Requirement Suppose you have a data files which are having duplicate records i.e. a line of a file is occurring more than one times. You want those records which are present multiple times in the file. So the requirement is to find the duplicate record using Map Reduce. Components InvolvedRead More →
Requirement There are many data files available. It is required to find out the total number of records available in data files using Map Reduce. Components Involved HDFS: To store the input data which will be passed to the Map Reduce as an input and also store the map reduce output.Read More →
Requirement Suppose you get data files which are having user’s basic information like first name, last name, designation, city, etc. These basic details are separated by ‘,’ delimiter. Now, the requirement has come to find out all the duplicate value of any field of information. So, here the requirement isRead More →
Requirement Suppose you have a file in which many words are repeated. Now the requirement is to get distinct words from the file using Map Reduce. If you compare with the SQL, then we have to write a map reduce program which is similar to the DISTINCT function of SQL.Read More →
