When is an identity mapper reducer used

0 votes
I have two doubts

1. When is iterative MapReduce used ?

2.When is identity MapReduce used ?
Apr 3, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
2,228 views

1 answer to this question.

0 votes
1.One of the simplest example of Iterative Mapreduce is K-Means Clustering.

We have the same input which is mapped into clusters then the output from mapper is used for making new clusters.

2. Identity Mappers and Reducers don't have a body, it only generates key-value pairs and the package is org.apache.hadoop.mapred.identity.

Identity Mapper and Reducer just like the concept of Identity function in mathematics i.e. do not transform the input and return it as it is in output form

An identity mapper is used can be used (among others!) if you would only want to sort your input.

Identity reducer is a bit different. It does not mean that the reduce step will not take place. It will take place and the related sorting/shuffling will also be performed but there will be no aggregation.

Hope this helps
answered Apr 3, 2018 by Ashish
• 2,650 points

Related Questions In Big Data Hadoop

0 votes
1 answer
0 votes
1 answer

when is hadoop useful for an application?

Hadoop is a software framework for storing ...READ MORE

answered Dec 20, 2021 in Big Data Hadoop by CoderGirl
• 500 points
727 views
0 votes
1 answer

How can I get the respective Bitcoin value for an input in USD when using c#

Simply make call to server and parse ...READ MORE

answered Mar 25, 2018 in Big Data Hadoop by charlie_brown
• 7,720 points
1,079 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
11,076 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,573 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
109,071 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
4,641 views
0 votes
1 answer

What Distributed Cache is actually used for in Hadoop?

Basically distributed cache allows you to cache ...READ MORE

answered Apr 3, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,184 views
0 votes
1 answer

Why Apache Pig is used instead of Hadoop?

As you know writing mapreduce programs in ...READ MORE

answered May 8, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,486 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP