What is the difference between MapReduce and YARN in Hadoop

0 votes
I am getting confused between MapReduce and YARN. Can someone explain me the difference?
Dec 19, 2018 in Big Data Hadoop by slayer
• 29,310 points
2,623 views

1 answer to this question.

0 votes

MapReduce:

MapReduce is an algorithm used to store data in HDFS. The MapReduce is divided into two important tasks, Map and Reduce. The Mapper takes a set of data and converts it into another set of data, in such a way that individual elements are stored as key/value pairs. In reduce task, the output from a map is taken as input and and the kep/value pair are combined into a smaller set of key/value pair.

YARN:

YARN is used to split up the functionalities of resource management and job scheduling/monitoring into separate daemons.

The ResourceManager assigns resources among all the applications in the system. The NodeManager is responsible for containers, monitoring their resource usage (CPU, memory, disk, network) and reporting the same to the ResourceManager/Scheduler.

answered Dec 19, 2018 by Omkar
• 69,170 points

Related Questions In Big Data Hadoop

0 votes
1 answer
0 votes
1 answer

What is the difference between Hadoop MapReduce and built-in MapReduce?

Differences are as follows: Hadoop's MR can be ...READ MORE

answered Sep 11, 2018 in Big Data Hadoop by Frankie
• 9,810 points
726 views
0 votes
10 answers

What is the difference between Mongodb and Hadoop?

MongoDB is a NoSQL database, whereas Hadoop is ...READ MORE

answered Jun 20, 2018 in Big Data Hadoop by jenny_code
8,444 views
0 votes
1 answer
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
7,902 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
1,331 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
62,735 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
3,000 views
0 votes
1 answer

Hadoop: What is the difference between `hadoop dfs` and `hadoop fs`?

You can find the definition here: $HADOOP_HOME/bin/hadoop ... elif [ ...READ MORE

answered Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,170 points
891 views
0 votes
1 answer

What is the difference between Map-side join and Reduce-side join?

Join is a clause that combines the records ...READ MORE

answered Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,170 points
2,546 views