What is Shuffle Phase

0 votes
I'm new to map reduce and Hadoop. What is a Shuffle Phase?
May 30, 2018 in Big Data Hadoop by shams
• 3,660 points
421 views

2 answers to this question.

0 votes

Once the first map tasks are completed, the nodes continue to perform several other map tasks and also exchange the intermediate outputs with the reducers as required. This process of moving the intermediate outputs of map tasks to the reducer is referred to as Shuffling.

answered May 30, 2018 by kurt_cobain
• 9,390 points
0 votes
The process where the intermediate results from the mapper are passed on to the reducer is called shuffle phase.
answered Mar 27, 2019 by Krishnan
• 140 points
Hello @Krishnan. Thanks for your answer. I have another doubt. Is the shuffle phase just the time period where results are passed from mapper to reducer or does something happen in this phase?

Related Questions In Big Data Hadoop

0 votes
1 answer

What is the purpose of shuffling and sorting phase in the reducer in Map Reduce?

Hi@akhtar, Shuffle phase in Hadoop transfers the map output from ...READ MORE

answered Dec 20, 2020 in Big Data Hadoop by MD
• 95,040 points
269 views
0 votes
10 answers

What is the difference between Mongodb and Hadoop?

Apart from the similarity that they are ...READ MORE

answered Dec 6, 2018 in Big Data Hadoop by Deeraj
6,949 views
0 votes
3 answers

What is Hive? Is Hive a database?

Hive is a data Warehouse infrastructure/system built ...READ MORE

answered Jul 1, 2019 in Big Data Hadoop by Ved Gupta
15,855 views
0 votes
13 answers

What is the difference between Hadoop/HDFS & HBase?

HDFS is a distributed file system whereas ...READ MORE

answered Apr 26, 2019 in Big Data Hadoop by Arihar
• 160 points
22,962 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
6,865 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
48,517 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,605 views
0 votes
1 answer
0 votes
1 answer

What is ClickStream Data Analysis

On a Web site, clickstream analysis (also ...READ MORE

answered Mar 21, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
137 views
0 votes
1 answer

What is Hadoop Distribution ?

Some companies release or sell products that ...READ MORE

answered Mar 27, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
223 views