Method to schedule the number of Mappers and Reducers in a Hadoop MapReduce Tsk

0 votes
Am trying to Schedule a MapReduce job where in which I had programmed mapper tasks to a limited number of 20 and on the other hand I had Programmed the Reducer Tasks to 0 but, Still, I ended up at getting a value other than zero. The system is unc=successful in displaying the time consumed to perform the task and am unable to understand where am I going wrong. Can anyone help me?
Apr 25, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
624 views

1 answer to this question.

0 votes

The number of Mapper tasks for a particular job is always equal to the number of input splits which means for each and every input split a Mapper task gets deposited. so the bottom line is that the entire cycle of MapReduce job might have a certain number of input splits to which they might have got themselves the equal number of Mapper tasks.

In your case, You might have input splits exceeding 20 to which you might have got the same number of Mapper Tasks 

You can get more detailed information on this link.

answered Apr 25, 2019 by ravikiran
• 4,620 points

Related Questions In Big Data Hadoop

0 votes
1 answer

What happens in a MapReduce job when you set the number of reducers to one?

If you set number of reducers as ...READ MORE

answered Jul 31, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,832 views
0 votes
1 answer
0 votes
1 answer

How to find the number of blocks for a file in Hadoop?

Hi@akhtar, You can use Hadoop file system command to ...READ MORE

answered Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
1,945 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
10,619 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,216 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
104,977 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,298 views
0 votes
1 answer

Explain to me the Elasticsearch and Hadoop in a much better manner

I understand your problem, I suggest you download ...READ MORE

answered May 10, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
464 views
0 votes
1 answer

Explain to me the method to transfer data between Azure tables and Hadoop on Azure

this article on HiveStorageHandler will let you create ...READ MORE

answered May 3, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
409 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP