Method to schedule the number of Mappers and Reducers in a Hadoop MapReduce Tsk.

0 votes
Am trying to Schedule a MapReduce job where in which I had programmed mapper tasks to a limited number of 20 and on the other hand I had Programmed the Reducer Tasks to 0 but, Still, I ended up at getting a value other than zero. The system is unc=successful in displaying the time consumed to perform the task and am unable to understand where am I going wrong. Can anyone help me?
Apr 25, 2019 in Big Data Hadoop by nitinrawat895
• 10,950 points
138 views

1 answer to this question.

0 votes

The number of Mapper tasks for a particular job is always equal to the number of input splits which means for each and every input split a Mapper task gets deposited. so the bottom line is that the entire cycle of MapReduce job might have a certain number of input splits to which they might have got themselves the equal number of Mapper tasks.

In your case, You might have input splits exceeding 20 to which you might have got the same number of Mapper Tasks 

You can get more detailed information on this link.

answered Apr 25, 2019 by ravikiran
• 4,600 points

Related Questions In Big Data Hadoop

0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

How to find the number of blocks for a file in Hadoop?

Hi@akhtar, You can use Hadoop file system command to ...READ MORE

answered Oct 13 in Big Data Hadoop by MD
• 66,980 points
103 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,950 points
6,128 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,950 points
935 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyF ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
39,710 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,320 points
2,302 views
0 votes
1 answer

Explain to me the Elasticsearch and Hadoop in a much better manner

I understand your problem, I suggest you download ...READ MORE

answered May 10, 2019 in Big Data Hadoop by ravikiran
• 4,600 points
80 views
0 votes
1 answer

Explain to me the method to transfer data between Azure tables and Hadoop on Azure

this article on HiveStorageHandler will let you create ...READ MORE

answered May 2, 2019 in Big Data Hadoop by ravikiran
• 4,600 points
74 views