Method to schedule the number of Mappers and Reducers in a Hadoop MapReduce Tsk.

0 votes
Am trying to Schedule a MapReduce job where in which I had programmed mapper tasks to a limited number of 20 and on the other hand I had Programmed the Reducer Tasks to 0 but, Still, I ended up at getting a value other than zero. The system is unc=successful in displaying the time consumed to perform the task and am unable to understand where am I going wrong. Can anyone help me?
Apr 25 in Big Data Hadoop by nitinrawat895
• 10,670 points
53 views

1 answer to this question.

0 votes

The number of Mapper tasks for a particular job is always equal to the number of input splits which means for each and every input split a Mapper task gets deposited. so the bottom line is that the entire cycle of MapReduce job might have a certain number of input splits to which they might have got themselves the equal number of Mapper tasks.

In your case, You might have input splits exceeding 20 to which you might have got the same number of Mapper Tasks 

You can get more detailed information on this link.

answered Apr 25 by ravikiran
• 4,560 points

Related Questions In Big Data Hadoop

0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,670 points
2,704 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,670 points
284 views
0 votes
10 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
13,452 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,240 points
985 views
0 votes
1 answer

Explain to me the Elasticsearch and Hadoop in a much better manner

I understand your problem, I suggest you download ...READ MORE

answered May 10 in Big Data Hadoop by ravikiran
• 4,560 points
40 views
0 votes
1 answer

Explain to me the method to transfer data between Azure tables and Hadoop on Azure

this article on HiveStorageHandler will let you create ...READ MORE

answered May 2 in Big Data Hadoop by ravikiran
• 4,560 points
32 views