Submitting MapReduce job using jobConf object vs job object

0 votes

I am new to Hadoop & I am a bit confused about how to submit a job to Hadoop. Earlier I was submitting the job using the following command:

JobClient.runJob(jobconf);

But while going through an online tutorial, I found out that they are submitting the job using the below command:

Configuration conf = getConf();
Job job = new Job(conf, "secondary sort");

Can anyone explain me what is the difference between jobconf & job object? Which is the right way of submitting the job?

May 4, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,119 views

1 answer to this question.

0 votes

Both JobConf & Job objects are used for configuring & submitting the job. You can also control the execution using the objects. The only difference between them is JobConf object belong to the org.apache.hadoop.mapred package, which is the deprecated API, while Job object is from org.apache.hadoop.mapreduce package, which is the new API.

I would recommend using the new API.

You can refer the following link for the official documentation.

JobConf: https://hadoop.apache.org/docs/r2.7.3/api/org/apache/hadoop/mapred/JobConf.html

Job: https://hadoop.apache.org/docs/r2.7.3/api/org/apache/hadoop/mapreduce/Job.html
 

answered May 4, 2018 by Shubham
• 13,490 points

Related Questions In Big Data Hadoop

0 votes
1 answer

Hadoop MapReduce vs MongoDB MapReduce

Hadoop vs MongoDB MR: 1) Hadoop's MR can ...READ MORE

answered Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
712 views
0 votes
1 answer

How hadoop mapreduce job is submitted to worker nodes?

Alright, I think you are basically looking ...READ MORE

answered Mar 30, 2018 in Big Data Hadoop by Ashish
• 2,650 points
4,123 views
0 votes
1 answer

Error running hadoop mapreduce in Python using Hadoop Streaming

Hi As you write mapper and reducer program  ...READ MORE

answered Jan 21, 2020 in Big Data Hadoop by anonymous
1,113 views
0 votes
1 answer

What happens in a MapReduce job when you set the number of reducers to one?

If you set number of reducers as ...READ MORE

answered Jul 31, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,035 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
8,631 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
76,319 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
3,310 views
0 votes
1 answer
0 votes
1 answer

How do I parse pdf file using MapReduce?

If you have your own custom InputFormat(WholeFileInputFormat). ...READ MORE

answered Apr 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
670 views
0 votes
1 answer

Getting error in MapReduce job.setInputFormatClass

In old Hadoop API(i.e. below Hadoop 0.20.0), ...READ MORE

answered Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,175 views
webinar REGISTER FOR FREE WEBINAR X
Send OTP
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP