What is the use of setting the name of the job in mapreduce

0 votes

What is the use of setting the name of the job? We do something like this:  

Job job = new Job(conf,"alphabetCounterJob");

and why does Eclipse show that this statement is deprecated?

Jul 10, 2019 in Big Data Hadoop by Quill
550 views

1 answer to this question.

0 votes

Job job = new Job(conf,"job_name") is just used for setting the user-specified job name. Setting the job name is not mandatory since the job will be assigned a job id anyways. But, if we set a job name it becomes easier to track the status of the job while the job is running. This may not be useful a single small job running but this becomes essential when multiple large jobs are running on the cluster. The job status can be checked using the below command:

yarn application -appStates RUNNING -list

I am running a basic wordcount map-reduce job and simultaneously also keeping an eye on the status of the job by running the above command in a separate terminal. Please refer to the below screenshot and also notice the progress percentage:

image

Eclipse shows the statement as deprecated because the construction of the Job class that is Job(Confiuration conf, String jobName) is now deprecated. Instead of this, if you use the below code, most probably you will not be getting deprecated warning:

job.setJobName("mywc");
answered Jul 10, 2019 by Umesh

Related Questions In Big Data Hadoop

0 votes
1 answer

Mapreduce: What is the use of setting the name of the job?

Job job = new Job(conf,"job_name"), is just ...READ MORE

answered Jul 22, 2019 in Big Data Hadoop by Madhu
1,086 views
0 votes
1 answer

What is the use of sequence file in Hadoop?

Sequence files are binary files containing serialized ...READ MORE

answered Apr 6, 2018 in Big Data Hadoop by Ashish
• 2,650 points
9,524 views
0 votes
1 answer

What happens in a MapReduce job when you set the number of reducers to one?

If you set number of reducers as ...READ MORE

answered Jul 31, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,023 views
0 votes
1 answer

What is the use of ZooKeeper in Hbase?

Hey, The zookeeper is used to maintain the ...READ MORE

answered May 21, 2019 in Big Data Hadoop by Gitika
• 65,890 points
2,929 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
10,929 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,455 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
108,330 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,549 views
0 votes
1 answer

What is the use of fsimage in hadoop?

The NameNode stores modifications to the file ...READ MORE

answered Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,230 points
24,875 views
0 votes
1 answer

What is the use of parser in Apache pig?

Hey, It is correct that it comes under ...READ MORE

answered May 8, 2019 in Big Data Hadoop by Gitika
• 65,890 points
1,069 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP