What is the use of setting the name of the job in mapreduce?

0 votes

What is the use of setting the name of the job? We do something like this:  

Job job = new Job(conf,"alphabetCounterJob");

and why does Eclipse show that this statement is deprecated?

Jul 9 in Big Data Hadoop by Quill
23 views

1 answer to this question.

0 votes

Job job = new Job(conf,"job_name") is just used for setting the user-specified job name. Setting the job name is not mandatory since the job will be assigned a job id anyways. But, if we set a job name it becomes easier to track the status of the job while the job is running. This may not be useful a single small job running but this becomes essential when multiple large jobs are running on the cluster. The job status can be checked using the below command:

yarn application -appStates RUNNING -list

I am running a basic wordcount map-reduce job and simultaneously also keeping an eye on the status of the job by running the above command in a separate terminal. Please refer to the below screenshot and also notice the progress percentage:

image

Eclipse shows the statement as deprecated because the construction of the Job class that is Job(Confiuration conf, String jobName) is now deprecated. Instead of this, if you use the below code, most probably you will not be getting deprecated warning:

job.setJobName("mywc");
answered Jul 9 by Umesh

Related Questions In Big Data Hadoop

0 votes
1 answer

Mapreduce: What is the use of setting the name of the job?

Job job = new Job(conf,"job_name"), is just ...READ MORE

answered Jul 22 in Big Data Hadoop by Madhu
18 views
0 votes
1 answer

What is the use of sequence file in Hadoop?

Sequence files are binary files containing serialized ...READ MORE

answered Apr 5, 2018 in Big Data Hadoop by Ashish
• 2,630 points
1,199 views
0 votes
1 answer
0 votes
1 answer

What is the use of ZooKeeper in Hbase?

Hey, The zookeeper is used to maintain the ...READ MORE

answered May 21 in Big Data Hadoop by Gitika
• 25,340 points
57 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,670 points
2,735 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,670 points
289 views
0 votes
10 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
13,553 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,240 points
992 views
–1 vote
1 answer

What is the use of fsimage in hadoop?

The NameNode stores modifications to the file ...READ MORE

answered Dec 20, 2018 in Big Data Hadoop by Omkar
• 67,480 points
1,509 views
0 votes
1 answer

What is the use of parser in Apache pig?

Hey, It is correct that it comes under ...READ MORE

answered May 7 in Big Data Hadoop by Gitika
• 25,340 points
40 views