What is the use of setting the name of the job in mapreduce?

0 votes

What is the use of setting the name of the job? We do something like this:  

Job job = new Job(conf,"alphabetCounterJob");

and why does Eclipse show that this statement is deprecated?

Jul 9, 2019 in Big Data Hadoop by Quill
86 views

1 answer to this question.

0 votes

Job job = new Job(conf,"job_name") is just used for setting the user-specified job name. Setting the job name is not mandatory since the job will be assigned a job id anyways. But, if we set a job name it becomes easier to track the status of the job while the job is running. This may not be useful a single small job running but this becomes essential when multiple large jobs are running on the cluster. The job status can be checked using the below command:

yarn application -appStates RUNNING -list

I am running a basic wordcount map-reduce job and simultaneously also keeping an eye on the status of the job by running the above command in a separate terminal. Please refer to the below screenshot and also notice the progress percentage:

image

Eclipse shows the statement as deprecated because the construction of the Job class that is Job(Confiuration conf, String jobName) is now deprecated. Instead of this, if you use the below code, most probably you will not be getting deprecated warning:

job.setJobName("mywc");
answered Jul 9, 2019 by Umesh

Related Questions In Big Data Hadoop

0 votes
1 answer

Mapreduce: What is the use of setting the name of the job?

Job job = new Job(conf,"job_name"), is just ...READ MORE

answered Jul 22, 2019 in Big Data Hadoop by Madhu
110 views
0 votes
1 answer

What is the use of sequence file in Hadoop?

Sequence files are binary files containing serialized ...READ MORE

answered Apr 5, 2018 in Big Data Hadoop by Ashish
• 2,650 points
4,255 views
0 votes
1 answer
0 votes
1 answer

What is the use of ZooKeeper in Hbase?

Hey, The zookeeper is used to maintain the ...READ MORE

answered May 21, 2019 in Big Data Hadoop by Gitika
• 36,890 points
803 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,950 points
5,843 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,950 points
872 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyF ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
36,714 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,320 points
2,187 views
0 votes
1 answer

What is the use of fsimage in hadoop?

The NameNode stores modifications to the file ...READ MORE

answered Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,030 points
8,657 views
0 votes
1 answer

What is the use of parser in Apache pig?

Hey, It is correct that it comes under ...READ MORE

answered May 7, 2019 in Big Data Hadoop by Gitika
• 36,890 points
139 views