What if Resource Manager fails?

0 votes
Hi. I am new to Hadoop and I was studying about the daemons. I started all the daemons and I saw that the ResourceManager was being turned off automatically. I solved that error but my question is what will happen if it fails on a Live system?
Jun 20 in Big Data Hadoop by Janan
62 views

1 answer to this question.

0 votes

Failure of the resource manager is serious because, without it, neither jobs nor task containers can be launched. In the default configuration, the resource manager is a single point of failure, since, in the (unlikely) event of machine failure, all running jobs fail—and can’t be recovered. 

To achieve high availability (HA), it is necessary to run a pair of resource managers in an active-standby configuration. If the active resource manager fails, then the standby can take over without significant interruption to the client.

Information about all the running applications is stored in a highly available state store (backed by ZooKeeper or HDFS), so that the standby can recover the core state of the failed active resource manager. Node manager information is not stored in the state store since it can be reconstructed relatively quickly by the new resource manager as the node managers send their first heartbeats.

When the new resource manager starts, it reads the application information from the state store, then restarts the application masters for all the applications running on the cluster. This does not count as a failed application attempt (so it does not count against yarn.resourcemanager.am.max-attempts), since the application did not fail due to an error in the application code, but was forcibly killed by the system.

answered Jun 20 by John

Related Questions In Big Data Hadoop

0 votes
1 answer
0 votes
2 answers
0 votes
1 answer

What will happen if the OOZIE_URL environment variable has not been set?

Hey, If the Oozie_URL environment variable has not ...READ MORE

answered Jun 24 in Big Data Hadoop by Gitika
• 25,340 points
33 views
0 votes
1 answer

What is the significance of ‘IF EXISTS” clause while dropping a table in Hive?

Hi, Since the table being dropped does not ...READ MORE

answered Jun 26 in Big Data Hadoop by Gitika
• 25,340 points
179 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,710 points
3,324 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,710 points
398 views
0 votes
10 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
16,422 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
1,197 views
0 votes
1 answer

How to set Resource Manager in Hue?

To set the Resource Manager host, open ...READ MORE

answered May 29 in Big Data Hadoop by Esha
57 views
0 votes
1 answer

Setting the resource manager port in Hue

Open the hue configuration file and search for the [[yarn_clusters]] sub-section. ...READ MORE

answered May 29 in Big Data Hadoop by Khan
23 views