Explain to me the difference between Name Node and Secondary Name Node

0 votes
I am a newbie to Big Data thing. I have a doubt related to the Hadoop Architecture. Is it like the Secondary Name Node stand up as a backup to the Name Node?

If Yes,

Then, Why does Hadoop go to "Hadoop not available" state when the Name Node fails?

Please help me learn this.
Jun 21 in Big Data Hadoop by nitinrawat895
• 10,670 points
44 views

2 answers to this question.

0 votes

First of all, 

Let us begin with the architecture.

Now the above image represents the architecture of Hadoop.

Let me explain u in detail.

Here you have the following

  • Name Node 
  • Data Node
  • Secondary Name Node

Secondary Name Node acts as a buffer to the Name Node, Not as its Back up. It stores the intermediate updates of the FS in a file called edit-log and updates them to the Final FS Image when Name Node is inactive. 

We are currently updated to Hadoop Version 2.x and it is no more related to the Secondary Name Node. It is replaced by the Standby Name node Which acts as a stand by to the actual name node and handles the Name Node Failures.

answered Jun 21 by ravikiran
• 4,560 points
0 votes

Secondary namenode is just a helper for Namenode. It gets the edit logs from the namenode in regular intervals and applies to fsimage. Once it has new fsimage, it copies back to namenode. Namenode will use this fsimage for the next restart, which will reduce the startup time. Secondary Namenode's whole purpose is to have a checkpoint in HDFS. Its just a helper node for namenode. That’s why it also known as checkpoint node. But, It cant replace namenode on namenode's failure.

So, Namenode still is Single-Point-of-Failure. To overcome this issue; STANDBY-NAMENODE comes into picture.

It does three things:

  1. merging fsimage and edits-log files. (Secondary-namenode's work)
  2. receive online updates of the file system meta-data, apply them to its memory state and persist them on disks just like the name-node does.

Thus at any time the Backup node contains an up-to-date image of the namespace both in memory and on local disk(s).

      3. Cluster will switch over to the new name-node (this standby-node) if the active namenode dies.

 

answered Aug 6 by Dhiman

Related Questions In Big Data Hadoop

+1 vote
1 answer

Explain to me the difference between HBase and HDFS

Let's start from scratch. Hadoop basically consists of three ...READ MORE

answered Mar 19 in Big Data Hadoop by nitinrawat895
• 10,670 points
64 views
0 votes
1 answer

Explain to me the difference between HBase and HDFS.

Hadoop generally consists of three major components: HDFS It ...READ MORE

answered Apr 12 in Big Data Hadoop by ravikiran
• 4,560 points
151 views
0 votes
1 answer

Explain to me the difference between HadoopHDFS and HBase.

Let me explain the major differences between ...READ MORE

answered May 13 in Big Data Hadoop by ravikiran
• 4,560 points

edited May 14 by Omkar 26 views
0 votes
0 answers

Difference between Name node and Secondary Name node

Explain to me the difference between the ...READ MORE

Mar 26 in Big Data Hadoop by nitinrawat895
• 10,670 points
21 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,670 points
2,725 views
0 votes
10 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
13,507 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,240 points
989 views
0 votes
1 answer
0 votes
1 answer

Explain to me the difference between name node and secondary name node.

Firstly, You need to understand the major ...READ MORE

answered Apr 30 in Big Data Hadoop by ravikiran
• 4,560 points
45 views
+1 vote
1 answer