What does NameNode stores and where it stores?

0 votes

What is stored in NameNode memory and how it is stored? How it manages the metadata that is continuously getting updated?

Apr 15, 2018 in Big Data Hadoop by coldcode
• 2,020 points
89 views

1 answer to this question.

0 votes

NameNode records the metadata of all the files stored in the cluster, such as location of blocks stored, size of the files, permissions, hierarchy, etc. There are two files associated with the metadata:

  • FsImage: Contains the complete state of the file system namespace since the start of the NameNode.
  • EditLogs: It contains all the recent modifications made to the file system with respect to the most recent FsImage.

If a file is deleted in HDFS, the NameNode will immediately record this in the EditLog.

The Secondary NameNode is one which constantly reads all the file systems and metadata from the RAM of the NameNode and writes it into the hard disk or the file system. It is responsible for combining the EditLogs with FsImage from the NameNode. 

Secondary NameNode downloads the EditLogs from the NameNode at regular intervals and applies to FsImage. The new FsImage is copied back to the NameNode, which is used whenever the NameNode is started the next time.

answered Apr 15, 2018 by Shubham
• 13,300 points

Related Questions In Big Data Hadoop

0 votes
11 answers

What is the default Namenode port of HDFS. Is it 8020 or 9000 or 50070?

8020/9000 hadoop namenode metadata port number. or ...READ MORE

answered Dec 31, 2018 in Big Data Hadoop by SM
11,704 views
0 votes
1 answer

What is Modeling data in Hadoop and how to do it?

I suggest spending some time with Apache ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,810 points
99 views
+1 vote
1 answer

What is difference between Hadoop Namenode HA and HDFS federation?

The main difference between HDFS High Availability ...READ MORE

answered Oct 30, 2018 in Big Data Hadoop by Frankie
• 9,810 points
238 views
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

answered Dec 20, 2018 in Big Data Hadoop by Omkar
• 67,620 points
75 views
0 votes
1 answer

What is pig storage and why it is used?

Hello, In pig, there is a default load ...READ MORE

answered May 7 in Big Data Hadoop by Gitika
• 25,340 points

edited May 7 by Gitika 65 views
0 votes
10 answers

What is the difference between Mongodb and Hadoop?

Apart from the similarity that they are ...READ MORE

answered Dec 6, 2018 in Big Data Hadoop by Deeraj
2,537 views
0 votes
1 answer
0 votes
3 answers

What are differences between NameNode and Secondary NameNode?

File metadata information is stored by Namenode ...READ MORE

answered Apr 7 in Big Data Hadoop by anonymous
1,960 views
0 votes
1 answer

Where does HDFS stores data on the local file system?

First find the Hadoop directory present in ...READ MORE

answered May 8, 2018 in Big Data Hadoop by Shubham
• 13,300 points
1,653 views