What does NameNode stores and where it stores

0 votes

What is stored in NameNode memory and how it is stored? How it manages the metadata that is continuously getting updated?

Apr 15, 2018 in Big Data Hadoop by coldcode
• 2,080 points
5,266 views

1 answer to this question.

0 votes

NameNode records the metadata of all the files stored in the cluster, such as location of blocks stored, size of the files, permissions, hierarchy, etc. There are two files associated with the metadata:

  • FsImage: Contains the complete state of the file system namespace since the start of the NameNode.
  • EditLogs: It contains all the recent modifications made to the file system with respect to the most recent FsImage.

If a file is deleted in HDFS, the NameNode will immediately record this in the EditLog.

The Secondary NameNode is one which constantly reads all the file systems and metadata from the RAM of the NameNode and writes it into the hard disk or the file system. It is responsible for combining the EditLogs with FsImage from the NameNode. 

Secondary NameNode downloads the EditLogs from the NameNode at regular intervals and applies to FsImage. The new FsImage is copied back to the NameNode, which is used whenever the NameNode is started the next time.

answered Apr 15, 2018 by Shubham
• 13,490 points

Related Questions In Big Data Hadoop

0 votes
11 answers

What is the default Namenode port of HDFS. Is it 8020 or 9000 or 50070?

8020/9000 hadoop namenode metadata port number. or ...READ MORE

answered Dec 31, 2018 in Big Data Hadoop by SM
59,206 views
0 votes
1 answer

What is Modeling data in Hadoop and how to do it?

I suggest spending some time with Apache ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,555 views
+1 vote
1 answer

What is difference between Hadoop Namenode HA and HDFS federation?

The main difference between HDFS High Availability ...READ MORE

answered Oct 31, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,026 views
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

answered Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,370 views
0 votes
1 answer

What is pig storage and why it is used?

Hello, In pig, there is a default load ...READ MORE

answered May 8, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited May 8, 2019 by Gitika 1,427 views
0 votes
1 answer
0 votes
1 answer

Where does hive stores its table?

With an external table the data itself ...READ MORE

answered Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,910 points
515 views
0 votes
3 answers

What are differences between NameNode and Secondary NameNode?

File metadata information is stored by Namenode ...READ MORE

answered Apr 8, 2019 in Big Data Hadoop by anonymous
14,176 views
0 votes
1 answer

Where does HDFS stores data on the local file system?

First find the Hadoop directory present in ...READ MORE

answered May 8, 2018 in Big Data Hadoop by Shubham
• 13,490 points
15,620 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP