Meaning of fs defaultFS property in core-site xml in hadoop

0 votes

I am installing Hadoop distributed mode cluster, and I have downloaded Hadoop and extracted the compressed file. While editing the configuration file, I am having some doubts. What does the fs.defaultFS property does in core-site.xml file.

I have 3 nodes:

192.168.101.1 --> Master Machine (NameNode, SecondaryNameNode & ResourceManager daemons)

192.168.101.2 --> Slave1 (Datanode & NodeManager daemons)

192.168.103.3 --> Slave2 (Datanode & NodeManager daemons)

My configuration is as below:

<property>
   <name>fs.default.name</name>
   <value>hdfs://192.168.1.2:9000/</value>
</property>

Do we have to pass the address of the NameNode here?

Apr 15, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
4,274 views

2 answers to this question.

0 votes

fs.default.name property in core-site.xml tells the address of the NameNode and all the HDFS command refers to the this NameNode address. It tells the default HDFS address.

9000 is the port where the datanode will send heartbeat to namenode.

answered Apr 15, 2018 by Shubham
• 13,480 points
0 votes

It allows to run dfs commands more easily. Otherwise we have to give the full site name.

For Example

To remove file from hdfs, we use $ hdfs dfs -rm instead of $ hdfs dfs -rm hdfs://hdfs/.

Thank you

answered Jan 22, 2020 by MD
• 95,160 points

Related Questions In Big Data Hadoop

+1 vote
1 answer

Where to set hadoop.tmp.dir? core-site.xml or hdfs-site.xml?

hadoop.tmp.dir (A base for other temporary directories) is ...READ MORE

answered Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
5,287 views
0 votes
1 answer

“no such file or directory" in case of hadoop fs -ls

The behaviour that you are seeing is ...READ MORE

answered May 9, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points

edited May 9, 2018 by nitinrawat895 5,662 views
0 votes
1 answer

Can I have a list of property files used in Hadoop Framework?

Here is a complete list of configuration ...READ MORE

answered Aug 14, 2018 in Big Data Hadoop by Frankie
• 9,810 points
185 views
0 votes
1 answer

What is the meaning of Write Ahead Log in Hadoop?

Write Ahead Log (WAL) is a file ...READ MORE

answered Nov 20, 2018 in Big Data Hadoop by Sunil
624 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
7,196 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
52,661 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,724 views
0 votes
1 answer
0 votes
1 answer

Changing hostname in fs.default.name property puts Hadoop in safemode

First of all, in Safe mode the ...READ MORE

answered Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,480 points
1,140 views
0 votes
1 answer

How to change the replication factor of specific directory in Hadoop?

Yes, you can change the replication factor ...READ MORE

answered May 10, 2018 in Big Data Hadoop by Shubham
• 13,480 points
1,846 views