Meaning of fs defaultFS property in core-site xml in hadoop

0 votes

I am installing Hadoop distributed mode cluster, and I have downloaded Hadoop and extracted the compressed file. While editing the configuration file, I am having some doubts. What does the fs.defaultFS property does in core-site.xml file.

I have 3 nodes:

192.168.101.1 --> Master Machine (NameNode, SecondaryNameNode & ResourceManager daemons)

192.168.101.2 --> Slave1 (Datanode & NodeManager daemons)

192.168.103.3 --> Slave2 (Datanode & NodeManager daemons)

My configuration is as below:

<property>
   <name>fs.default.name</name>
   <value>hdfs://192.168.1.2:9000/</value>
</property>

Do we have to pass the address of the NameNode here?

Apr 15, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,985 views

2 answers to this question.

0 votes

fs.default.name property in core-site.xml tells the address of the NameNode and all the HDFS command refers to the this NameNode address. It tells the default HDFS address.

9000 is the port where the datanode will send heartbeat to namenode.

answered Apr 15, 2018 by Shubham
• 13,480 points
0 votes

It allows to run dfs commands more easily. Otherwise we have to give the full site name.

For Example

To remove file from hdfs, we use $ hdfs dfs -rm instead of $ hdfs dfs -rm hdfs://hdfs/.

Thank you

answered Jan 22, 2020 by MD
• 95,060 points

Related Questions In Big Data Hadoop

+1 vote
1 answer

Where to set hadoop.tmp.dir? core-site.xml or hdfs-site.xml?

hadoop.tmp.dir (A base for other temporary directories) is ...READ MORE

answered Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
4,898 views
0 votes
1 answer

“no such file or directory" in case of hadoop fs -ls

The behaviour that you are seeing is ...READ MORE

answered May 9, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points

edited May 9, 2018 by nitinrawat895 5,334 views
0 votes
1 answer

Can I have a list of property files used in Hadoop Framework?

Here is a complete list of configuration ...READ MORE

answered Aug 14, 2018 in Big Data Hadoop by Frankie
• 9,810 points
159 views
0 votes
1 answer

What is the meaning of Write Ahead Log in Hadoop?

Write Ahead Log (WAL) is a file ...READ MORE

answered Nov 20, 2018 in Big Data Hadoop by Sunil
542 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
6,811 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
47,772 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,587 views
0 votes
1 answer
0 votes
1 answer

Changing hostname in fs.default.name property puts Hadoop in safemode

First of all, in Safe mode the ...READ MORE

answered Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,480 points
1,056 views
0 votes
1 answer

How to change the replication factor of specific directory in Hadoop?

Yes, you can change the replication factor ...READ MORE

answered May 10, 2018 in Big Data Hadoop by Shubham
• 13,480 points
1,708 views