2 datanodes is slower ,how to get those details .what is your approach as hadoop admin

+1 vote
2 datanodes is slower ,how to get those details .what is your approach as hadoop admin ?
Sep 21, 2019 in Big Data Hadoop by raghavendra
• 160 points
208 views

1 answer to this question.

+1 vote

First, enable the detection of slow nodes. You can do this by setting the value of dfs.namenode.peer.stats.enabled property to true. 

<property>
 <name>dfs.datanode.peer.stats.enabled</name>
 <value>true</value> 
</property>

Let the cluster run for sometime. 

To access the details, visit: http://<namenode_host>:50070/jmx

Here you will see the time taken by datanodes. After you have detected the datanodes that are slow, you have to check for the bottlenecks in data flow. 

answered Sep 23, 2019 by Riya

Related Questions In Big Data Hadoop

0 votes
11 answers
0 votes
1 answer
0 votes
1 answer

What is Custom partitioner in Hadoop? How to write partition function ?

Don't think that in Hadoop the same ...READ MORE

answered Sep 18, 2018 in Big Data Hadoop by Frankie
• 9,810 points
301 views
0 votes
1 answer

What is Modeling data in Hadoop and how to do it?

I suggest spending some time with Apache ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,810 points
221 views
0 votes
1 answer

What is the command to find the free space in HDFS?

You can use dfsadmin which runs a ...READ MORE

answered Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,380 points
396 views
0 votes
1 answer

How to find the used cache in HDFS

hdfs dfsadmin -report This command tells fs ...READ MORE

answered May 4, 2018 in Big Data Hadoop by Shubham
• 13,380 points
431 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,850 points
4,492 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,850 points
638 views
+1 vote
1 answer

how to escape delimiter in hive?

Refer to the below code used to ...READ MORE

answered Oct 31, 2019 in Big Data Hadoop by Kiran
633 views