2 datanodes is slower how to get those details what is your approach as hadoop admin

+1 vote
2 datanodes is slower ,how to get those details .what is your approach as hadoop admin ?
Sep 21, 2019 in Big Data Hadoop by raghavendra
• 160 points
1,505 views

1 answer to this question.

+1 vote

First, enable the detection of slow nodes. You can do this by setting the value of dfs.namenode.peer.stats.enabled property to true. 

<property>
 <name>dfs.datanode.peer.stats.enabled</name>
 <value>true</value> 
</property>

Let the cluster run for sometime. 

To access the details, visit: http://<namenode_host>:50070/jmx

Here you will see the time taken by datanodes. After you have detected the datanodes that are slow, you have to check for the bottlenecks in data flow. 

answered Sep 23, 2019 by Riya

Related Questions In Big Data Hadoop

0 votes
11 answers
0 votes
1 answer
0 votes
1 answer

What is Custom partitioner in Hadoop? How to write partition function ?

Don't think that in Hadoop the same ...READ MORE

answered Sep 18, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,372 views
0 votes
1 answer

What is Modeling data in Hadoop and how to do it?

I suggest spending some time with Apache ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,568 views
0 votes
1 answer

What is the command to find the free space in HDFS?

You can use dfsadmin which runs a ...READ MORE

answered Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,870 views
0 votes
1 answer

How to find the used cache in HDFS

hdfs dfsadmin -report This command tells fs ...READ MORE

answered May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,054 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
10,599 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,206 views
+2 votes
1 answer

how to escape delimiter in hive?

Refer to the below code used to ...READ MORE

answered Oct 31, 2019 in Big Data Hadoop by Kiran
7,138 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP