2 datanodes is slower ,how to get those details .what is your approach as hadoop admin

+1 vote
2 datanodes is slower ,how to get those details .what is your approach as hadoop admin ?
Sep 21 in Big Data Hadoop by raghavendra
• 160 points
136 views

1 answer to this question.

+1 vote

First, enable the detection of slow nodes. You can do this by setting the value of dfs.namenode.peer.stats.enabled property to true. 

<property>
 <name>dfs.datanode.peer.stats.enabled</name>
 <value>true</value> 
</property>

Let the cluster run for sometime. 

To access the details, visit: http://<namenode_host>:50070/jmx

Here you will see the time taken by datanodes. After you have detected the datanodes that are slow, you have to check for the bottlenecks in data flow. 

answered Sep 23 by Riya

Related Questions In Big Data Hadoop

0 votes
11 answers
0 votes
1 answer
0 votes
1 answer

What is Custom partitioner in Hadoop? How to write partition function ?

Don't think that in Hadoop the same ...READ MORE

answered Sep 18, 2018 in Big Data Hadoop by Frankie
• 9,810 points
211 views
0 votes
1 answer

What is Modeling data in Hadoop and how to do it?

I suggest spending some time with Apache ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,810 points
130 views
0 votes
1 answer

What is the command to know the details of your data created in a table in Hive?

Hey, Yes, there is a way to check ...READ MORE

answered May 14 in Big Data Hadoop by Gitika
• 25,420 points
179 views
0 votes
1 answer

What is the command to find the free space in HDFS?

You can use dfsadmin which runs a ...READ MORE

answered Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,350 points
269 views
0 votes
1 answer

How to find the used cache in HDFS

hdfs dfsadmin -report This command tells fs ...READ MORE

answered May 4, 2018 in Big Data Hadoop by Shubham
• 13,350 points
301 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,800 points
3,571 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,800 points
453 views
+1 vote
1 answer

how to escape delimiter in hive?

Refer to the below code used to ...READ MORE

answered Oct 31 in Big Data Hadoop by Kiran
97 views