How does Hadoop s block replacement policy work

0 votes
I'm working on a Hadoop cluster and my cluster has nodes in seven racks, and I have provided a rack topology script. What is Hadoop's block placement policy, assuming a block replication factor of three?
Aug 16, 2018 in Big Data Hadoop by Meci Matt
• 9,460 points
1,183 views

1 answer to this question.

0 votes
In your case, One copy of the block is written to a node in one rack; two copies are written to two nodes in a different rack.
Actually, what happens is HDFS uses rack-aware replica placement policy. In default configuration there are total 3 copies of a datablock on HDFS, 2 copies are stored on datanodes on same rack and 3rd copy on a different rack.

Hope this helps!
answered Aug 16, 2018 by nitinrawat895
• 11,380 points

Related Questions In Big Data Hadoop

0 votes
1 answer

How does the HDFS Client knows the block size while writing?

HDFS is designed in a way where ...READ MORE

answered Mar 27, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
1,070 views
0 votes
1 answer

How does Avro schema evolution work?

If you have one avro file and ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
8,154 views
0 votes
1 answer

How does decreasing the block size make more space on Datanode?

When there is space in data nodes ...READ MORE

answered Jul 5, 2019 in Big Data Hadoop by Krish
836 views
+1 vote
1 answer

How does Hadoop process records split across block boundaries?

Interesting question, I spent some time looking ...READ MORE

answered Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,890 points
662 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,546 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
10,924 views
0 votes
1 answer

How to get started with Hadoop?

Well, hadoop is actually a framework that ...READ MORE

answered Mar 21, 2018 in Big Data Hadoop by coldcode
• 2,090 points
1,070 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
108,313 views
0 votes
1 answer

How to analyze block placement on datanodes and rebalancing data across Hadoop nodes?

HDFS provides a tool for administrators i.e. ...READ MORE

answered Jun 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
956 views
0 votes
1 answer

How does HDFS Federation help HDFS Scale horizontally?

Let me try to explain you the ...READ MORE

answered Jul 12, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,307 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP