Replication Factor in Hadoop

0 votes
I have 10 TB data and the whole size of the combined cluster is 14 TB
I have set the Replication factor to 2.

In this case how it will replicate the data?

Due to the Replication factor, the minimum size of the storage on the cluster must be double the size of the Data,

Is this something that Hadoop can't solve, or its a loophole?
Apr 18, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,274 views

1 answer to this question.

0 votes
If you have provided a replication factor of 2 and the free space available on the cluster is not twice the amount of data to be replicated, it will result in an under-replicated block.  

It's not something that's unsolvable.

It's as simple as that, you can't fit in something if you don't have space. It can't appear magically. Dude.
answered Apr 18, 2018 by kurt_cobain
• 9,350 points

Related Questions In Big Data Hadoop

0 votes
1 answer

How to change the replication factor of specific directory in Hadoop?

Yes, you can change the replication factor ...READ MORE

answered May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,694 views
0 votes
1 answer

How to set replication factor in Hadoop?

Hi@akhtar, You can find setrep command in the ...READ MORE

answered Oct 1, 2020 in Big Data Hadoop by MD
• 95,460 points
7,948 views
0 votes
1 answer

How to change the default replication factor in Hadoop?

Hi@akhtar, You can change the default replication factor from the ...READ MORE

answered Oct 3, 2020 in Big Data Hadoop by MD
• 95,460 points
1,844 views
0 votes
1 answer

How to run Hadoop in Docker containers?

Hi, You can run Hadoop in Docker container. Follow ...READ MORE

answered Jan 24, 2020 in Big Data Hadoop by MD
• 95,460 points
2,250 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
4,643 views
0 votes
1 answer

“no such file or directory" in case of hadoop fs -ls

The behaviour that you are seeing is ...READ MORE

answered May 9, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points

edited May 9, 2018 by nitinrawat895 8,266 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
11,078 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,575 views
0 votes
1 answer

When hadoop-env.sh will be executed in hadoop

Yes you need to put in the ...READ MORE

answered Apr 3, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
1,259 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP