Replication Factor in Hadoop

0 votes
I have 10 TB data and the whole size of the combined cluster is 14 TB
I have set the Replication factor to 2.

In this case how it will replicate the data?

Due to the Replication factor, the minimum size of the storage on the cluster must be double the size of the Data,

Is this something that Hadoop can't solve, or its a loophole?
Apr 18, 2018 in Big Data Hadoop by Ashish
• 2,650 points
713 views

1 answer to this question.

0 votes
If you have provided a replication factor of 2 and the free space available on the cluster is not twice the amount of data to be replicated, it will result in an under-replicated block.  

It's not something that's unsolvable.

It's as simple as that, you can't fit in something if you don't have space. It can't appear magically. Dude.
answered Apr 18, 2018 by kurt_cobain
• 9,390 points

Related Questions In Big Data Hadoop

0 votes
1 answer

How to change the replication factor of specific directory in Hadoop?

Yes, you can change the replication factor ...READ MORE

answered May 10, 2018 in Big Data Hadoop by Shubham
• 13,480 points
1,714 views
0 votes
1 answer

How to set replication factor in Hadoop?

Hi@akhtar, You can find setrep command in the ...READ MORE

answered Oct 1, 2020 in Big Data Hadoop by MD
• 95,060 points
370 views
0 votes
1 answer

How to change the default replication factor in Hadoop?

Hi@akhtar, You can change the default replication factor from the ...READ MORE

answered Oct 2, 2020 in Big Data Hadoop by MD
• 95,060 points
145 views
0 votes
1 answer

How to run Hadoop in Docker containers?

Hi, You can run Hadoop in Docker container. Follow ...READ MORE

answered Jan 24, 2020 in Big Data Hadoop by MD
• 95,060 points
545 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,588 views
0 votes
1 answer

“no such file or directory" in case of hadoop fs -ls

The behaviour that you are seeing is ...READ MORE

answered May 9, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points

edited May 9, 2018 by nitinrawat895 5,340 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
6,818 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
1,092 views
0 votes
1 answer

When hadoop-env.sh will be executed in hadoop

Yes you need to put in the ...READ MORE

answered Apr 3, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
454 views