How to calculate number of slave nodes

Question

I m planning a Hadoop cluster, and I expect to be receiving just under 1TB of data per week which will be stored on the cluster, using Hadoop's default replication. So, what I decide is that all the slave nodes will be configured with 4 x 1TB disks.

But is there any way to calculate how many slave nodes I need to deploy at a minimum to store one year's worth of data.

Thanks in advance!

Answer 1

Total number of slave nodes in your case are:

So, first you have to determine the total number of space required.

Total space required is : 52 (weeks) * 1 (disk space per week) * 3 (default replication factor) = 156 TB
 
Minimum number of slave nodes required: 156 /4 = 39

Hope this helps.