what are the typicall block sizes in HDFS

0 votes

To see the block size in HDFS , lets see how data get stored inside the Data nodes in Hadoop cluster?

Apr 8 in Big Data Hadoop by sunny
115 views

1 answer to this question.

0 votes

HDFS is a block structured file system where each file is divided into particular size and by default the particular size is 128MB. Lets take an example to understand how HDFS stores files and data blocks.

Suppose a person wants to store a file which is of 380MB and want to store it into Hadoop distributed file system. So now what HDFS  will do is that it will divide up the files into three blocks because 380 MB divided by 128MB which is the default size of each data block is approximately three. 

So the first block will occupy 128MB, the second block will also occupy 128MB and the third block will occupy the remaining size of the file that is 124MB. So after the files has been divided into data blocks, this data blocks will be distributed into Data nodes that is present in the Hadoop cluster.

There is a small pictorial form of example given, I hope it will be helpful.

Image result for picture of memory distribution in hadoop as 128mb in blocks

answered Apr 8 by Gitika
• 25,420 points

Related Questions In Big Data Hadoop

0 votes
5 answers
0 votes
1 answer

What are the various ways to import files into HDFS?

There are various tools and frameworks available ...READ MORE

answered Apr 13, 2018 in Big Data Hadoop by nitinrawat895
• 10,760 points
417 views
0 votes
1 answer

What is the command to navigate in HDFS?

First of all there is no command ...READ MORE

answered Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,350 points
554 views
0 votes
1 answer

What is the command to find the free space in HDFS?

You can use dfsadmin which runs a ...READ MORE

answered Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,350 points
261 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,760 points
3,522 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,760 points
433 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
17,919 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,280 points
1,295 views
0 votes
1 answer

What are the different hdfs dfs commands to perform copy operation?

The different hdfs dfs commands to perform ...READ MORE

answered Apr 9 in Big Data Hadoop by Gitika
• 25,420 points
45 views
0 votes
1 answer

What are the site-specific configuration files in Hadoop?

There are different site specific configuration to ...READ MORE

answered Apr 9 in Big Data Hadoop by Gitika
• 25,420 points
53 views