Is a HDFS block sequential ?

0 votes
How can HDFS have a sequential block of 64MB when the underlying linux filesystem has only 4KB block sizes and a write of 64MB block cannot be sequential.

I am bit confused with this part. I am not able to get any explanation.

Can somebody help?
May 21, 2018 in Big Data Hadoop by Shubham
• 13,290 points
121 views

1 answer to this question.

0 votes

It seems like you are confused between the terms "contiguous" and "sequential". We have sequential reads/writes (from/to disk) and "contiguous" disk space allocation.

A single HDFS block of 64 MB will be written to disk sequentially. Therefore there is a fair chance that the data will be written into contiguous space on disk (consisting of multiple blocks next to each other). So the disk/block fragmentation will be much lower compared to a random disk write.

Furthermore, sequential reads/writes are much faster than random writes with multiple disk seeks. 

To learn more about this, check the following link: http://Difference between sequential write and random write.

Hope this answer your query to some extent.

answered May 21, 2018 by nitinrawat895
• 10,670 points

Related Questions In Big Data Hadoop

0 votes
1 answer
0 votes
1 answer

What is the command to count number of lines in a file in hdfs?

hadoop fs -cat /example2/doc1 | wc -l READ MORE

answered Nov 22, 2018 in Big Data Hadoop by Omkar
• 67,520 points
303 views
0 votes
1 answer

How to find the number of blocks a hdfs file is divided into?

Yes. you can use the hadoop fsck command to do ...READ MORE

answered Nov 29, 2018 in Big Data Hadoop by Omkar
• 67,520 points
432 views
0 votes
1 answer

How is a file written in hdfs?

When you copy a file from the ...READ MORE

answered Dec 21, 2018 in Big Data Hadoop by Omkar
• 67,520 points
34 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,240 points
999 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,670 points
2,752 views
0 votes
1 answer

How to get started with Hadoop?

Well, hadoop is actually a framework that ...READ MORE

answered Mar 21, 2018 in Big Data Hadoop by coldcode
• 2,020 points
84 views
0 votes
10 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
13,619 views
0 votes
1 answer

What metadata is stored on a DataNode when a block is written to it?

Let me explain you step by step.  Each ...READ MORE

answered Jul 23, 2018 in Big Data Hadoop by nitinrawat895
• 10,670 points
187 views
0 votes
3 answers

What is Hive? Is Hive a database?

Hive is a data Warehouse infrastructure/system built ...READ MORE

answered Jul 1 in Big Data Hadoop by Ved Gupta
5,857 views