How to change block size in Hadoop dynamically

0 votes

Hi Guys,

I have configured Hadoop Cluster on AWS. I want to change the default block size. How can I do that?

Sep 25, 2020 in Big Data Hadoop by MD
• 95,460 points
3,103 views

1 answer to this question.

0 votes

Hi@akhtar,

By default, the block size is 64MB in Hadoop Cluster. But you can change the block size dynamically at the time of uploading the file using dfs.block.size parameter as ahoen below.

$ hadoop fs  -D dfs.block.size=32000000 -put abc.txt /

Here you have to specify the block size in bytes. Otherwise it will not work.

answered Sep 25, 2020 by akhtar
• 38,260 points

Related Questions In Big Data Hadoop

0 votes
1 answer

How to change default block size in Hadoop Cluster?

Hi@akhtar, You can change the default block size ...READ MORE

answered Oct 3, 2020 in Big Data Hadoop by MD
• 95,460 points
2,522 views
0 votes
1 answer

How to change the replication factor of specific directory in Hadoop?

Yes, you can change the replication factor ...READ MORE

answered May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,695 views
0 votes
1 answer

How to change the checkpointing duration in Hadoop

Answer: The default duration of checkpointing is 3600 ...READ MORE

answered May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,521 views
0 votes
1 answer

How to check the size of a file in Hadoop HDFS?

You can use the  hadoop fs -ls command to ...READ MORE

answered Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
13,585 views
0 votes
1 answer

What is the command to find the free space in HDFS?

You can use dfsadmin which runs a ...READ MORE

answered Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,232 views
0 votes
1 answer

How to find the used cache in HDFS

hdfs dfsadmin -report This command tells fs ...READ MORE

answered May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,505 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
11,078 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,575 views
0 votes
1 answer

How to configure Hadoop namenode?

Hi@MD, To configure the Hadoop master node, you ...READ MORE

answered Sep 21, 2020 in Big Data Hadoop by akhtar
• 38,260 points
987 views
0 votes
1 answer

How to start Hadoop daemons?

Hi@MD, Before starting with the HDFS command, you have ...READ MORE

answered Oct 15, 2020 in Big Data Hadoop by akhtar
• 38,260 points

edited Oct 16, 2020 by akhtar 1,004 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP