How to change block size in Hadoop dynamically?

0 votes

Hi Guys,

I have configured Hadoop Cluster on AWS. I want to change the default block size. How can I do that?

Sep 25 in Big Data Hadoop by MD
• 79,930 points
91 views

1 answer to this question.

0 votes

Hi@akhtar,

By default, the block size is 64MB in Hadoop Cluster. But you can change the block size dynamically at the time of uploading the file using dfs.block.size parameter as ahoen below.

$ hadoop fs  -D dfs.block.size=32000000 -put abc.txt /

Here you have to specify the block size in bytes. Otherwise it will not work.

answered Sep 25 by akhtar
• 33,720 points

Related Questions In Big Data Hadoop

0 votes
1 answer

How to change default block size in Hadoop Cluster?

Hi@akhtar, You can change the default block size ...READ MORE

answered Oct 2 in Big Data Hadoop by MD
• 79,930 points
39 views
0 votes
1 answer

How to change the replication factor of specific directory in Hadoop?

Yes, you can change the replication factor ...READ MORE

answered May 10, 2018 in Big Data Hadoop by Shubham
• 13,450 points
1,572 views
0 votes
1 answer

How to change the checkpointing duration in Hadoop

Answer: The default duration of checkpointing is 3600 ...READ MORE

answered May 11, 2018 in Big Data Hadoop by Shubham
• 13,450 points
321 views
0 votes
1 answer

How to check the size of a file in Hadoop HDFS?

You can use the  hadoop fs -ls command to ...READ MORE

answered Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,030 points
3,310 views
0 votes
1 answer

What is the command to find the free space in HDFS?

You can use dfsadmin which runs a ...READ MORE

answered Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,450 points
670 views
0 votes
1 answer

How to find the used cache in HDFS

hdfs dfsadmin -report This command tells fs ...READ MORE

answered May 4, 2018 in Big Data Hadoop by Shubham
• 13,450 points
756 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,950 points
6,363 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,950 points
987 views
0 votes
1 answer

How to configure Hadoop namenode?

Hi@MD, To configure the Hadoop master node, you ...READ MORE

answered Sep 20 in Big Data Hadoop by akhtar
• 33,720 points
37 views
0 votes
1 answer

How to start Hadoop daemons?

Hi@MD, Before starting with the HDFS command, you have ...READ MORE

answered Oct 15 in Big Data Hadoop by akhtar
• 33,720 points

edited Oct 15 by akhtar 24 views