Hadoop Small File

0 votes
HI,

How can i check the Namenode memory, which contains metadata about small files.

How cna I merge the small Files into large ,Do we have any best practices ? OR any job which can be scheduled weekly ?
Aug 22, 2020 in Big Data Hadoop by himanshu
• 120 points
83 views

1 answer to this question.

–1 vote

Hi@himanshu,

To monitor your Namenode, you can create a small script using the API. If you want to merge your files in a single file then Hadoop has one command that may help.

$ hadoop fs -getmerge /user/hadoop/demo_files merged.txt
answered Aug 24, 2020 by MD
• 95,060 points

Related Questions In Big Data Hadoop

0 votes
1 answer

The file exists before processing with hadoop command

Took session and it got resolved. READ MORE

answered Dec 18, 2017 in Big Data Hadoop by Sudhir
• 1,610 points
236 views
0 votes
1 answer

Where can I find hadoop-streaming.jar JAR file?

You will find the streaming jar here: ...READ MORE

answered Mar 21, 2018 in Big Data Hadoop by coldcode
• 2,080 points
3,254 views
0 votes
1 answer
0 votes
7 answers

How to run a jar file in hadoop?

I used this command to run my ...READ MORE

answered Dec 10, 2018 in Big Data Hadoop by Dasinto
13,732 views
0 votes
1 answer

What is the use of sequence file in Hadoop?

Sequence files are binary files containing serialized ...READ MORE

answered Apr 5, 2018 in Big Data Hadoop by Ashish
• 2,650 points
5,317 views
0 votes
1 answer

Getting error in Hadoop: Output file already exist

When you executed your code earlier, you ...READ MORE

answered Apr 19, 2018 in Big Data Hadoop by Shubham
• 13,480 points
4,231 views
0 votes
2 answers

hadoop copy a local file system folder to HDFS

There's a typo in your command: "hadopp". ...READ MORE

answered Feb 4, 2019 in Big Data Hadoop by Lohith
17,278 views
0 votes
1 answer

Difference between Hadoop file system and Linux

Yes, to a certain extent we can ...READ MORE

answered Apr 20, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,679 views
0 votes
1 answer

java.io.IOException: File /user/hadoop/ could only be replicated to 0 nodes, instead of 1

Hi@akhtar, To avoid this error, follow the bellow ...READ MORE

answered Apr 17, 2020 in Big Data Hadoop by MD
• 95,060 points
253 views