Hadoop Small File

Question

HI,

How can i check the Namenode memory, which contains metadata about small files.

How cna I merge the small Files into large ,Do we have any best practices ? OR any job which can be scheduled weekly ?

Answer 1

Hi@himanshu,

To monitor your Namenode, you can create a small script using the API. If you want to merge your files in a single file then Hadoop has one command that may help.

$ hadoop fs -getmerge /user/hadoop/demo_files merged.txt