File formats in Hadoop

0 votes
Hadoop File Format , when and what to use?
Apr 9, 2019 in Big Data Hadoop by sunny
963 views

1 answer to this question.

0 votes

File format is just a way to define how information is stored in the HDFS file system. File format should be well defined and expressive.

For Example, images have several common storage formats like PNG, JPG, GIF. All three of these can store the same image but each of the formats has specific characteristics. For example, JPG files tend to be smaller.

When we deal with Hadoop file system, like other file system the format of the file we can store in HDFS is entirely up to us. In Hadoop's file system not only we have traditional storage format (like JPG, PNG images ) but we also have some Hadoop-focused file formats to use for structured and unstructured data. 

Some common storage formats for Hadoop are:

  • Plain Text format (CSV)
  • Sequence File input format
  • Row-Column format
answered Apr 9, 2019 by Gitika
• 65,890 points

edited Apr 12, 2019 by Gitika

Related Questions In Big Data Hadoop

0 votes
7 answers

How to run a jar file in hadoop?

I used this command to run my ...READ MORE

answered Dec 10, 2018 in Big Data Hadoop by Dasinto
26,377 views
0 votes
1 answer

What is the use of sequence file in Hadoop?

Sequence files are binary files containing serialized ...READ MORE

answered Apr 6, 2018 in Big Data Hadoop by Ashish
• 2,650 points
9,515 views
0 votes
1 answer

Getting error in Hadoop: Output file already exist

When you executed your code earlier, you ...READ MORE

answered Apr 19, 2018 in Big Data Hadoop by Shubham
• 13,490 points
8,409 views
0 votes
1 answer

What is the slaves file configuration in Hadoop?

The main idea behind is the master ...READ MORE

answered Apr 24, 2018 in Big Data Hadoop by Shubham
• 13,490 points
4,378 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
10,913 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,446 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
108,250 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,538 views
0 votes
1 answer

Explain what is a sequence file in Hadoop?

Hello, To store binary key/value pairs, sequence file ...READ MORE

answered Jun 10, 2019 in Big Data Hadoop by Gitika
• 65,890 points
999 views
0 votes
12 answers

What is Zookeeper? What is the purpose of Zookeeper in Hadoop Ecosystem?

Hey, Apache Zookeeper says that it is a ...READ MORE

answered Apr 29, 2019 in Big Data Hadoop by Gitika
• 65,890 points
29,562 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP