Why do we need Hadoop framework?

0 votes

What is the need of Hadoop framework? Was not Distributed File System enough to handle the large volume of data?

Apr 9 in Big Data Hadoop by sunny

edited Apr 12 by Gitika 26 views

1 answer to this question.

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
0 votes

The function of Distributes File System is to partitions the data, store and manage the data across different machines. DFS can handle the large volume of data, but Hadoop framework will help to process the large amount of data.

Large data is divided into several blocks and stored in different commodity hardware (storing data into distributed way). 

Lets take an example in general:

If we want to process those data, first we will go to commodity hardware and will copy the data to the processing unit and finally, we will do the processing.

This process has some complications, for large data. 

  • When transferring large data some data may lose and make trouble.
  •  But if we use HADOOP, we don't need to take the data to the processing unit. 
  • Instead, we will take our processing unit to the commodity hardware, where our data is stored.
  • Processing can be done over there and we can take the output.

This is how Hadoop framework is more beneficial then DFS.

 

answered Apr 9 by Gitika
• 7,320 points

edited Apr 12 by Gitika

Related Questions In Big Data Hadoop

0 votes
1 answer

What do we exactly mean by “Hadoop” – the definition of Hadoop?

The official definition of Apache Hadoop given ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by Shubham
118 views
0 votes
1 answer

What skills do I need to become Hadoop Admin?

You have heard it right. There is ...READ MORE

answered Nov 8, 2018 in Big Data Hadoop by anonymous
18 views
0 votes
2 answers

Do we need to format datanode to store data

That was not important. If you can ...READ MORE

answered Jan 15 in Big Data Hadoop by Sam
• 160 points
54 views
0 votes
0 answers

Why we use 'help' command in Hadoop Sqoop?

Use of help command in Hadoop sqoop. READ MORE

Apr 11 in Big Data Hadoop by amrita
18 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 9,030 points
1,651 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 9,030 points
130 views
0 votes
10 answers

hadoop fs -put command?

copy command can be used to copy files ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Sujay
8,004 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
558 views
0 votes
1 answer

Why do we need the FOR EACH operation in Pig Scripts?

The operation FOREACH in Apache Pig is ...READ MORE

answered Apr 30 in Big Data Hadoop by Gitika
• 7,320 points
11 views
0 votes
1 answer

Why we need to install "ant -Dhadoopversion=23" ? What is the use of this?

Hi, We install ant to build pig, If the ...READ MORE

answered Apr 26 in Big Data Hadoop by Gitika
• 7,320 points
13 views

© 2018 Brain4ce Education Solutions Pvt. Ltd. All rights Reserved.
"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.