Most voted questions in Big Data Hadoop

0 votes
1 answer

Setting Hive/Hadoop property using Hive Query

You can set Hadoop & Hive conf ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,675 views
0 votes
1 answer

Getting error in Hadoop Streaming: Type mismatch in Key from Map

In Hadoop streaming you have to customize ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
• 2,080 points
1,011 views
0 votes
1 answer

Getting error while building Hadoop core jar using ant.

I think you are missing libtool library. ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
• 2,080 points
776 views
0 votes
1 answer

Replication Factor in Hadoop?

If you have provided a replication factor ...READ MORE

Apr 18, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
1,060 views
0 votes
1 answer

How can I use my host machine’s web browser to check my HDFS services running in the VM?

The sole purpose of the virtual machine ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,096 views
0 votes
1 answer

What are the different ways to load data from Hadoop to Azure Data Lake?

I would recommend you to go through ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
• 2,080 points
901 views
0 votes
1 answer

What are the advantages & disadvantages of Hadoop Dockerization?

As you are already having a Hadoop ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
• 2,080 points
1,367 views
0 votes
1 answer

How to tune Spark jobs & optimize the performance?

You need to know the cluster properly ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
• 2,080 points
1,683 views
0 votes
2 answers

Hadoop is not able to find jps command

jps is actually not a command of ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
14,124 views
0 votes
1 answer

Why am I not able to see the Hadoop daemons that are running?

I guess you are starting the services ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
800 views
0 votes
2 answers

How can I list NameNode & DataNodes from any machine in the Hadoop cluster?

You can browse hadoop page from any ...READ MORE

Jan 23, 2020 in Big Data Hadoop by MD
• 95,440 points
11,150 views
0 votes
1 answer

can't find start-all.sh in hadoop installation

Actually, you are not mentioning the path for ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
7,509 views
0 votes
1 answer

Not able to find HDFS directory on my system?

I guess you didn't understand it correctly dfs.datanode.data.dir, ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
7,105 views
0 votes
1 answer

In which directory Hadoop should be installed?

You can install Hadoop anywhere. You just ...READ MORE

Apr 17, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,178 views
0 votes
2 answers

How to exit NameNode safe mode?

hadoop dfsadmin -safemode leave READ MORE

Apr 11, 2019 in Big Data Hadoop by anonymous
3,512 views
0 votes
1 answer

Is there any way to write "map only" Hadoop jobs ?

You can easily set the number of ...READ MORE

Apr 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
669 views
0 votes
2 answers

Meaning of fs.defaultFS property in core-site.xml in hadoop

It allows to run dfs commands more ...READ MORE

Jan 22, 2020 in Big Data Hadoop by MD
• 95,440 points
7,059 views
0 votes
1 answer

What does NameNode stores and where it stores?

NameNode records the metadata of all the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
5,328 views
0 votes
2 answers

Function of “hadoop namenode -format” command

Namenode is the node in the Hadoop ...READ MORE

Feb 4, 2019 in Big Data Hadoop by Kanika
20,569 views
0 votes
1 answer

Is there a way to rebalance single Datanode in Hadoop.

Currently Hadoop does not automatically do this. ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
513 views
0 votes
1 answer

Moving files in Hadoop using the Java API?

I would recommend you to use FileSystem.rename(). ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,480 views
0 votes
1 answer

Deleting a directory with comma throwing an error

As comma is an escape sequence character, ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
403 views
0 votes
11 answers

What is the command to start Job history server in Hadoop 2.x & how to get its UI?

mr-jobhistory-daemon. sh start historyserver READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
19,707 views
0 votes
2 answers

Hadoop query regarding setJarByClass method of Job class

http://www.bigdataspeak.com/2014/06/what-is-need-to-use-jobsetjarbycla ...READ MORE

Feb 7, 2019 in Big Data Hadoop by siri
2,033 views
0 votes
1 answer

Best way of starting & stopping the Hadoop daemons with command line

First way is to use start-all.sh & ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
9,548 views
0 votes
1 answer

Files for Configuring HDFS in Hadoop 2.2.0?

By default these Hadoop configuration files are ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
500 views
0 votes
1 answer

Getting error in MapReduce job.setInputFormatClass

In old Hadoop API(i.e. below Hadoop 0.20.0), ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,854 views
0 votes
1 answer

How can I put file to HDFS directly without copying it local disk?

Can use pipe from wget to hdfs. You ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,250 views
0 votes
2 answers

start-dfs.sh command is not starting Hadoop JobTracker & TaskTracker

On which version of hadoop do you ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
3,412 views
0 votes
2 answers

Command to check the Hadoop distribution as well as it’s version which is installed in my cluster

One of the options to check the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
5,269 views
0 votes
1 answer

Getting error in command hdfs dfs -mkdir

You are getting this error because the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,848 views
0 votes
1 answer

I am getting error while starting the Hadoop Daemons i.e. ResourceManger & NodeManager in Hadoop 3

According to me the error is because ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,289 views
0 votes
1 answer

Why Java Code in Hadoop uses own Data Types instead of basic Data types?

Hadoop provides us Writable interface based data ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
885 views
0 votes
1 answer

How to migrate/ change Hadoop 1.x maven project to Hadoop 2.x?

In Hadoop 2.2. most of the dependencies ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
772 views
0 votes
1 answer

Why ResourceManager crashes after sometime or while accessing HDFS in Hadoop 2.8.1 and Ubuntu 16.04?

I was facing the same problem and ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,153 views
0 votes
1 answer

How do I connect my Spark based HDInsight cluster to my blob storage?

Go through this blog: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-use-blob-storage#access-blobs I went through this ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,934 views
0 votes
1 answer

What are the various ways to import files into HDFS?

There are various tools and frameworks available ...READ MORE

Apr 13, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,246 views
0 votes
1 answer

How can we transfer a PDF file to HDFS?

You can easily upload any file to ...READ MORE

Apr 13, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
853 views
0 votes
1 answer

What are SUCCESS and part-r-00000 files in Hadoop?

Yes, both the files i.e. SUCCESS and ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
11,996 views
0 votes
1 answer

Is there any way to increase Java Heap size in Hadoop?

You can add some more memory by ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
4,558 views
0 votes
12 answers

What is Zookeeper? What is the purpose of Zookeeper in Hadoop Ecosystem?

Hey, Apache Zookeeper says that it is a ...READ MORE

Apr 29, 2019 in Big Data Hadoop by Gitika
• 65,910 points
28,407 views
0 votes
1 answer

How to move data from Oracle database to Hadoop?

Yes, you heard it correctly. Apache Sqoop is ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
6,829 views
0 votes
1 answer

Is Hadoop a good open-source project to join?

Yes, Hadoop has a whole ecosystem of ...READ MORE

Apr 12, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
435 views
0 votes
1 answer

Is java necessary for Hadoop?

It is not a prerequisite. But you ...READ MORE

Apr 11, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
449 views
0 votes
1 answer

How do I parse pdf file using MapReduce?

If you have your own custom InputFormat(WholeFileInputFormat). ...READ MORE

Apr 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,270 views
0 votes
1 answer

What is the difference between a zero reducer and identity reducer in Hadoop Mapreduce?

A Zero reducer as the name suggests ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,268 views
0 votes
1 answer

What is a importance of Hive ODBC Connector

The Cloudera ODBC Driver for Hive enables ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
662 views
0 votes
1 answer

Difference between Application Master and Application Manager?

The Application Master is responsible for the ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
13,875 views
0 votes
1 answer

Is there any way to load data from MySql to HDFS?

The generic command i.e used to import ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,335 views
0 votes
1 answer

What are the hardware requirements for installing Hadoop on my Laptop?

You can either install Apache Hadoop on ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
• 13,490 points
7,610 views