Most answered questions in Big Data Hadoop

0 votes
1 answer

Setting Hive/Hadoop property using Hive Query

You can set Hadoop & Hive conf ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,997 views
0 votes
1 answer

Getting error in Hadoop Streaming: Type mismatch in Key from Map

In Hadoop streaming you have to customize ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 1,275 views
0 votes
1 answer

Getting error while building Hadoop core jar using ant.

I think you are missing libtool library. ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 1,002 views
0 votes
1 answer

Replication Factor in Hadoop?

If you have provided a replication factor ...READ MORE

Apr 18, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,269 views
0 votes
1 answer

How can I use my host machine’s web browser to check my HDFS services running in the VM?

The sole purpose of the virtual machine ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,453 views
0 votes
1 answer

What are the different ways to load data from Hadoop to Azure Data Lake?

I would recommend you to go through ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 1,062 views
0 votes
1 answer

What are the advantages & disadvantages of Hadoop Dockerization?

As you are already having a Hadoop ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 1,598 views
0 votes
1 answer

How to tune Spark jobs & optimize the performance?

You need to know the cluster properly ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 1,901 views
0 votes
1 answer

Why am I not able to see the Hadoop daemons that are running?

I guess you are starting the services ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,040 views
0 votes
1 answer

can't find start-all.sh in hadoop installation

Actually, you are not mentioning the path for ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 8,320 views
0 votes
1 answer

Not able to find HDFS directory on my system?

I guess you didn't understand it correctly dfs.datanode.data.dir, ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 7,684 views
0 votes
1 answer

In which directory Hadoop should be installed?

You can install Hadoop anywhere. You just ...READ MORE

Apr 17, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,429 views
0 votes
1 answer

Is there any way to write "map only" Hadoop jobs ?

You can easily set the number of ...READ MORE

Apr 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 943 views
+1 vote
1 answer

http://localhost:50070 not working in HADOOP

There are 2 case possible: 1. If you ...READ MORE

Apr 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 41,955 views
0 votes
1 answer

What does NameNode stores and where it stores?

NameNode records the metadata of all the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 5,959 views
0 votes
1 answer

Is there a way to rebalance single Datanode in Hadoop.

Currently Hadoop does not automatically do this. ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 777 views
0 votes
1 answer

Moving files in Hadoop using the Java API?

I would recommend you to use FileSystem.rename(). ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,683 views
0 votes
1 answer

Deleting a directory with comma throwing an error

As comma is an escape sequence character, ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 516 views
0 votes
1 answer

Hadoop query regarding setJarByClass method of Job class

setJarByClass method basically tells the nodes where ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,365 views
0 votes
1 answer

Best way of starting & stopping the Hadoop daemons with command line

First way is to use start-all.sh & ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 10,087 views
0 votes
1 answer

Files for Configuring HDFS in Hadoop 2.2.0?

By default these Hadoop configuration files are ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 775 views
0 votes
1 answer

Getting error in MapReduce job.setInputFormatClass

In old Hadoop API(i.e. below Hadoop 0.20.0), ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,075 views
0 votes
1 answer

How can I put file to HDFS directly without copying it local disk?

Can use pipe from wget to hdfs. You ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 4,622 views
0 votes
1 answer

Getting error in command hdfs dfs -mkdir

You are getting this error because the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 3,278 views
0 votes
1 answer

I am getting error while starting the Hadoop Daemons i.e. ResourceManger & NodeManager in Hadoop 3

According to me the error is because ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 3,667 views
0 votes
1 answer

Why Java Code in Hadoop uses own Data Types instead of basic Data types?

Hadoop provides us Writable interface based data ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,171 views
0 votes
1 answer

How to migrate/ change Hadoop 1.x maven project to Hadoop 2.x?

In Hadoop 2.2. most of the dependencies ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,080 views
0 votes
1 answer

Why ResourceManager crashes after sometime or while accessing HDFS in Hadoop 2.8.1 and Ubuntu 16.04?

I was facing the same problem and ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,458 views
0 votes
1 answer

How do I connect my Spark based HDInsight cluster to my blob storage?

Go through this blog: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-use-blob-storage#access-blobs I went through this ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,104 views
0 votes
1 answer

What are the various ways to import files into HDFS?

There are various tools and frameworks available ...READ MORE

Apr 13, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 3,595 views
0 votes
1 answer

How can we transfer a PDF file to HDFS?

You can easily upload any file to ...READ MORE

Apr 13, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,206 views
0 votes
1 answer

What are SUCCESS and part-r-00000 files in Hadoop?

Yes, both the files i.e. SUCCESS and ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 12,574 views
0 votes
1 answer

Is there any way to increase Java Heap size in Hadoop?

You can add some more memory by ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 4,987 views
0 votes
1 answer

How to move data from Oracle database to Hadoop?

Yes, you heard it correctly. Apache Sqoop is ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 7,316 views
0 votes
1 answer

Is Hadoop a good open-source project to join?

Yes, Hadoop has a whole ecosystem of ...READ MORE

Apr 12, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 765 views
0 votes
1 answer

Is java necessary for Hadoop?

It is not a prerequisite. But you ...READ MORE

Apr 11, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 751 views
0 votes
1 answer

How do I parse pdf file using MapReduce?

If you have your own custom InputFormat(WholeFileInputFormat). ...READ MORE

Apr 11, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,663 views
0 votes
1 answer

What is the difference between a zero reducer and identity reducer in Hadoop Mapreduce?

A Zero reducer as the name suggests ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 2,564 views
0 votes
1 answer

What is a importance of Hive ODBC Connector

The Cloudera ODBC Driver for Hive enables ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 868 views
0 votes
1 answer

Difference between Application Master and Application Manager?

The Application Master is responsible for the ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 14,636 views
0 votes
1 answer

Is there any way to load data from MySql to HDFS?

The generic command i.e used to import ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 3,660 views
0 votes
1 answer

What are the hardware requirements for installing Hadoop on my Laptop?

You can either install Apache Hadoop on ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 8,089 views
0 votes
1 answer

How to use custom FileInputFormat in MapReduce?

You have to override isSplitable method. ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,236 views
0 votes
1 answer

How do I include all the Hadoop dependencies using Maven?

This is a dependency mismatch error. I ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 6,532 views
0 votes
1 answer

Can one implement combiner and reducer separately?

Surely, you can use combiner separately along ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Ashish
 • 2,650 points • 1,110 views
0 votes
1 answer

IDE for writing and running hadoop jobs?

You can use the Eclipse IDE. It's ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,898 views
0 votes
1 answer

How do I print hadoop properties in command line?

You can use the following command to get ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,833 views
0 votes
1 answer

What does Context mean in Hadoop MapR terms ?

The new API makes extensive use of ...READ MORE

Apr 6, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,601 views
0 votes
1 answer

How to find hadoop distribution and version?

Just Use the command Hadoop version ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points
edited Apr 6, 2018 by kurt_cobain • 2,022 views
0 votes
1 answer

How to configure secondary namenode in Hadoop 2.x ?

bin/hadoop-daemon.sh start [namenode | secondarynamenode | datanode ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,836 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.