Most answered questions in Big Data Hadoop

0 votes
1 answer

Setting Hive/Hadoop property using Hive Query

You can set Hadoop & Hive conf ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,427 views
0 votes
1 answer

Getting error in Hadoop Streaming: Type mismatch in Key from Map

In Hadoop streaming you have to customize ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 1,661 views
0 votes
1 answer

Getting error while building Hadoop core jar using ant.

I think you are missing libtool library. ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 1,358 views
0 votes
1 answer

Replication Factor in Hadoop?

If you have provided a replication factor ...READ MORE

Apr 18, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,626 views
0 votes
1 answer

How can I use my host machine’s web browser to check my HDFS services running in the VM?

The sole purpose of the virtual machine ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,011 views
0 votes
1 answer

What are the different ways to load data from Hadoop to Azure Data Lake?

I would recommend you to go through ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 1,435 views
0 votes
1 answer

What are the advantages & disadvantages of Hadoop Dockerization?

As you are already having a Hadoop ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 1,973 views
0 votes
1 answer

How to tune Spark jobs & optimize the performance?

You need to know the cluster properly ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 2,241 views
0 votes
1 answer

Why am I not able to see the Hadoop daemons that are running?

I guess you are starting the services ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,484 views
0 votes
1 answer

can't find start-all.sh in hadoop installation

Actually, you are not mentioning the path for ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 9,397 views
0 votes
1 answer

Not able to find HDFS directory on my system?

I guess you didn't understand it correctly dfs.datanode.data.dir, ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 8,201 views
0 votes
1 answer

In which directory Hadoop should be installed?

You can install Hadoop anywhere. You just ...READ MORE

Apr 17, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,804 views
0 votes
1 answer

Is there any way to write "map only" Hadoop jobs ?

You can easily set the number of ...READ MORE

Apr 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,381 views
+1 vote
1 answer

http://localhost:50070 not working in HADOOP

There are 2 case possible: 1. If you ...READ MORE

Apr 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 44,225 views
0 votes
1 answer

What does NameNode stores and where it stores?

NameNode records the metadata of all the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 6,633 views
0 votes
1 answer

Is there a way to rebalance single Datanode in Hadoop.

Currently Hadoop does not automatically do this. ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,230 views
0 votes
1 answer

Moving files in Hadoop using the Java API?

I would recommend you to use FileSystem.rename(). ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 3,069 views
0 votes
1 answer

Deleting a directory with comma throwing an error

As comma is an escape sequence character, ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 833 views
0 votes
1 answer

Hadoop query regarding setJarByClass method of Job class

setJarByClass method basically tells the nodes where ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,851 views
0 votes
1 answer

Best way of starting & stopping the Hadoop daemons with command line

First way is to use start-all.sh & ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 11,098 views
0 votes
1 answer

Files for Configuring HDFS in Hadoop 2.2.0?

By default these Hadoop configuration files are ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,237 views
0 votes
1 answer

Getting error in MapReduce job.setInputFormatClass

In old Hadoop API(i.e. below Hadoop 0.20.0), ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,416 views
0 votes
1 answer

How can I put file to HDFS directly without copying it local disk?

Can use pipe from wget to hdfs. You ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 5,117 views
0 votes
1 answer

Getting error in command hdfs dfs -mkdir

You are getting this error because the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 3,899 views
0 votes
1 answer

I am getting error while starting the Hadoop Daemons i.e. ResourceManger & NodeManager in Hadoop 3

According to me the error is because ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 4,171 views
0 votes
1 answer

Why Java Code in Hadoop uses own Data Types instead of basic Data types?

Hadoop provides us Writable interface based data ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,498 views
0 votes
1 answer

How to migrate/ change Hadoop 1.x maven project to Hadoop 2.x?

In Hadoop 2.2. most of the dependencies ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,517 views
0 votes
1 answer

Why ResourceManager crashes after sometime or while accessing HDFS in Hadoop 2.8.1 and Ubuntu 16.04?

I was facing the same problem and ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,882 views
0 votes
1 answer

How do I connect my Spark based HDInsight cluster to my blob storage?

Go through this blog: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-use-blob-storage#access-blobs I went through this ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,432 views
0 votes
1 answer

What are the various ways to import files into HDFS?

There are various tools and frameworks available ...READ MORE

Apr 13, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 4,118 views
0 votes
1 answer

How can we transfer a PDF file to HDFS?

You can easily upload any file to ...READ MORE

Apr 13, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,686 views
0 votes
1 answer

What are SUCCESS and part-r-00000 files in Hadoop?

Yes, both the files i.e. SUCCESS and ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 13,336 views
0 votes
1 answer

Is there any way to increase Java Heap size in Hadoop?

You can add some more memory by ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 5,494 views
0 votes
1 answer

How to move data from Oracle database to Hadoop?

Yes, you heard it correctly. Apache Sqoop is ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 7,877 views
0 votes
1 answer

Is Hadoop a good open-source project to join?

Yes, Hadoop has a whole ecosystem of ...READ MORE

Apr 12, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,220 views
0 votes
1 answer

Is java necessary for Hadoop?

It is not a prerequisite. But you ...READ MORE

Apr 11, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,152 views
0 votes
1 answer

How do I parse pdf file using MapReduce?

If you have your own custom InputFormat(WholeFileInputFormat). ...READ MORE

Apr 11, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,114 views
0 votes
1 answer

What is the difference between a zero reducer and identity reducer in Hadoop Mapreduce?

A Zero reducer as the name suggests ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 3,044 views
0 votes
1 answer

What is a importance of Hive ODBC Connector

The Cloudera ODBC Driver for Hive enables ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,168 views
0 votes
1 answer

Difference between Application Master and Application Manager?

The Application Master is responsible for the ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 15,453 views
0 votes
1 answer

Is there any way to load data from MySql to HDFS?

The generic command i.e used to import ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 4,118 views
0 votes
1 answer

What are the hardware requirements for installing Hadoop on my Laptop?

You can either install Apache Hadoop on ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 8,590 views
0 votes
1 answer

How to use custom FileInputFormat in MapReduce?

You have to override isSplitable method. ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,645 views
0 votes
1 answer

How do I include all the Hadoop dependencies using Maven?

This is a dependency mismatch error. I ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 7,083 views
0 votes
1 answer

Can one implement combiner and reducer separately?

Surely, you can use combiner separately along ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Ashish
 • 2,650 points • 1,504 views
0 votes
1 answer

IDE for writing and running hadoop jobs?

You can use the Eclipse IDE. It's ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 2,298 views
0 votes
1 answer

How do I print hadoop properties in command line?

You can use the following command to get ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 2,271 views
0 votes
1 answer

What does Context mean in Hadoop MapR terms ?

The new API makes extensive use of ...READ MORE

Apr 6, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,980 views
0 votes
1 answer

How to find hadoop distribution and version?

Just Use the command Hadoop version ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points
edited Apr 6, 2018 by kurt_cobain • 2,429 views
0 votes
1 answer

How to configure secondary namenode in Hadoop 2.x ?

bin/hadoop-daemon.sh start [namenode | secondarynamenode | datanode ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 2,299 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.