Trending questions in Big Data Hadoop

0 votes
1 answer

Setting the Number of Map tasks and Reduce Tasks not Working

The command that you are running is ...READ MORE

May 3, 2018 in Big Data Hadoop by Ashish
• 2,630 points
160 views
0 votes
1 answer

Moving files in Hadoop using the Java API?

I would recommend you to use FileSystem.rename(). ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,300 points
905 views
0 votes
1 answer

What is hadoop.tmp.dir ?

hadoop.tmp.dir is used as the base for temporary ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
1,767 views
0 votes
1 answer

What is the command to find the free space in HDFS?

You can use dfsadmin which runs a ...READ MORE

Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,300 points
227 views
0 votes
1 answer

What happend while formatting hadoop namenode?

Basically, NameNode is the master daemon that ...READ MORE

May 3, 2018 in Big Data Hadoop by Ashish
• 2,630 points
41 views
0 votes
1 answer

How to print the content of a file in console present in HDFS?

Yes, you can use hdfs dfs command ...READ MORE

Apr 19, 2018 in Big Data Hadoop by Shubham
• 13,300 points
648 views
0 votes
1 answer

Where Big Data tools like Hadoop and Spark comes into picture when we talk about ETL?

When we talk about ETL, ETL means ...READ MORE

May 3, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
24 views
0 votes
1 answer

Which latest Hadoop version is stable?

Try Checking this website: http://hadoop.apache.org/releases.html. Here you will ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
1,654 views
0 votes
1 answer

How to programmatically access hadoop cluster where kerberos is enable?

Okay,here's the code snippet to work in the ...READ MORE

Mar 27, 2018 in Big Data Hadoop by coldcode
• 2,020 points
1,619 views
0 votes
1 answer

GUI for using Hadoop

Hue is open source and works well ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
424 views
0 votes
1 answer

What is the $HIVE_HOME in Hortonworks sandbox

You can find the hive-site.xml file /etc/hive/conf.install/hive-site.xml ...READ MORE

Apr 23, 2018 in Big Data Hadoop by Shubham
• 13,300 points
405 views
0 votes
1 answer

How do I connect my Spark based HDInsight cluster to my blob storage?

Go through this blog: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-use-blob-storage#access-blobs I went through this ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,300 points
693 views
0 votes
1 answer

How to tune Spark jobs & optimize the performance?

You need to know the cluster properly ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
• 2,020 points
539 views
0 votes
1 answer

How to transfer data from Netezza to HDFS using Apache Sqoop?

Remove the --direct option. It gives issue ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
331 views
0 votes
1 answer

How to work with distributed cache in Hadoop?

The problem with your code is that ...READ MORE

Apr 20, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
434 views
0 votes
1 answer

What is the function of getLocalCacheArchives method?

We use distributed cache to share those ...READ MORE

Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,300 points
39 views
0 votes
1 answer

Where is Hadoop Classpath?

It is set in hadoop-config.sh. You can add ...READ MORE

Apr 2, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
1,189 views
0 votes
1 answer

What is a container in YARN?

A container basically represents a resource on ...READ MORE

Apr 9, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
853 views
0 votes
1 answer

How can I write text in HDFS using CMD?

Hadoop put & appendToFile only reads standard ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,300 points
91 views
0 votes
1 answer

How to import data to HBase from SQL server?

You can easily import the data from ...READ MORE

Apr 20, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
372 views
0 votes
1 answer

How do I include all the Hadoop dependencies using Maven?

This is a dependency mismatch error. I ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
• 13,300 points
782 views
0 votes
1 answer

How do we authenticate user from http.signature.secret file?

hadoop.http.authentication.signature.secret.file: The signature secret file for signing ...READ MORE

Apr 24, 2018 in Big Data Hadoop by Shubham
• 13,300 points
168 views
0 votes
1 answer

Namenode not getting started

You need to delete the contents of the ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
204 views
0 votes
1 answer

Can we use apache Mahout without Hadoop dependency?

There is a number of algorithm implementations ...READ MORE

Apr 26, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
66 views
0 votes
1 answer

Which is better Neo4j or HBASE ?

For your requirement, I would recommend you ...READ MORE

Apr 26, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
58 views
0 votes
1 answer

Difference between Hadoop file system and Linux

Yes, to a certain extent we can ...READ MORE

Apr 20, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
317 views
0 votes
1 answer

Killing an Application from ResourceManager Web UI

In hadoop v2.7.1, if you open the ...READ MORE

Apr 23, 2018 in Big Data Hadoop by Shubham
• 13,300 points
186 views
0 votes
1 answer

Cassandra for datawarehouse

Actually, Cassandra being a NoSQL database with ...READ MORE

Apr 20, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
296 views
0 votes
1 answer

What does count command in Hadoop tells?

The output of the count command are: ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
165 views
0 votes
1 answer

What is the difference between a zero reducer and identity reducer in Hadoop Mapreduce?

A Zero reducer as the name suggests ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
702 views
0 votes
1 answer

Getting error in command hdfs dfs -mkdir

You are getting this error because the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,300 points
482 views
0 votes
1 answer

What are the advantages & disadvantages of Hadoop Dockerization?

As you are already having a Hadoop ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
• 2,020 points
334 views
0 votes
1 answer

Replication Factor in Hadoop?

If you have provided a replication factor ...READ MORE

Apr 18, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
328 views
0 votes
1 answer

Why is jar file required to execute a MR code instead of class file?

We use hadoop keyword to invoke the ...READ MORE

Apr 24, 2018 in Big Data Hadoop by Shubham
• 13,300 points
59 views
0 votes
1 answer

Is there any way to load data from MySql to HDFS?

The generic command i.e used to import ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
653 views
0 votes
1 answer

How to perform Near-real time analytics using Hadoop?

To perform Near-real time analytics, you have ...READ MORE

Apr 24, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
40 views
0 votes
1 answer

How to checkout Hadoop 2.6.0 from git

Clone the following Git repository: git clone git ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
89 views
0 votes
1 answer

Setting Hive/Hadoop property using Hive Query

You can set Hadoop & Hive conf ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,300 points
290 views
0 votes
1 answer

I am getting error while starting the Hadoop Daemons i.e. ResourceManger & NodeManager in Hadoop 3

According to me the error is because ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,300 points
415 views
0 votes
1 answer

Getting error in MapReduce job.setInputFormatClass

In old Hadoop API(i.e. below Hadoop 0.20.0), ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,300 points
410 views
0 votes
1 answer

Not able to find HDFS directory on my system?

I guess you didn't understand it correctly dfs.datanode.data.dir, ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
315 views
0 votes
1 answer

Getting error in Hadoop Streaming: Type mismatch in Key from Map

In Hadoop streaming you have to customize ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
• 2,020 points
268 views
0 votes
1 answer

HortonWorks Hadoop encryption tools and data security

There are many tools available for encrypting ...READ MORE

Apr 20, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
145 views
0 votes
1 answer

When is an identity mapper/reducer used?

1.One of the simplest example of Iterative ...READ MORE

Apr 3, 2018 in Big Data Hadoop by Ashish
• 2,630 points
868 views
0 votes
1 answer

What are the various ways to import files into HDFS?

There are various tools and frameworks available ...READ MORE

Apr 13, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
390 views
0 votes
1 answer

Hadoop for data migration

You can use Hadoop for these kinds ...READ MORE

Apr 18, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
170 views
0 votes
1 answer

How to implement data locality in Hadoop MapReduce?

You can use this getFileBlockLocations method of ...READ MORE

Apr 20, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
80 views
0 votes
1 answer

How to upload file to HDFS in Ubuntu

you can use  hadoop fs -copyFromLocal  "/home/ritwik ...READ MORE

Apr 18, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
151 views
0 votes
1 answer

How can I use my host machine’s web browser to check my HDFS services running in the VM?

The sole purpose of the virtual machine ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,300 points
150 views
0 votes
1 answer

Error in Hadoop Mapreduce

The file that you are referring here ...READ MORE

Apr 19, 2018 in Big Data Hadoop by Shubham
• 13,300 points
112 views