Trending questions in Big Data Hadoop

0 votes
1 answer

What is new in Hadoop 3?

Here are few changes in Hadoop 3 1. ...READ MORE

May 28, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
38 views
0 votes
1 answer

How to change the replication factor of specific directory in Hadoop?

Yes, you can change the replication factor ...READ MORE

May 10, 2018 in Big Data Hadoop by Shubham
• 13,310 points
770 views
0 votes
1 answer

can't find start-all.sh in hadoop installation

Actually, you are not mentioning the path for ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
1,764 views
0 votes
1 answer

Getting error in Hadoop: Output file already exist

When you executed your code earlier, you ...READ MORE

Apr 19, 2018 in Big Data Hadoop by Shubham
• 13,310 points
1,617 views
0 votes
1 answer

Is there any way to access Hadoop web UI in linux?

In this case what you can do ...READ MORE

May 9, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
751 views
0 votes
1 answer

What are the hardware requirements for installing Hadoop on my Laptop?

You can either install Apache Hadoop on ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
• 13,310 points
1,991 views
0 votes
1 answer

Is a HDFS block sequential ?

It seems like you are confused between the ...READ MORE

May 21, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
147 views
0 votes
1 answer

Disabling Kerberos authentication in Hadoop

Make the following changes: core-site.xml(Hadoop_Dir/etc/hadoop): ...READ MORE

May 15, 2018 in Big Data Hadoop by Shubham
• 13,310 points
362 views
0 votes
1 answer

Visualization Tool in Cloudera CDH

Cloudera CDH comes with a Hadoop ecosystem ...READ MORE

May 16, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
233 views
0 votes
1 answer

Is there any way to include a python package with Hadoop streaming job?

See I don't know the answer to ...READ MORE

May 10, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
434 views
0 votes
1 answer

Sqoop vs Oracle Hadoop Connectors

Most of the connectors would have the ...READ MORE

May 18, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
68 views
0 votes
1 answer

Meaning of fs.defaultFS property in core-site.xml in hadoop

fs.default.name property in core-site.xml tells the address ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,310 points
1,483 views
0 votes
1 answer

Can we use Apache Mahout without Hadoop dependency?

Yes. Not all of the Mahout depends ...READ MORE

May 17, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
93 views
0 votes
1 answer

Hadoop Command to merge edit logs with fsimage

You can use this command to save ...READ MORE

May 10, 2018 in Big Data Hadoop by Shubham
• 13,310 points
366 views
0 votes
1 answer

How to install Hadoop in Ubuntu?

Follow the steps as mentioned in the ...READ MORE

May 17, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
49 views
0 votes
1 answer

Moving data to hdfs using copyFromLocal command

Actually dfs.data.dir and dfs.name.dir have to point ...READ MORE

Mar 27, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
2,254 views
0 votes
1 answer

Hadoop combiners with aggregator functions

Both combiner & aggregator fulfill partly the ...READ MORE

May 16, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
54 views
0 votes
1 answer

NodeManager is not able to connect to the ResourceManager.

Here, I guess the issue is with ...READ MORE

May 1, 2018 in Big Data Hadoop by Shubham
• 13,310 points
703 views
0 votes
1 answer

Does setup & clean methods in Hadoop MapReduce is executed after each task?

Setup & cleanup methods are executed after ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,310 points
371 views
0 votes
1 answer

Java MapReduce error saying No FileSystem for scheme:hdfs

The problem is with the dependencies. The ...READ MORE

May 9, 2018 in Big Data Hadoop by Shubham
• 13,310 points
307 views
0 votes
1 answer

Is it compulsory to have the hadoop user as sudo user?

No, it is not important to have ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,310 points
345 views
0 votes
1 answer

Getting error in JAVA_HOME variable.

First of all check the hadoop version ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,310 points
208 views
0 votes
1 answer

Error while copying the file from local to HDFS

Well, the reason you are getting such ...READ MORE

May 2, 2018 in Big Data Hadoop by Ashish
• 2,630 points
567 views
0 votes
1 answer

Hadoop job getting executed in local mode only?

Basically, you have not configured the mapreduce.framework.name ...READ MORE

May 3, 2018 in Big Data Hadoop by Atul
• 10,240 points
527 views
0 votes
1 answer

Installing Hive & Hadoop in VM

For Hadoop installation, I would recommend you ...READ MORE

Apr 19, 2018 in Big Data Hadoop by Shubham
• 13,310 points
1,102 views
+1 vote
1 answer

Where to set hadoop.tmp.dir? core-site.xml or hdfs-site.xml?

hadoop.tmp.dir (A base for other temporary directories) is ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
2,070 views
0 votes
1 answer

Is there any way to delete a directory from Hadoop cluster which is having comma(,) in its name?

Just try the following command: hadoop fs -rm ...READ MORE

May 7, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
303 views
0 votes
1 answer

Why Apache Pig is used instead of Hadoop?

As you know writing mapreduce programs in ...READ MORE

May 7, 2018 in Big Data Hadoop by Ashish
• 2,630 points
283 views
0 votes
1 answer

Hadoop giving java.io.IOException, in mkdir Java code.

I am not sure about the issue. ...READ MORE

May 3, 2018 in Big Data Hadoop by Shubham
• 13,310 points
482 views
0 votes
1 answer

What is the use of sequence file in Hadoop?

Sequence files are binary files containing serialized ...READ MORE

Apr 5, 2018 in Big Data Hadoop by Ashish
• 2,630 points
1,665 views
0 votes
1 answer

ApplicationMaster in YARN Architecture

Let me help you with your confusion: YARN ...READ MORE

May 7, 2018 in Big Data Hadoop by Ashish
• 2,630 points
274 views
0 votes
1 answer

How to change the checkpointing duration in Hadoop

Answer: The default duration of checkpointing is 3600 ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,310 points
111 views
0 votes
1 answer

What is the slaves file configuration in Hadoop?

The main idea behind is the master ...READ MORE

Apr 24, 2018 in Big Data Hadoop by Shubham
• 13,310 points
816 views
0 votes
1 answer

Cannot connect to Hive from MicroStrategy BI tool

The problem is with your hive authentication. ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,310 points
205 views
0 votes
1 answer

Sqoop version compatible with Hadoop 0.20?

Apache Sqoop has 2 major projects i.e. ...READ MORE

May 9, 2018 in Big Data Hadoop by Shubham
• 13,310 points
148 views
0 votes
1 answer

How to find Hadoop version in CDH?

The simplest way to check Hadoop version ...READ MORE

Apr 19, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
1,004 views
0 votes
1 answer

Submitting MapReduce job using jobConf object vs job object

Both JobConf & Job objects are used ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,310 points
350 views
0 votes
1 answer

Is there a way to copy data from one one Hadoop distributed file system(HDFS) to another HDFS?

The distributed copy command, distcp, is a ...READ MORE

Mar 22, 2018 in Big Data Hadoop by Ashish
• 2,630 points
2,206 views
0 votes
1 answer

How Sqoop and Tera Data Connector for Hadoop differ from each other?

In order to make use of TD ...READ MORE

May 2, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
385 views
0 votes
1 answer

Can we use HDFS to store git repositories?

Yes, it is possible to use HDFS ...READ MORE

May 7, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
160 views
0 votes
1 answer

Could not find the Sqoop directory in HDP 2.2

You can find the Sqoop lib directory ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,310 points
287 views
0 votes
1 answer

How hadoop mapreduce job is submitted to worker nodes?

Alright, I think you are basically looking ...READ MORE

Mar 29, 2018 in Big Data Hadoop by Ashish
• 2,630 points
1,826 views
0 votes
1 answer

How to find the used cache in HDFS

hdfs dfsadmin -report This command tells fs ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,310 points
266 views
0 votes
1 answer

What are some of the famous visualization tools which can be integrated with Hadoop & Hive?

I have personally used two visualization tools ...READ MORE

May 1, 2018 in Big Data Hadoop by coldcode
• 2,020 points
370 views
0 votes
1 answer

What is the command to navigate in HDFS?

First of all there is no command ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,310 points
519 views
0 votes
1 answer

Hadoop absolute path - pwd ?

"hdfs dfs -pwd" does not exist because ...READ MORE

Mar 27, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
1,847 views
0 votes
1 answer

Is there any way to increase Java Heap size in Hadoop?

You can add some more memory by ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
1,146 views
0 votes
1 answer

Changing hostname in fs.default.name property puts Hadoop in safemode

First of all, in Safe mode the ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,310 points
492 views
0 votes
1 answer

How can I put file to HDFS directly without copying it local disk?

Can use pipe from wget to hdfs. You ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
970 views
0 votes
1 answer

Which Data Structure is used in case of Map Reduce?

In case of Hadoop, HDFS is used ...READ MORE

May 4, 2018 in Big Data Hadoop by nitinrawat895
• 10,730 points
140 views