Latest questions in Big Data Hadoop

0 votes
1 answer

When is the reduce tasks start in Hadoop?

Let me explain you the whole scenario. ...READ MORE

May 22, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,390 views
0 votes
1 answer

Is a HDFS block sequential ?

It seems like you are confused between the ...READ MORE

May 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,417 views
0 votes
1 answer

Is there any way to pull data from Mainframe to Hadoop?

First of all, COBOL is a programming ...READ MORE

May 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,358 views
0 votes
1 answer

Sqoop vs Oracle Hadoop Connectors

Most of the connectors would have the ...READ MORE

May 18, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
725 views
0 votes
1 answer

Can we use Apache Mahout without Hadoop dependency?

Yes. Not all of the Mahout depends ...READ MORE

May 17, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
791 views
0 votes
1 answer

How to install Hadoop in Ubuntu?

Follow the steps as mentioned in the ...READ MORE

May 17, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
467 views
0 votes
3 answers

How to connect Spark to a remote Hive server?

JDBC is not required here. Create a hive ...READ MORE

Mar 8, 2019 in Big Data Hadoop by Vijay Dixon
• 190 points
12,159 views
0 votes
1 answer

What is the command to check the number of cores in Spark?

Go to your Spark Web UI & ...READ MORE

May 17, 2018 in Big Data Hadoop by Shubham
• 13,490 points
6,499 views
0 votes
1 answer

Hadoop combiners with aggregator functions

Both combiner & aggregator fulfill partly the ...READ MORE

May 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
444 views
0 votes
1 answer

Visualization Tool in Cloudera CDH

Cloudera CDH comes with a Hadoop ecosystem ...READ MORE

May 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,061 views
0 votes
1 answer

How can anyone recover deleted HDFS data?

Yes, there is a trash policy in ...READ MORE

May 16, 2018 in Big Data Hadoop by Shubham
• 13,490 points
10,320 views
0 votes
1 answer

Disabling Kerberos authentication in Hadoop

Make the following changes: core-site.xml(Hadoop_Dir/etc/hadoop): ...READ MORE

May 16, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,645 views
0 votes
1 answer

Getting error in JAVA_HOME variable.

First of all check the hadoop version ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,996 views
0 votes
1 answer

How to change the checkpointing duration in Hadoop

Answer: The default duration of checkpointing is 3600 ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,227 views
0 votes
1 answer

How to change the replication factor of specific directory in Hadoop?

Yes, you can change the replication factor ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,404 views
0 votes
1 answer

Hadoop Command to merge edit logs with fsimage

You can use this command to save ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,688 views
0 votes
1 answer

Is there any way to include a python package with Hadoop streaming job?

See I don't know the answer to ...READ MORE

May 10, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,982 views
0 votes
10 answers

Difference between single node & pseudo-distributed mode in Hadoop?

Single node is used for debugging the ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Mahisha
18,443 views
0 votes
1 answer

Sqoop version compatible with Hadoop 0.20?

Apache Sqoop has 2 major projects i.e. ...READ MORE

May 9, 2018 in Big Data Hadoop by Shubham
• 13,490 points
832 views
0 votes
1 answer

Java MapReduce error saying No FileSystem for scheme:hdfs

The problem is with the dependencies. The ...READ MORE

May 9, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,286 views
0 votes
1 answer

“no such file or directory" in case of hadoop fs -ls

The behaviour that you are seeing is ...READ MORE

May 9, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points

edited May 9, 2018 by nitinrawat895 7,838 views
0 votes
1 answer

Is there any way to access Hadoop web UI in linux?

In this case what you can do ...READ MORE

May 9, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,592 views
0 votes
2 answers

Difference between HDFS and NFS

In NFS, the data is stored only ...READ MORE

Feb 4, 2019 in Big Data Hadoop by Kumar
14,267 views
+1 vote
1 answer

How can we list files in HDFS directory as per timestamp?

No, there is no other option to ...READ MORE

May 8, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
11,290 views
0 votes
1 answer

Does setup & clean methods in Hadoop MapReduce is executed after each task?

Setup & cleanup methods are executed after ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,975 views
0 votes
1 answer

Cannot connect to Hive from MicroStrategy BI tool

The problem is with your hive authentication. ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,010 views
0 votes
1 answer

Where does HDFS stores data on the local file system?

First find the Hadoop directory present in ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,490 points
15,757 views
0 votes
1 answer

Is it compulsory to have the hadoop user as sudo user?

No, it is not important to have ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,119 views
0 votes
1 answer

Why Apache Pig is used instead of Hadoop?

As you know writing mapreduce programs in ...READ MORE

May 8, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,170 views
0 votes
1 answer

ApplicationMaster in YARN Architecture

Let me help you with your confusion: YARN ...READ MORE

May 8, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,055 views
0 votes
1 answer

How to delete a directory from Hadoop cluster which is having comma(,) in its name?

Just try the following command: hadoop fs -rm ...READ MORE

May 7, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,800 views
0 votes
1 answer

Can we use HDFS to store git repositories?

Yes, it is possible to use HDFS ...READ MORE

May 7, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,206 views
0 votes
1 answer

What is the default location of Hadoop log files & how can I change that location?

The default directory of Hadoop log file ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
20,581 views
0 votes
1 answer

Submitting MapReduce job using jobConf object vs job object

Both JobConf & Job objects are used ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,667 views
0 votes
1 answer

Which Data Structure is used in case of Map Reduce?

In case of Hadoop, HDFS is used ...READ MORE

May 4, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,291 views
0 votes
9 answers

Is there any way to check which Hadoop daemons are running?

use jps command, It will show all the running ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Rakesh
• 160 points
45,400 views
0 votes
1 answer

How to find the used cache in HDFS

hdfs dfsadmin -report This command tells fs ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,057 views
0 votes
1 answer

Could not find the Sqoop directory in HDP 2.2

You can find the Sqoop lib directory ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,292 views
0 votes
1 answer

What happend while formatting hadoop namenode?

Basically, NameNode is the master daemon that ...READ MORE

May 4, 2018 in Big Data Hadoop by Ashish
• 2,650 points
416 views
0 votes
1 answer

Setting the Number of Map tasks and Reduce Tasks not Working

The command that you are running is ...READ MORE

May 4, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,238 views
0 votes
1 answer

Where Big Data tools like Hadoop and Spark comes into picture when we talk about ETL?

When we talk about ETL, ETL means ...READ MORE

May 3, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
418 views
+1 vote
12 answers

How to check size of HDFS directory?

It is the same syntax. Use the ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Sowmya
46,049 views
0 votes
1 answer

After installing Hadoop on Windows7, NameNode failed to start

You need to install Hadoop winutils to ...READ MORE

May 3, 2018 in Big Data Hadoop by Shubham
• 13,490 points
6,735 views
0 votes
1 answer

Hadoop giving java.io.IOException, in mkdir Java code.

I am not sure about the issue. ...READ MORE

May 3, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,250 views
0 votes
1 answer

Hadoop job getting executed in local mode only?

Basically, you have not configured the mapreduce.framework.name ...READ MORE

May 3, 2018 in Big Data Hadoop by Atul
• 10,240 points
2,128 views
0 votes
1 answer

Error while copying the file from local to HDFS

Well, the reason you are getting such ...READ MORE

May 3, 2018 in Big Data Hadoop by Ashish
• 2,650 points
3,700 views
0 votes
1 answer

How to extract only few lines of data from HDFS?

Here also in case of Hadoop, it is ...READ MORE

May 2, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
10,817 views
0 votes
1 answer

How Sqoop and Tera Data Connector for Hadoop differ from each other?

In order to make use of TD ...READ MORE

May 2, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,287 views
0 votes
1 answer

NodeManager is not able to connect to the ResourceManager.

Here, I guess the issue is with ...READ MORE

May 1, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,463 views
0 votes
1 answer

What are some of the famous visualization tools which can be integrated with Hadoop & Hive?

I have personally used two visualization tools ...READ MORE

May 1, 2018 in Big Data Hadoop by coldcode
• 2,080 points
1,819 views