Trending questions in Big Data Hadoop

0 votes
1 answer

Disabling Kerberos authentication in Hadoop

Make the following changes: core-site.xml(Hadoop_Dir/etc/hadoop): ...READ MORE

May 16, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,644 views
0 votes
1 answer

JobTracker Task Scheduling

The task tracker send out heartbeat messages ...READ MORE

Jun 5, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
735 views
0 votes
1 answer

HDFS usage for small files

Well, the HDFS works more reliably with ...READ MORE

Jun 12, 2018 in Big Data Hadoop by BigData_is_my_ex
385 views
0 votes
1 answer

Hadoop job getting executed in local mode only?

Basically, you have not configured the mapreduce.framework.name ...READ MORE

May 3, 2018 in Big Data Hadoop by Atul
• 10,240 points
2,121 views
0 votes
1 answer

How to find the used cache in HDFS

hdfs dfsadmin -report This command tells fs ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,056 views
0 votes
1 answer

Getting error in command hdfs dfs -mkdir

You are getting this error because the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,847 views
0 votes
1 answer

Killing an Application from ResourceManager Web UI

In hadoop v2.7.1, if you open the ...READ MORE

Apr 23, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,469 views
0 votes
1 answer

Hadoop Command to merge edit logs with fsimage

You can use this command to save ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,686 views
0 votes
1 answer

Types of Hadoop Clusters

Below is the difference given between Standalone, ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,569 views
0 votes
1 answer

Changing hostname in fs.default.name property puts Hadoop in safemode

First of all, in Safe mode the ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,007 views
0 votes
1 answer

What are some of the famous visualization tools which can be integrated with Hadoop & Hive?

I have personally used two visualization tools ...READ MORE

May 1, 2018 in Big Data Hadoop by coldcode
• 2,080 points
1,809 views
0 votes
1 answer

Submitting MapReduce job using jobConf object vs job object

Both JobConf & Job objects are used ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,666 views
0 votes
1 answer

Moving files in Hadoop using the Java API?

I would recommend you to use FileSystem.rename(). ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,479 views
0 votes
1 answer

What is the command to find the free space in HDFS?

You can use dfsadmin which runs a ...READ MORE

Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,871 views
0 votes
1 answer

Visualization Tool in Cloudera CDH

Cloudera CDH comes with a Hadoop ecosystem ...READ MORE

May 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,060 views
0 votes
1 answer

What is Hue?

As you said, Hue is a web ...READ MORE

Mar 22, 2018 in Big Data Hadoop by Ashish
• 2,650 points

edited Mar 22, 2018 by Ashish 3,400 views
0 votes
1 answer

Namenode not getting started

You need to delete the contents of the ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,008 views
0 votes
1 answer

How to change the checkpointing duration in Hadoop

Answer: The default duration of checkpointing is 3600 ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,219 views
0 votes
1 answer

How can I write text in HDFS using CMD?

Hadoop put & appendToFile only reads standard ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,785 views
0 votes
1 answer

What is new in Hadoop 3?

Here are few changes in Hadoop 3 1. ...READ MORE

May 28, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
373 views
0 votes
1 answer

Can we use Apache Mahout without Hadoop dependency?

Yes. Not all of the Mahout depends ...READ MORE

May 17, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
785 views
0 votes
1 answer

Can we use HDFS to store git repositories?

Yes, it is possible to use HDFS ...READ MORE

May 7, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,205 views
0 votes
1 answer

Sqoop vs Oracle Hadoop Connectors

Most of the connectors would have the ...READ MORE

May 18, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
712 views
0 votes
1 answer

Which Data Structure is used in case of Map Reduce?

In case of Hadoop, HDFS is used ...READ MORE

May 4, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,289 views
0 votes
1 answer

Could not find the Sqoop directory in HDP 2.2

You can find the Sqoop lib directory ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,291 views
0 votes
1 answer

GUI for using Hadoop

Hue is open source and works well ...READ MORE

Apr 24, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
1,734 views
0 votes
1 answer

Differences between Hadoop-common, Hadoop-core and Hadoop-client?

To help provide some additional details regarding ...READ MORE

Mar 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,830 views
0 votes
1 answer

What is the difference between a zero reducer and identity reducer in Hadoop Mapreduce?

A Zero reducer as the name suggests ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,267 views
0 votes
1 answer

How Sqoop and Tera Data Connector for Hadoop differ from each other?

In order to make use of TD ...READ MORE

May 2, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,285 views
0 votes
1 answer

What is difference between Oozie workflow, coordinator and bundle ?

Workflow does not have time specifications to ...READ MORE

Mar 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,791 views
0 votes
1 answer

Setting the Number of Map tasks and Reduce Tasks not Working

The command that you are running is ...READ MORE

May 4, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,232 views
0 votes
1 answer

ApplicationMaster in YARN Architecture

Let me help you with your confusion: YARN ...READ MORE

May 8, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,053 views
0 votes
1 answer

Cannot connect to Hive from MicroStrategy BI tool

The problem is with your hive authentication. ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,008 views
0 votes
1 answer

How do we authenticate user from http.signature.secret file?

hadoop.http.authentication.signature.secret.file: The signature secret file for signing ...READ MORE

Apr 24, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,565 views
0 votes
1 answer

How do I connect my Spark based HDInsight cluster to my blob storage?

Go through this blog: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-use-blob-storage#access-blobs I went through this ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,934 views
0 votes
1 answer

How to practice programming with Hadoop?

Well there are multiple ways to solve ...READ MORE

Mar 30, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,662 views
0 votes
1 answer

Sqoop version compatible with Hadoop 0.20?

Apache Sqoop has 2 major projects i.e. ...READ MORE

May 9, 2018 in Big Data Hadoop by Shubham
• 13,490 points
832 views
0 votes
1 answer

What is the $HIVE_HOME in Hortonworks sandbox

You can find the hive-site.xml file /etc/hive/conf.install/hive-site.xml ...READ MORE

Apr 23, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,527 views
0 votes
1 answer

Getting error in MapReduce job.setInputFormatClass

In old Hadoop API(i.e. below Hadoop 0.20.0), ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,854 views
0 votes
1 answer

How to install Hadoop in Ubuntu?

Follow the steps as mentioned in the ...READ MORE

May 17, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
465 views
0 votes
1 answer

What does count command in Hadoop tells?

The output of the count command are: ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
1,495 views
0 votes
1 answer

How to tune Spark jobs & optimize the performance?

You need to know the cluster properly ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
• 2,080 points
1,681 views
0 votes
1 answer

How to transfer data from Netezza to HDFS using Apache Sqoop?

Remove the --direct option. It gives issue ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
1,477 views
0 votes
1 answer

Setting Hive/Hadoop property using Hive Query

You can set Hadoop & Hive conf ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,674 views
0 votes
1 answer

Hdfs Service Systemd - startup

I guess the issue you are facing ...READ MORE

Mar 29, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,540 views
0 votes
1 answer

Joining Multiple Spark Dataframes

You can run the below code to ...READ MORE

Mar 26, 2018 in Big Data Hadoop by Bharani
• 4,660 points
2,642 views
0 votes
1 answer

Hadoop combiners with aggregator functions

Both combiner & aggregator fulfill partly the ...READ MORE

May 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
440 views
0 votes
1 answer

How to set the number of Map & Reduce tasks?

The map tasks created for a job ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,608 views
0 votes
1 answer

Can we use Apache Sqoop and Hive both together? What is the difference between the two?

Yes, you can. In fact many people ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,553 views
0 votes
1 answer

How to import data to HBase from SQL server?

You can easily import the data from ...READ MORE

Apr 20, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
1,391 views