Most viewed questions in Big Data Hadoop

0 votes
1 answer

Difference between Text and String in Hadoop

The binary representation of a Text object ...READ MORE

Aug 8, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,544 views
0 votes
1 answer

IOException: All datanodes are bad.

Hi@akhtar, As we know HDFS works in a ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,460 points
2,542 views
0 votes
1 answer

Hadoop Command to merge edit logs with fsimage

You can use this command to save ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,535 views
+2 votes
1 answer

Is Kafka and Zookeeper are required in a Big Data Cluster?

Apache Kafka is one of the components ...READ MORE

Mar 23, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,535 views
0 votes
1 answer

Hbase installation Issue. Cant start HRegionServer and HQuorumPeer

It seems hbase did not start properly ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,532 views
0 votes
0 answers

What are the pros and cons of parquet format compared to other formats?

Hi Team, I am new to Hadoop I ...READ MORE

Dec 21, 2020 in Big Data Hadoop by akhtar
• 38,260 points
2,531 views
0 votes
1 answer

How can we send data from MongoDB to Hadoop?

The MongoDB Connector for Hadoop reads data ...READ MORE

Mar 27, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,529 views
0 votes
1 answer

Namenode not getting started

You need to delete the contents of the ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
2,528 views
+1 vote
1 answer

When I try to execute any Hadoop commands error pops up saying unable to find or load main class M

The error might be due to the ...READ MORE

Jul 17, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,523 views
0 votes
1 answer

What happens in a MapReduce job when you set the number of reducers to one?

If you set number of reducers as ...READ MORE

Jul 31, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,518 views
0 votes
1 answer

Hadoop Spark: What is version to find SparkSession in library Spark?

you need both core and SQL artifacts <repositories> ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,517 views
0 votes
1 answer

Which of the following is not a hadoop output format?

The Hadoop Output Format checks the Output ...READ MORE

Dec 20, 2021 in Big Data Hadoop by Kavya
• 700 points
2,516 views
0 votes
1 answer

Load data into teradata using sqoop

The general syntax to do this as ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Ritu
2,516 views
0 votes
1 answer

How to upload files in Hadoop Cluster?

Hi@akhtar, To upload a file in Hadoop Cluster, ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,460 points
2,506 views
0 votes
3 answers

How to specify KeyValueTextInputFormat Separator in Hadoop-.20 api?

conf.set("key.value.separator.in.input.line", ","); Job job = new ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Rio
2,501 views
0 votes
1 answer

JDBC to HiveServer2 connection in HTTPS mode with SSL enabled

To connect to HiveServer2 in HTTPS mode ...READ MORE

Jun 4, 2019 in Big Data Hadoop by Firoz
2,500 views
0 votes
1 answer

Getting error message on execution of sqoop command to list database

Please use the sqoop list database syntax ...READ MORE

May 23, 2019 in Big Data Hadoop by Rashmi
2,500 views
0 votes
1 answer

Explain to me how to get Hadoop configuration in Java Util.

In order to get access to the File ...READ MORE

May 24, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,498 views
0 votes
1 answer

Enabling TLS/SSL on Hive

To enable TLS/SSL on hive, you have ...READ MORE

May 31, 2019 in Big Data Hadoop by Haran
2,494 views
0 votes
1 answer

Sqoop import gives error: org.apache.hadoop.security.AccessControlException: Permission denied

Seems like you are not passing the ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,487 views
0 votes
1 answer

Unable to Locate WinUtils Library in Hadoop binary path.

If you are facing this problem while running a ...READ MORE

Jul 11, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,484 views
0 votes
1 answer

What are the services running in Hadoop

Below are the services Running in Hadoop Hdfs  yarn mapreduce ozzie zookeeper hive hue hbase impala flume sqoop spark Depending ...READ MORE

Jun 24, 2019 in Big Data Hadoop by deepak
2,479 views
+1 vote
1 answer

Unable to load data in Hbase table from dataset

Try these steps (make necessary changes): First upload ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,479 views
0 votes
1 answer

How to add a column in Hive table?

Hi@akhtar, You can use the alter table command ...READ MORE

Oct 19, 2020 in Big Data Hadoop by MD
• 95,460 points
2,477 views
0 votes
1 answer

How to find hadoop distribution and version?

Just Use the command Hadoop version ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points

edited Apr 6, 2018 by kurt_cobain 2,474 views
0 votes
1 answer

How do I connect my Spark based HDInsight cluster to my blob storage?

Go through this blog: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-use-blob-storage#access-blobs I went through this ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,468 views
0 votes
1 answer

How to delete hdfs folder from java app?

Try this: Configuration conf = new Configuration(); ...READ MORE

Oct 30, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,467 views
0 votes
1 answer

Getting error in MapReduce job.setInputFormatClass

In old Hadoop API(i.e. below Hadoop 0.20.0), ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,466 views
0 votes
1 answer

I have installed Hadoop on Ubuntu but name node is not running.

If you are using Hadoop version-2.7.7, then ...READ MORE

Apr 30, 2019 in Big Data Hadoop by Gitika
• 65,730 points
2,465 views
0 votes
1 answer

How do I join 2 tables in PIG using 2 fields?

Here, we have two tables: Tab1 having columns ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,461 views
0 votes
1 answer

How to reduce shuffling cost in map reduce?

You can define a Combiner function, which does the ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,460 views
0 votes
1 answer

Cant access file from Hive. permission denied

There are two possible reasons for this: Wrong ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,460 views
0 votes
1 answer

Hadoop: How to use Jps command with Sun JDK installed?

You can put JPS into your path ...READ MORE

Nov 9, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,459 views
0 votes
1 answer

Distcp From Local to HDFS giving error file not found

Hey, @Amey, This is probably because of a ...READ MORE

Apr 29, 2020 in Big Data Hadoop by Gitika
• 65,730 points
2,457 views
0 votes
1 answer

Difference between root of hdfs and local machine

The command hdfs dfs -put command is used to ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Mahi
2,452 views
0 votes
1 answer

Disable dynamic partition in hive

Dynamic partition is set to true by ...READ MORE

May 21, 2019 in Big Data Hadoop by Vishwa
2,451 views
0 votes
1 answer

Sqoop import where clause problem

The syntax you are using is wrong. ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,449 views
0 votes
1 answer

Setting Hive/Hadoop property using Hive Query

You can set Hadoop & Hive conf ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,447 views
0 votes
1 answer

How to exit name node from safe mode?

In order to forcefully let the namenode ...READ MORE

Sep 26, 2018 in Big Data Hadoop by slayer
• 29,370 points
2,442 views
0 votes
1 answer

How compression works in Hadoop?

It basically depends on the file type ...READ MORE

Jul 27, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,441 views
0 votes
1 answer

How to set the number of Map & Reduce tasks?

The map tasks created for a job ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,441 views
0 votes
1 answer

How to change file format using Sqoop?

For change in the file format, you ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,430 views
0 votes
1 answer

Impala: Add months to current time

You can add the months using the add_months method ...READ MORE

Jun 6, 2019 in Big Data Hadoop by John
2,428 views
0 votes
1 answer

What do we exactly mean by “Hadoop” – the definition of Hadoop?

The official definition of Apache Hadoop given ...READ MORE

Mar 16, 2018 in Big Data Hadoop by Shubham
2,426 views
0 votes
1 answer

Hadoop sqoop import not working. Error: ERROR manager.SqlManager: Error reading from database

In the command, try mentioning the driver ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,425 views
0 votes
1 answer

Not able to start/stop hadoop daemons

If you were able to start the ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,419 views
0 votes
1 answer

Hadoop vs Data Lake

A data lake is a storage repository that holds ...READ MORE

Mar 26, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,416 views
0 votes
1 answer

Does Hadoop and Spark support iPv6 now?

It does not. As of today HADOOP-11890, which ...READ MORE

Oct 15, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,414 views
0 votes
1 answer

Connection String for MySQL database using Sqoop

The format for the connection string and ...READ MORE

Jun 6, 2019 in Big Data Hadoop by John
2,408 views