Most viewed questions in Big Data Hadoop

0 votes
1 answer

What is the best way to integrate SAS with Hadoop without losing the parallel processing capacity of Hadoop

One of the major pushes at SAS ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,152 views
0 votes
1 answer

which version of sqoop should i use for hadoop 3.3.0?

Hi@shresht, This is just a warning. Did you ...READ MORE

Sep 7, 2020 in Big Data Hadoop by MD
• 95,460 points
2,146 views
0 votes
1 answer

Command to listing all the tables In HBase?

Hey, list is the command that is used ...READ MORE

May 23, 2019 in Big Data Hadoop by Gitika
• 65,890 points
2,139 views
0 votes
1 answer

Hadoop: error: Cannot lock storage /app/hadoop/tmp/dfs/name. The directory is already locked.

Hi, Check your dfs.name.dir and dfs.data.dir path in hdfs-site.xml. Or ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
• 65,890 points
2,130 views
0 votes
2 answers

How to see MySql service is running or not using linux command?

Hi, You can simply run the following commands ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
2,126 views
0 votes
1 answer

When is an identity mapper/reducer used?

1.One of the simplest example of Iterative ...READ MORE

Apr 3, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,120 views
0 votes
2 answers

Not Able to read the file from hdfs location

Please make sure you connect to spark2-shell ...READ MORE

Jul 14, 2020 in Big Data Hadoop by Shantanu
• 190 points
2,117 views
0 votes
1 answer

Is there any hdfs dfs command to restrict number of files to be created in a directory ?

Not sure about the command but you ...READ MORE

May 6, 2019 in Big Data Hadoop by Shri
2,117 views
0 votes
1 answer

Is there any way to include a python package with Hadoop streaming job?

See I don't know the answer to ...READ MORE

May 10, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,116 views
0 votes
1 answer

Sqoop error while importing data from MySql

As the error states, the target directory ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,230 points
2,115 views
0 votes
1 answer

Not able to start namenode with ./start-all.sh

Try this: stop all the daemons: ./stop-all.sh format the namenode: cd ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,230 points
2,115 views
0 votes
1 answer

Namenode not getting started

You need to delete the contents of the ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,115 views
0 votes
2 answers

How to set up Map and Reduce Tasks?

Hi, The number of map tasks for a ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Rashi
2,104 views
0 votes
1 answer

Enabling TLS/SSL on Hive

To enable TLS/SSL on hive, you have ...READ MORE

May 31, 2019 in Big Data Hadoop by Haran
2,102 views
0 votes
1 answer

Difference between Text and String in Hadoop

The binary representation of a Text object ...READ MORE

Aug 8, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,099 views
0 votes
2 answers

E0901: Namenode [localhost:8020] not allowed, not in Oozies whitelist

You can add this below property in oozie-site.xml: <property> <name>oozie.service.HadoopAccessorService.jobTracker.whitelist</name> <value>myaddress:8020</value> </property> Hope ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Shiva
2,098 views
0 votes
1 answer

IOException: All datanodes are bad.

Hi@akhtar, As we know HDFS works in a ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,460 points
2,094 views
0 votes
1 answer

Explain to me how to get Hadoop configuration in Java Util.

In order to get access to the File ...READ MORE

May 24, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,090 views
0 votes
1 answer

Path to hiverc file

The hiverc file is not created by default. ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Jishan
2,090 views
0 votes
1 answer

How to load multiple tables in Sqoop?

U can use " import-all-tables " option ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Omkar
• 69,230 points
2,087 views
0 votes
1 answer

How do I join 2 tables in PIG using 2 fields?

Here, we have two tables: Tab1 having columns ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,087 views
0 votes
1 answer

How to use mountable HDFS on Centos?

Hey. You can use the following commands ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,082 views
0 votes
1 answer

Iterate twice on values (MapReduce)

We have to cache the values from ...READ MORE

Oct 1, 2018 in Big Data Hadoop by digger
• 26,740 points
2,078 views
0 votes
0 answers

ava.sql.SQLException: Error while processing statement:

Hi everyone, I am facing one issue ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Hemanth
• 250 points

edited Aug 7, 2019 by Omkar 2,077 views
0 votes
1 answer

Configuring JDBC Clients for LDAP Authentication with HiveServer2

JDBC client requires a connection URL as ...READ MORE

Jun 3, 2019 in Big Data Hadoop by Raman
2,073 views
0 votes
1 answer

How Impala is fast compared to Hive in terms of query response?

Impala provides faster response as it uses MPP(massively ...READ MORE

Mar 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,073 views
0 votes
1 answer

Query regarding String and Varchar in Hive

Varchar datatype is also saved internally as ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,230 points
2,069 views
0 votes
1 answer

Error: Could not create the Java Virtual Machine in Hadoop.

Hi@akhtar, You can list down all the files ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,460 points
2,068 views
0 votes
1 answer

How to delete hdfs folder from java app?

Try this: Configuration conf = new Configuration(); ...READ MORE

Oct 30, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,066 views
–1 vote
1 answer

How to use multiple spark version?

You can use the  SPARK_MAJOR_VERSION for this. Suppose ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,061 views
0 votes
1 answer

Getting error message on execution of sqoop command to list database

Please use the sqoop list database syntax ...READ MORE

May 23, 2019 in Big Data Hadoop by Rashmi
2,057 views
0 votes
1 answer

How can I write text in HDFS using CMD?

Hadoop put & appendToFile only reads standard ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,057 views
+1 vote
1 answer

Unable to load data in Hbase table from dataset

Try these steps (make necessary changes): First upload ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,053 views
0 votes
1 answer

Hadoop sqoop import not working. Error: ERROR manager.SqlManager: Error reading from database

In the command, try mentioning the driver ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,050 views
0 votes
1 answer

How do I connect my Spark based HDInsight cluster to my blob storage?

Go through this blog: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-use-blob-storage#access-blobs I went through this ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,049 views
0 votes
1 answer

which of the following are hadoop built in counters?

MapReduce in Hadoop maintains some built-in counters ...READ MORE

Dec 20, 2021 in Big Data Hadoop by Kavya
• 700 points
2,048 views
0 votes
1 answer

Can you please help with Hive Query to get FirstName, MiddleName, LastName and Suffix from FullName in Hive. Thank you

Hey, You can get first name, middle name, ...READ MORE

May 15, 2019 in Big Data Hadoop by Gitika
• 65,890 points

edited May 15, 2019 by Gitika 2,048 views
+2 votes
1 answer

Is Kafka and Zookeeper are required in a Big Data Cluster?

Apache Kafka is one of the components ...READ MORE

Mar 23, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,048 views
0 votes
1 answer

What is the command to find the free space in HDFS?

You can use dfsadmin which runs a ...READ MORE

Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,047 views
0 votes
1 answer

Name node is in safe mode. Not able to leave

In order to forcefully let the namenode ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,890 points
2,044 views
0 votes
1 answer

What Distributed Cache is actually used for in Hadoop?

Basically distributed cache allows you to cache ...READ MORE

Apr 3, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,041 views
0 votes
1 answer

How to run MapReduce program?

Eclipse is already installed in the Edureka ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Suman
2,038 views
0 votes
1 answer

How can we send data from MongoDB to Hadoop?

The MongoDB Connector for Hadoop reads data ...READ MORE

Mar 27, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,038 views
0 votes
1 answer

Unable to execute HDFS commands on the terminal

Maybe because you have not started hadoop ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,230 points
2,034 views
0 votes
1 answer

Distcp From Local to HDFS giving error file not found

Hey, @Amey, This is probably because of a ...READ MORE

Apr 29, 2020 in Big Data Hadoop by Gitika
• 65,890 points
2,033 views
0 votes
1 answer

JDBC to HiveServer2 connection in HTTPS mode with SSL enabled

To connect to HiveServer2 in HTTPS mode ...READ MORE

Jun 4, 2019 in Big Data Hadoop by Firoz
2,032 views
0 votes
1 answer

How to run Hadoop in Docker containers?

Hi, You can run Hadoop in Docker container. Follow ...READ MORE

Jan 24, 2020 in Big Data Hadoop by MD
• 95,460 points
2,031 views
0 votes
1 answer

Zookeeper server going down frequently.

Hi@B, There may be several reasons behind this. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,460 points
2,030 views
–1 vote
1 answer

Getting error while starting hdfs namenode -format

Check your /etc/hosts file, the format should be like ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,230 points
2,028 views
0 votes
1 answer

What is the meaning of Write Ahead Log in Hadoop?

Write Ahead Log (WAL) is a file ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Sunil
2,019 views