Most voted questions in Big Data Hadoop

+11 votes
11 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

modify the glibc version.CentOS provides safe softwares ...READ MORE

Sep 10, 2018 in Big Data Hadoop by bug_seeker
• 15,510 points
72,146 views
+5 votes
2 answers

Hive to HDFS transfer

Hive does not store data. Hive is ...READ MORE

Sep 20, 2018 in Big Data Hadoop by SM
3,982 views
+4 votes
3 answers

Unable to find file error- while Streaming Hadoop

Is python installed running on the slaves that ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Vinith
4,297 views
+3 votes
1 answer

Getting Connection Error while loading data into table using cloudera hive

Hey Nafeesa, Itseems that Hive is not able ...READ MORE

Oct 4, 2018 in Big Data Hadoop by Vardhan
• 13,150 points
1,015 views
+3 votes
5 answers

Hadoop DistributedCache is deprecated - what is the preferred API?

I had the same problem. And not ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rohan
2,343 views
+3 votes
1 answer

Apache Nifi Execute Process Processor

Hey soujanyabargavi!  NO, ExecuteProcess does not allow incoming ...READ MORE

Sep 20, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,205 views
+2 votes
1 answer

FileStreamSink: Error while looking for metadata directory. java.lang.IllegalArgumentException: java.net.UnknownHostException: hive

Hi@akhtar, You tried to read file from your ...READ MORE

Feb 13, 2020 in Big Data Hadoop by MD
• 95,460 points
11,267 views
+2 votes
0 answers

MapReduce Job is failed: "Job failed as tasks failed. failed Maps:1 failed Reduces:0"

Hi everyone This is an error that I'm ...READ MORE

Jan 17, 2020 in Big Data Hadoop by akhtar
• 38,260 points
1,469 views
+2 votes
0 answers
+2 votes
1 answer

how to escape delimiter in hive?

Refer to the below code used to ...READ MORE

Oct 31, 2019 in Big Data Hadoop by Kiran
7,629 views
+2 votes
1 answer

windows 10 C:\Users\mk>hadoop -version output:- Error: Could not find or load main class P.

Hey, I guess the error you are facing ...READ MORE

May 10, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,588 views
+2 votes
1 answer

How To Configure Tls Encryption For Cloudera Manager?

The Cloudera Connect Partner Program, more than ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
707 views
+2 votes
1 answer
+2 votes
1 answer

Hadoop Jersey 1.x injection which is now not supported by Weblogic 12C

Add these lines to your weblogic-application.xml file ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,356 views
+2 votes
5 answers

Not able to start hadoop dfs

You can re-install openssh-client and openssh-server: $ sudo ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Jino
3,125 views
+2 votes
4 answers

Datanode process not running in Hadoop

Run the following commands: Stop-all.sh start-dfs.sh start-yarn.sh mr-jobhistory-daemon.sh ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Anand
18,591 views
+2 votes
2 answers

Create HIVE Table with multi character delimiter

FILELDS TERMINATED BY does not support multi-character delimiters. ...READ MORE

Oct 3, 2018 in Big Data Hadoop by slayer
• 29,370 points
14,604 views
+2 votes
5 answers

How to transpose/pivot data in hive?

Below is also a way for Pivot SELECT ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rahul
20,016 views
+2 votes
1 answer

How to calculate Maximum salary of the employee with the name using the Map Reduce Technique

Please try the below code and it ...READ MORE

Jul 25, 2018 in Big Data Hadoop by Neha
• 6,300 points
5,673 views
+2 votes
1 answer

Is Kafka and Zookeeper are required in a Big Data Cluster?

Apache Kafka is one of the components ...READ MORE

Mar 23, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,111 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
109,026 views
+2 votes
10 answers

Is there any difference between “hdfs dfs” and “hadoop fs” shell commands?

hadoop fs <args> fs is used for generic ...READ MORE

Mar 16, 2018 in Big Data Hadoop by anonymous
34,164 views
+1 vote
1 answer

ssh: connect to host localhost port 22: Connection refused in Hadoop.

Hi@akhtar, You need to uninstall SSH and reinstall ...READ MORE

Dec 18, 2020 in Big Data Hadoop by MD
• 95,460 points
10,264 views
+1 vote
1 answer

How to use HDFStore to hold large datasets?

Hi@akhtar, You can store your datasets from pandas ...READ MORE

Dec 17, 2020 in Big Data Hadoop by MD
• 95,460 points
1,088 views
+1 vote
0 answers

How to export all collections in MongoDB?

Hi Team, I have one database in MongoDB. ...READ MORE

Dec 17, 2020 in Big Data Hadoop by akhtar
• 38,260 points
651 views
+1 vote
2 answers

How to delete and update a record in Hive?

Hi, Earlier, there was no operation supported for ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
• 38,260 points
6,718 views
+1 vote
1 answer

How does Hadoop process records split across block boundaries?

Interesting question, I spent some time looking ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,770 points
732 views
+1 vote
1 answer

When to use Hadoop, HBase, Hive and Pig?

MapReduce is just a computing framework. HBase has ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,770 points
970 views
+1 vote
1 answer

Not able to create kms key using ambari.

Hi@Shilpa, There may be a problem with your ...READ MORE

Nov 4, 2020 in Big Data Hadoop by MD
• 95,460 points
952 views
+1 vote
1 answer

How to copy file from Local file system to HDFS?

Hi@akhtar, You can copy files from your local ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,460 points
3,002 views
+1 vote
1 answer

How to check a HDFS directory size?

Hi@akhtar, You can check the size of the ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,460 points
901 views
+1 vote
1 answer

How to change columname in a dataframe

Hi@shanmugam, You can change your column by using ...READ MORE

May 21, 2020 in Big Data Hadoop by MD
• 95,460 points
796 views
+1 vote
1 answer

starting hive gave me exception

Hi@Hans, You may got this error, if you ...READ MORE

May 20, 2020 in Big Data Hadoop by MD
• 95,460 points
2,400 views
+1 vote
1 answer

FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

Hi@akhtar, This issue generally occurs when the memory ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,460 points
31,087 views
+1 vote
1 answer

Does sqoop 1.4.6 version on HDP 2.6.4 support SSL

Hi, Is your "JDBC location" string connect?  If ...READ MORE

Jan 29, 2020 in Big Data Hadoop by Roshan
1,315 views
+1 vote
1 answer

what is splunk?

Splunk is a software platform to search, ...READ MORE

Jan 24, 2020 in Big Data Hadoop by Vardhan
731 views
+1 vote
1 answer

About Available Space Block Placement Policy

Hi, We know, In HDFS data is divided into ...READ MORE

Jan 29, 2020 in Big Data Hadoop by MD
• 95,460 points
955 views
+1 vote
1 answer

Information Unavailable:Running jps command in Hadoop

Hi, I think this is because the process ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
2,036 views
+1 vote
1 answer

Streaming facebook data using Flume framework!!!

Hi You can find the facebook 'API' from ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
2,473 views
+1 vote
1 answer

Unhandled internal error. Java heap space

Hi As your file size is too large, ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
1,085 views
+1 vote
2 answers

How to find previous records from a data set in Pig??

Hi, You can use ToDate() and SubtractDuration() function ...READ MORE

Jan 23, 2020 in Big Data Hadoop by MD
• 95,460 points
1,470 views
+1 vote
0 answers

Hadoop Mapreduce : Null Pointer Exception

While running the below program, I got ...READ MORE

Dec 6, 2019 in Big Data Hadoop by Tarun
• 160 points
1,622 views
+1 vote
2 answers

Hadoop Learning Path

Hi! Since you have only 6 weeks, it's ...READ MORE

Nov 28, 2019 in Big Data Hadoop by Farheen
1,298 views
+1 vote
1 answer

datanode decomissioning

You have set the replication factor to ...READ MORE

Nov 28, 2019 in Big Data Hadoop by Rahul
725 views
+1 vote
0 answers

Oozie filter all coordinator jobs based on nominalTime

Hi Edureka team. I would like to ...READ MORE

Nov 12, 2019 in Big Data Hadoop by Thayanban
• 130 points
1,178 views
+1 vote
2 answers

Unable to create external table on HIVE

Hi @Ozer, This error occurred because there is ...READ MORE

Nov 7, 2019 in Big Data Hadoop by Richa
4,601 views
+1 vote
0 answers

Class not found exception in wordcount program in mapreduce

import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.Path; import java.io.IOException; import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat; import org.apache.hadoop.mapreduce.*; import org.apache.hadoop.mapreduce.lib.input.FileInputFormat; import ...READ MORE

Oct 3, 2019 in Big Data Hadoop by Tarun
• 160 points

edited Oct 3, 2019 by Omkar 1,827 views
+1 vote
1 answer

flume twitter data file not generated in HDFS

Seems like you've missed the source and ...READ MORE

Dec 2, 2019 in Big Data Hadoop by Esha
3,719 views
+1 vote
1 answer

Client not able to connect to cluster

There could be multiple reasons: Make sure you ...READ MORE

Sep 23, 2019 in Big Data Hadoop by Rishi
943 views