Most voted questions in Big Data Hadoop

+11 votes
11 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

modify the glibc version.CentOS provides safe softwares ...READ MORE

Sep 10, 2018 in Big Data Hadoop by bug_seeker
• 15,520 points
69,315 views
+5 votes
2 answers

Hive to HDFS transfer

Hive does not store data. Hive is ...READ MORE

Sep 20, 2018 in Big Data Hadoop by SM
3,652 views
+4 votes
3 answers

Unable to find file error- while Streaming Hadoop

Is python installed running on the slaves that ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Vinith
3,753 views
+3 votes
1 answer

Getting Connection Error while loading data into table using cloudera hive

Hey Nafeesa, Itseems that Hive is not able ...READ MORE

Oct 4, 2018 in Big Data Hadoop by Vardhan
• 13,190 points
714 views
+3 votes
5 answers

Hadoop DistributedCache is deprecated - what is the preferred API?

I had the same problem. And not ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rohan
1,899 views
+3 votes
1 answer

Apache Nifi Execute Process Processor

Hey soujanyabargavi!  NO, ExecuteProcess does not allow incoming ...READ MORE

Sep 20, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,674 views
+2 votes
1 answer

FileStreamSink: Error while looking for metadata directory. java.lang.IllegalArgumentException: java.net.UnknownHostException: hive

Hi@akhtar, You tried to read file from your ...READ MORE

Feb 13, 2020 in Big Data Hadoop by MD
• 95,440 points
10,531 views
+2 votes
0 answers

MapReduce Job is failed: "Job failed as tasks failed. failed Maps:1 failed Reduces:0"

Hi everyone This is an error that I'm ...READ MORE

Jan 17, 2020 in Big Data Hadoop by akhtar
• 38,230 points
1,155 views
+2 votes
0 answers
+2 votes
1 answer

how to escape delimiter in hive?

Refer to the below code used to ...READ MORE

Oct 31, 2019 in Big Data Hadoop by Kiran
7,141 views
+2 votes
1 answer

windows 10 C:\Users\mk>hadoop -version output:- Error: Could not find or load main class P.

Hey, I guess the error you are facing ...READ MORE

May 10, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,247 views
+2 votes
1 answer

How To Configure Tls Encryption For Cloudera Manager?

The Cloudera Connect Partner Program, more than ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
430 views
+2 votes
1 answer
+2 votes
1 answer

Hadoop Jersey 1.x injection which is now not supported by Weblogic 12C

Add these lines to your weblogic-application.xml file ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,138 views
+2 votes
5 answers

Not able to start hadoop dfs

You can re-install openssh-client and openssh-server: $ sudo ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Jino
2,504 views
+2 votes
4 answers

Datanode process not running in Hadoop

Run the following commands: Stop-all.sh start-dfs.sh start-yarn.sh mr-jobhistory-daemon.sh ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Anand
17,335 views
+2 votes
2 answers

Create HIVE Table with multi character delimiter

FILELDS TERMINATED BY does not support multi-character delimiters. ...READ MORE

Oct 3, 2018 in Big Data Hadoop by slayer
• 29,350 points
13,927 views
+2 votes
5 answers

How to transpose/pivot data in hive?

Below is also a way for Pivot SELECT ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rahul
19,136 views
+2 votes
1 answer

How to calculate Maximum salary of the employee with the name using the Map Reduce Technique

Please try the below code and it ...READ MORE

Jul 25, 2018 in Big Data Hadoop by Neha
• 6,300 points
5,270 views
+2 votes
1 answer

Is Kafka and Zookeeper are required in a Big Data Cluster?

Apache Kafka is one of the components ...READ MORE

Mar 23, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,873 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
104,768 views
+2 votes
10 answers

Is there any difference between “hdfs dfs” and “hadoop fs” shell commands?

hadoop fs <args> fs is used for generic ...READ MORE

Mar 16, 2018 in Big Data Hadoop by anonymous
32,581 views
+1 vote
1 answer

ssh: connect to host localhost port 22: Connection refused in Hadoop.

Hi@akhtar, You need to uninstall SSH and reinstall ...READ MORE

Dec 18, 2020 in Big Data Hadoop by MD
• 95,440 points
9,652 views
+1 vote
1 answer

How to use HDFStore to hold large datasets?

Hi@akhtar, You can store your datasets from pandas ...READ MORE

Dec 17, 2020 in Big Data Hadoop by MD
• 95,440 points
842 views
+1 vote
0 answers

How to export all collections in MongoDB?

Hi Team, I have one database in MongoDB. ...READ MORE

Dec 17, 2020 in Big Data Hadoop by akhtar
• 38,230 points
512 views
+1 vote
2 answers

How to delete and update a record in Hive?

Hi, Earlier, there was no operation supported for ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
• 38,230 points
6,030 views
+1 vote
1 answer

How does Hadoop process records split across block boundaries?

Interesting question, I spent some time looking ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,910 points
453 views
+1 vote
1 answer

When to use Hadoop, HBase, Hive and Pig?

MapReduce is just a computing framework. HBase has ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,910 points
754 views
+1 vote
1 answer

Not able to create kms key using ambari.

Hi@Shilpa, There may be a problem with your ...READ MORE

Nov 4, 2020 in Big Data Hadoop by MD
• 95,440 points
654 views
+1 vote
1 answer

How to copy file from Local file system to HDFS?

Hi@akhtar, You can copy files from your local ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,440 points
2,430 views
+1 vote
1 answer

How to check a HDFS directory size?

Hi@akhtar, You can check the size of the ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
549 views
+1 vote
1 answer

How to change columname in a dataframe

Hi@shanmugam, You can change your column by using ...READ MORE

May 21, 2020 in Big Data Hadoop by MD
• 95,440 points
610 views
+1 vote
1 answer

starting hive gave me exception

Hi@Hans, You may got this error, if you ...READ MORE

May 20, 2020 in Big Data Hadoop by MD
• 95,440 points
2,056 views
+1 vote
1 answer

FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

Hi@akhtar, This issue generally occurs when the memory ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,440 points
29,789 views
+1 vote
1 answer

Does sqoop 1.4.6 version on HDP 2.6.4 support SSL

Hi, Is your "JDBC location" string connect?  If ...READ MORE

Jan 29, 2020 in Big Data Hadoop by Roshan
1,041 views
+1 vote
1 answer

what is splunk?

Splunk is a software platform to search, ...READ MORE

Jan 24, 2020 in Big Data Hadoop by Vardhan
448 views
+1 vote
1 answer

About Available Space Block Placement Policy

Hi, We know, In HDFS data is divided into ...READ MORE

Jan 29, 2020 in Big Data Hadoop by MD
• 95,440 points
805 views
+1 vote
1 answer

Information Unavailable:Running jps command in Hadoop

Hi, I think this is because the process ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
1,474 views
+1 vote
1 answer

Streaming facebook data using Flume framework!!!

Hi You can find the facebook 'API' from ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
1,974 views
+1 vote
1 answer

Unhandled internal error. Java heap space

Hi As your file size is too large, ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
753 views
+1 vote
2 answers

How to find previous records from a data set in Pig??

Hi, You can use ToDate() and SubtractDuration() function ...READ MORE

Jan 23, 2020 in Big Data Hadoop by MD
• 95,440 points
986 views
+1 vote
0 answers

Hadoop Mapreduce : Null Pointer Exception

While running the below program, I got ...READ MORE

Dec 6, 2019 in Big Data Hadoop by Tarun
• 160 points
1,338 views
+1 vote
2 answers

Hadoop Learning Path

Hi! Since you have only 6 weeks, it's ...READ MORE

Nov 28, 2019 in Big Data Hadoop by Farheen
1,134 views
+1 vote
1 answer

datanode decomissioning

You have set the replication factor to ...READ MORE

Nov 28, 2019 in Big Data Hadoop by Rahul
538 views
+1 vote
0 answers

Oozie filter all coordinator jobs based on nominalTime

Hi Edureka team. I would like to ...READ MORE

Nov 12, 2019 in Big Data Hadoop by Thayanban
• 130 points
961 views
+1 vote
2 answers

Unable to create external table on HIVE

Hi @Ozer, This error occurred because there is ...READ MORE

Nov 7, 2019 in Big Data Hadoop by Richa
4,174 views
+1 vote
0 answers

Class not found exception in wordcount program in mapreduce

import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.Path; import java.io.IOException; import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat; import org.apache.hadoop.mapreduce.*; import org.apache.hadoop.mapreduce.lib.input.FileInputFormat; import ...READ MORE

Oct 3, 2019 in Big Data Hadoop by Tarun
• 160 points

edited Oct 3, 2019 by Omkar 1,371 views
+1 vote
1 answer

flume twitter data file not generated in HDFS

Seems like you've missed the source and ...READ MORE

Dec 2, 2019 in Big Data Hadoop by Esha
2,831 views
+1 vote
1 answer

Client not able to connect to cluster

There could be multiple reasons: Make sure you ...READ MORE

Sep 23, 2019 in Big Data Hadoop by Rishi
659 views