Most voted questions in Big Data Hadoop

+10 votes
11 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

modify the glibc version.CentOS provides safe softwares ...READ MORE

Sep 10, 2018 in Big Data Hadoop by bug_seeker
• 15,350 points
12,389 views
+5 votes
2 answers

Hive to HDFS transfer

Hive does not store data. Hive is ...READ MORE

Sep 20, 2018 in Big Data Hadoop by SM
718 views
+4 votes
3 answers

Unable to find file error- while Streaming Hadoop

Is python installed running on the slaves that ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Vinith
302 views
+3 votes
0 answers

How to handle Sqoop failure program and restart the job from failed tables?

When running a Sqoop jobs on a ...READ MORE

Aug 29 in Big Data Hadoop by Kunal
• 150 points

edited Sep 5 by Kunal 83 views
+3 votes
1 answer

Getting Connection Error while loading data into table using cloudera hive

Hey Nafeesa, Itseems that Hive is not able ...READ MORE

Oct 3, 2018 in Big Data Hadoop by Vardhan
• 12,570 points
76 views
+3 votes
5 answers

Hadoop DistributedCache is deprecated - what is the preferred API?

I had the same problem. And not ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rohan
318 views
+3 votes
1 answer

Apache Nifi Execute Process Processor

Hey soujanyabargavi!  NO, ExecuteProcess does not allow incoming ...READ MORE

Sep 20, 2018 in Big Data Hadoop by Omkar
• 67,600 points
684 views
+2 votes
1 answer

How To Configure Tls Encryption For Cloudera Manager?

The Cloudera Connect Partner Program, more than ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Frankie
• 9,810 points
31 views
+2 votes
1 answer
+2 votes
1 answer

Hadoop Jersey 1.x injection which is now not supported by Weblogic 12C

Add these lines to your weblogic-application.xml file ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Omkar
• 67,600 points
159 views
+2 votes
5 answers

Not able to start hadoop dfs

You can re-install openssh-client and openssh-server: $ sudo ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Jino
270 views
+2 votes
4 answers

Datanode process not running in Hadoop

Run the following commands: Stop-all.sh start-dfs.sh start-yarn.sh mr-jobhistory-daemon.sh ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Anand
310 views
+2 votes
2 answers

Create HIVE Table with multi character delimiter

FILELDS TERMINATED BY does not support multi-character delimiters. ...READ MORE

Oct 3, 2018 in Big Data Hadoop by slayer
• 29,170 points
2,009 views
+2 votes
5 answers

How to transpose/pivot data in hive?

Below is also a way for Pivot SELECT ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rahul
5,338 views
+2 votes
1 answer

How to calculate Maximum salary of the employee with the name using the Map Reduce Technique

Please try the below code and it ...READ MORE

Jul 25, 2018 in Big Data Hadoop by Neha
• 6,280 points
532 views
+2 votes
10 answers

Is there any difference between “hdfs dfs” and “hadoop fs” shell commands?

Yes, there's a difference between hadoop fs and ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Kunal
10,536 views
+1 vote
1 answer

Unable to create external table on HIVE

Hi @Ozer. The LOCATION is used to specify the ...READ MORE

Oct 14 in Big Data Hadoop by Kiran
67 views
+1 vote
1 answer
+1 vote
0 answers

Output of dump command has empty records

this is my input file output_pig_group_education_comma/input_load.txt and its ...READ MORE

Aug 10 in Big Data Hadoop by Manju Bhargavi
33 views
+1 vote
2 answers

Error: com/eng/mr/WordCountDriver : Unsupported major.minor version 52.0

The reason why you get this error ...READ MORE

Aug 6 in Big Data Hadoop by Venkita
• 240 points
31 views
+1 vote
2 answers

Hadoop: Error: Exception in thread “main” java.lang.UnsupportedClassVersionError: a

The reason for this error is because ...READ MORE

Aug 6 in Big Data Hadoop by Venkita
• 240 points
84 views
+1 vote
2 answers

Hadoop Administration

Make the following changes to your configuration ...READ MORE

Aug 5 in Big Data Hadoop by Simran
51 views
+1 vote
1 answer

What is the best way to merge multi-part HDFS files into single file?

1. In order to merge two or ...READ MORE

Jul 29 in Big Data Hadoop by Tina
320 views
+1 vote
1 answer
+1 vote
0 answers

Hadoop Installation error [closed]

Pls help on below error..on MAC OS WARN ...READ MORE

Jul 9 in Big Data Hadoop by Anshuman
• 130 points

closed Jul 10 by Omkar 25 views
+1 vote
1 answer

Explain to me the difference between Name node and Secondary name node

First of all, let understand what is ...READ MORE

May 14 in Big Data Hadoop by ravikiran
• 4,560 points
45 views
+1 vote
1 answer

windows 10 C:\Users\mk>hadoop -version output:- Error: Could not find or load main class P.

Hey, I guess the error you are facing ...READ MORE

May 10 in Big Data Hadoop by Gitika
• 25,340 points
136 views
+1 vote
1 answer

Why do we use STORE command in pig?

Hey, We use store command to store the ...READ MORE

May 7 in Big Data Hadoop by Gitika
• 25,340 points
33 views
+1 vote
1 answer

Explain to me the difference between HBase and HDFS

Let's start from scratch. Hadoop basically consists of three ...READ MORE

Mar 19 in Big Data Hadoop by nitinrawat895
• 10,690 points
68 views
+1 vote
1 answer

How can I get the Hadoop Documentation for its particular version?

Hi, You can download all the versions you ...READ MORE

Mar 19 in Big Data Hadoop by nitinrawat895
• 10,690 points
636 views
+1 vote
1 answer

Need help Installing Sqoop on Windows.

Download Sqoop from this link: http://www.apache.org/dyn/closer.lua/sqoop/1.4.7 This link is ...READ MORE

Feb 25 in Big Data Hadoop by Chandu
498 views
+1 vote
1 answer

How to install Kafka on Windows System?

These are the steps to install Kafka ...READ MORE

Feb 25 in Big Data Hadoop by Ramya
128 views
+1 vote
1 answer

How to delete sqoop job?

$ ​sqoop job --delete jobname But be careful ...READ MORE

Feb 19 in Big Data Hadoop by Omkar
• 67,600 points
765 views
+1 vote
1 answer

Do Cloudera’s Products Work With My Existing Data Management Infrastructure?

The Cloudera Connect Partner Program, more than ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Frankie
• 9,810 points
43 views
+1 vote
1 answer

Unable to load data in Hbase table from dataset

Try these steps (make necessary changes): First upload ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 67,600 points
290 views
+1 vote
1 answer

How to print data without brackets using PIG Dump?

Please refer to the below commands: student = ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 67,600 points
92 views
+1 vote
1 answer

What is the process to perform an incremental data load in Sqoop?

The process to perform incremental data load ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Frankie
• 9,810 points
430 views
+1 vote
1 answer

Hadoop Map Reduce: java.lang.reflect.InvocationTargetException

I executed the same code and it ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 67,600 points
186 views
+1 vote
1 answer

How to switch off Cloudera Manager Service?

First list the running services: chkconfig --list And then ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 67,600 points
43 views
+1 vote
1 answer

Not able to start datanode in Hadoop

Follow these steps: Stop namenode Delete the datanode directory ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 67,600 points
84 views
+1 vote
1 answer

How to get status of hdfs directory using python?

import commands hdir_list = commands.getoutput('hadoop fs -ls hdfs:/ ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 67,600 points
316 views
+1 vote
1 answer

How to write file in hdfs using python?

#!/usr/bin/python from subprocess import Popen, PIPE cat = Popen(["hadoop", ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 67,600 points
1,694 views
+1 vote
1 answer

Hadoop: "DEPRECATED: Use of this script to execute hdfs command is deprecated." error

The use of dfs in your command is "Deprecated". ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
• 67,600 points
770 views
+1 vote
1 answer

Hadoop: Using composite-key

You can use a Writable, something like ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 67,600 points
228 views
+1 vote
1 answer

What is the technique to know the Default scheduler in hadoop?

Default scheduler in hadoop is JobQueueTaskScheduler, which is ...READ MORE

Oct 30, 2018 in Big Data Hadoop by Frankie
• 9,810 points
122 views
+1 vote
1 answer

What is difference between Hadoop Namenode HA and HDFS federation?

The main difference between HDFS High Availability ...READ MORE

Oct 30, 2018 in Big Data Hadoop by Frankie
• 9,810 points
241 views
+1 vote
3 answers

HIVE: java.net.URISyntaxException

Change in hfs-site.xml this properties <name>hive.exec.scratchdir</name> <value>/tmp/hive-${user.name}</value> <name>hive.exec.local.scratchdir</name> <value>/tmp/${user.name}</value> <name>hive.downloaded.resources.dir</name> <value>/tmp/${user.name}_resources</value> <name>hive.scratch.dir.permission</name> ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Roshan
162 views
+1 vote
1 answer

How to count number of rows in alias in PIG?

COUNT is part of pig LOGS= LOAD 'log'; LOGS_GROUP= ...READ MORE

Oct 15, 2018 in Big Data Hadoop by Omkar
• 67,600 points
113 views