Most answered questions in Big Data Hadoop

0 votes
13 answers

What is the difference between Hadoop/HDFS & HBase?

HDFS is a distributed file system whereas ...READ MORE

Apr 26 in Big Data Hadoop by Arihar
• 160 points
9,609 views
0 votes
12 answers

What is Zookeeper? What is the purpose of Zookeeper in Hadoop Ecosystem?

Hey, Apache Zookeeper says that it is a ...READ MORE

Apr 29 in Big Data Hadoop by Gitika
• 25,340 points
4,956 views
0 votes
11 answers

How to check size of HDFS directory?

It is the same syntax. Use the ...READ MORE

Jun 6 in Big Data Hadoop by Sowmya
8,856 views
0 votes
11 answers

What is the command to start Job history server in Hadoop 2.x & how to get its UI?

mr-jobhistory-daemon. sh start historyserver READ MORE

Jul 23 in Big Data Hadoop by Lokesh Singh
5,005 views
0 votes
11 answers

What is the default Namenode port of HDFS. Is it 8020 or 9000 or 50070?

8020/9000 hadoop namenode metadata port number. or ...READ MORE

Dec 31, 2018 in Big Data Hadoop by SM
11,610 views
+10 votes
11 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

modify the glibc version.CentOS provides safe softwares ...READ MORE

Sep 10, 2018 in Big Data Hadoop by bug_seeker
• 15,350 points
12,234 views
0 votes
10 answers

Difference between single node & pseudo-distributed mode in Hadoop?

Both are the same thing but single ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Vilola
3,839 views
0 votes
10 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Aditya
14,854 views
+2 votes
10 answers

Is there any difference between “hdfs dfs” and “hadoop fs” shell commands?

Yes, there's a difference between hadoop fs and ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Kunal
10,456 views
0 votes
10 answers

What is the difference between Mongodb and Hadoop?

Apart from the similarity that they are ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Deeraj
2,530 views
0 votes
9 answers

Is there any way to check which Hadoop daemons are running?

use jps command, It will show all the running ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Rakesh
• 160 points
8,077 views
0 votes
7 answers

How to run a jar file in hadoop?

I used this command to run my ...READ MORE

Dec 10, 2018 in Big Data Hadoop by Dasinto
5,432 views
0 votes
5 answers

Hadoop hdfs: list all files in a directory and its subdirectories

Hi, You can try this command: hadoop fs -ls ...READ MORE

Aug 1 in Big Data Hadoop by Dinish
1,901 views
+2 votes
5 answers

Not able to start hadoop dfs

You can re-install openssh-client and openssh-server: $ sudo ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Jino
266 views
+2 votes
5 answers

How to transpose/pivot data in hive?

Below is also a way for Pivot SELECT ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rahul
5,265 views
+3 votes
5 answers

Hadoop DistributedCache is deprecated - what is the preferred API?

I had the same problem. And not ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rohan
315 views
0 votes
5 answers

What is the HDFS command to list all the files in HDFS according to the timestamp?

You can try filter using value in ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Lenny
9,681 views
+2 votes
4 answers

Datanode process not running in Hadoop

Run the following commands: Stop-all.sh start-dfs.sh start-yarn.sh mr-jobhistory-daemon.sh ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Anand
295 views
0 votes
3 answers

How to change the delimiter in Sqoop?

--fields-terminated-by <char> READ MORE

Jun 25 in Big Data Hadoop by anonymous
1,582 views
0 votes
3 answers

Spark Scala: How to list all folders in directory

val spark = SparkSession.builder().appName("Demo").getOrCreate() val path = new ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Mark
2,097 views
0 votes
3 answers

Hadoop Spark: How to iterate hdfs directories?

import org.apache.hadoop.fs.{FileSystem,Path} FileSystem.get( sc.hadoopConfiguration ).listStatus( new Path("hdfs:///tmp")).foreach( ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Komal
2,244 views
+1 vote
3 answers

HIVE: java.net.URISyntaxException

Change in hfs-site.xml this properties <name>hive.exec.scratchdir</name> <value>/tmp/hive-${user.name}</value> <name>hive.exec.local.scratchdir</name> <value>/tmp/${user.name}</value> <name>hive.downloaded.resources.dir</name> <value>/tmp/${user.name}_resources</value> <name>hive.scratch.dir.permission</name> ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Roshan
155 views
0 votes
3 answers

How to specify KeyValueTextInputFormat Separator in Hadoop-.20 api?

conf.set("key.value.separator.in.input.line", ","); Job job = new J ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Rio
185 views
+4 votes
3 answers

Unable to find file error- while Streaming Hadoop

Is python installed running on the slaves that ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Vinith
294 views
+1 vote
3 answers

when i tried to run the hdfs namenode -format command...its failed to run..can anyone help me with this???

Hi Suriyaprakash, I guess the path for hadoop ...READ MORE

Jul 23, 2018 in Big Data Hadoop by avi_man_utd
681 views
0 votes
3 answers

How to connect Spark to a remote Hive server?

JDBC is not required here. Create a hive ...READ MORE

Mar 8 in Big Data Hadoop by Vijay Dixon
• 180 points
1,395 views
0 votes
3 answers

Cloudera Hadoop - Daemons not running

Please run below mentioned command. It will ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Priyaj
• 56,900 points
611 views
0 votes
3 answers

Can we run Spark without using Hadoop?

No, you can run spark without hadoop. ...READ MORE

May 7 in Big Data Hadoop by pradeep
178 views
0 votes
3 answers

What are differences between NameNode and Secondary NameNode?

File metadata information is stored by Namenode ...READ MORE

Apr 7 in Big Data Hadoop by anonymous
1,951 views
0 votes
3 answers

What is Hive? Is Hive a database?

Hive is a data Warehouse infrastructure/system built ...READ MORE

Jul 1 in Big Data Hadoop by Ved Gupta
6,328 views
0 votes
2 answers

How to find the database daily refresh time / sync up time

I use this code to get the ...READ MORE

Sep 17 in Big Data Hadoop by Raman
45 views
0 votes
2 answers

How to use scoop in a Java Program

There is a trick which worked out ...READ MORE

Sep 4 in Big Data Hadoop by ravikiran
• 4,560 points
68 views
+1 vote
2 answers

Error: com/eng/mr/WordCountDriver : Unsupported major.minor version 52.0

The reason why you get this error ...READ MORE

Aug 6 in Big Data Hadoop by Venkita
• 240 points
29 views
+1 vote
2 answers

Hadoop: Error: Exception in thread “main” java.lang.UnsupportedClassVersionError: a

The reason for this error is because ...READ MORE

Aug 6 in Big Data Hadoop by Venkita
• 240 points
76 views
+1 vote
2 answers

Hadoop Administration

Make the following changes to your configuration ...READ MORE

Aug 5 in Big Data Hadoop by Simran
49 views
0 votes
2 answers

Namenode is not getting started

Hi, You can do one thing, first delete all ...READ MORE

Aug 5 in Big Data Hadoop by Namisha
37 views
0 votes
2 answers

Error in running hdfs commands

Hey, You can check this command also  hadoop fs ...READ MORE

Aug 5 in Big Data Hadoop by Rashi
21 views
0 votes
2 answers

Exception in thread "main" java.lang.UnsupportedClassVersionError

Hi, keep in mind do not forget to ...READ MORE

Aug 5 in Big Data Hadoop by Rashi
52 views
0 votes
2 answers

How to set up Map and Reduce Tasks?

Hi, The number of map tasks for a ...READ MORE

Aug 5 in Big Data Hadoop by Rashi
57 views
0 votes
2 answers

What is the relationship between Hadoop and Database?

Hadoop software framework work is very well ...READ MORE

Aug 6 in Big Data Hadoop by Dinesh
98 views
0 votes
2 answers

E0901: Namenode [localhost:8020] not allowed, not in Oozies whitelist

You can add this below property in oozie-site.xml: <property> <name>oozie.service.HadoopAccessorService.jobTracker.whitelist</name> <value>myaddress:8020</value> </property> Hope ...READ MORE

Aug 6 in Big Data Hadoop by Shiva
50 views
0 votes
2 answers

What is ElasticSearch Hadoop?

it as a connector that allows data to flow bi-directionaly so ...READ MORE

Aug 6 in Big Data Hadoop by Dinish
53 views
0 votes
2 answers

Explain to me the difference between Name Node and Secondary Name Node

Secondary namenode is just a helper for ...READ MORE

Aug 6 in Big Data Hadoop by Dhiman
58 views
0 votes
2 answers

if HDFS threshold has been reached. What is the our approach to resolve this issue?

This was a fundamental issue in HDFS ...READ MORE

Jun 24 in Big Data Hadoop by Gitika
• 25,340 points
46 views
0 votes
2 answers

Error While Running Oozie Project

You need to add your current user ...READ MORE

Aug 6 in Big Data Hadoop by Dhimanshu
35 views
0 votes
2 answers

Why we require SSH during hadoop installation?

Hey, SSH setup is required to do different ...READ MORE

Jun 11 in Big Data Hadoop by Gitika
• 25,340 points

edited Jun 11 by Gitika 103 views
0 votes
2 answers

How to pass a password to Sqoop import command?

You can directly pass the password in ...READ MORE

May 15 in Big Data Hadoop by Raj
294 views
0 votes
2 answers

What is the difference between Oozie and Nifi ?

The main difference between Oozie and Nifi ...READ MORE

May 7 in Big Data Hadoop by Omkar
• 67,620 points
426 views
0 votes
2 answers

Error:- cannot locate pig-core-hr. jar. do ‘ant -Dhadoopversion=23 jar’

Even I got the same error, I ...READ MORE

Apr 26 in Big Data Hadoop by disha

edited Apr 29 by Gitika 53 views