Most answered questions in Big Data Hadoop

0 votes
13 answers

What is the difference between Hadoop/HDFS & HBase?

HDFS is a distributed file system whereas ...READ MORE

Apr 26 in Big Data Hadoop by Arihar
• 160 points
11,616 views
0 votes
12 answers

What is Zookeeper? What is the purpose of Zookeeper in Hadoop Ecosystem?

Hey, Apache Zookeeper says that it is a ...READ MORE

Apr 29 in Big Data Hadoop by Gitika
• 25,420 points
6,241 views
0 votes
11 answers

How to check size of HDFS directory?

It is the same syntax. Use the ...READ MORE

Jun 6 in Big Data Hadoop by Sowmya
10,393 views
0 votes
11 answers

What is the command to start Job history server in Hadoop 2.x & how to get its UI?

mr-jobhistory-daemon. sh start historyserver READ MORE

Jul 23 in Big Data Hadoop by Lokesh Singh
5,645 views
0 votes
11 answers

What is the default Namenode port of HDFS. Is it 8020 or 9000 or 50070?

8020/9000 hadoop namenode metadata port number. or ...READ MORE

Dec 31, 2018 in Big Data Hadoop by SM
14,350 views
+10 votes
11 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

modify the glibc version.CentOS provides safe softwares ...READ MORE

Sep 10, 2018 in Big Data Hadoop by bug_seeker
• 15,360 points
14,296 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Aditya
17,940 views
0 votes
10 answers

Difference between single node & pseudo-distributed mode in Hadoop?

Both are the same thing but single ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Vilola
4,780 views
+2 votes
10 answers

Is there any difference between “hdfs dfs” and “hadoop fs” shell commands?

Yes, there's a difference between hadoop fs and ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Kunal
11,494 views
0 votes
10 answers

What is the difference between Mongodb and Hadoop?

Apart from the similarity that they are ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Deeraj
2,818 views
0 votes
9 answers

Is there any way to check which Hadoop daemons are running?

use jps command, It will show all the running ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Rakesh
• 160 points
9,712 views
0 votes
7 answers

How to run a jar file in hadoop?

I used this command to run my ...READ MORE

Dec 10, 2018 in Big Data Hadoop by Dasinto
6,462 views
0 votes
5 answers

Hadoop hdfs: list all files in a directory and its subdirectories

Hi, You can try this command: hadoop fs -ls ...READ MORE

Aug 1 in Big Data Hadoop by Dinish
2,306 views
+2 votes
5 answers

Not able to start hadoop dfs

You can re-install openssh-client and openssh-server: $ sudo ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Jino
320 views
+2 votes
5 answers

How to transpose/pivot data in hive?

Below is also a way for Pivot SELECT ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rahul
6,209 views
+3 votes
5 answers

Hadoop DistributedCache is deprecated - what is the preferred API?

I had the same problem. And not ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rohan
350 views
0 votes
5 answers

What is the HDFS command to list all the files in HDFS according to the timestamp?

You can try filter using value in ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Lenny
11,590 views
+2 votes
4 answers

Datanode process not running in Hadoop

Run the following commands: Stop-all.sh start-dfs.sh start-yarn.sh mr-jobhistory-daemon.sh ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Anand
543 views
0 votes
3 answers

How to change the delimiter in Sqoop?

--fields-terminated-by <char> READ MORE

Jun 25 in Big Data Hadoop by anonymous
2,027 views
0 votes
3 answers

Spark Scala: How to list all folders in directory

val spark = SparkSession.builder().appName("Demo").getOrCreate() val path = new ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Mark
2,638 views
0 votes
3 answers

Hadoop Spark: How to iterate hdfs directories?

import org.apache.hadoop.fs.{FileSystem,Path} FileSystem.get( sc.hadoopConfiguration ).listStatus( new Path("hdfs:///tmp")).foreach( ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Komal
3,254 views
+1 vote
3 answers

HIVE: java.net.URISyntaxException

Change in hfs-site.xml this properties <name>hive.exec.scratchdir</name> <value>/tmp/hive-${user.name}</value> <name>hive.exec.local.scratchdir</name> <value>/tmp/${user.name}</value> <name>hive.downloaded.resources.dir</name> <value>/tmp/${user.name}_resources</value> <name>hive.scratch.dir.permission</name> ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Roshan
212 views
0 votes
3 answers

How to specify KeyValueTextInputFormat Separator in Hadoop-.20 api?

conf.set("key.value.separator.in.input.line", ","); Job job = new J ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Rio
238 views
+4 votes
3 answers

Unable to find file error- while Streaming Hadoop

Is python installed running on the slaves that ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Vinith
364 views
+1 vote
3 answers

when i tried to run the hdfs namenode -format command...its failed to run..can anyone help me with this???

Hi Suriyaprakash, I guess the path for hadoop ...READ MORE

Jul 23, 2018 in Big Data Hadoop by avi_man_utd
927 views
0 votes
3 answers

How to connect Spark to a remote Hive server?

JDBC is not required here. Create a hive ...READ MORE

Mar 8 in Big Data Hadoop by Vijay Dixon
• 190 points
1,615 views
0 votes
3 answers

Cloudera Hadoop - Daemons not running

Please run below mentioned command. It will ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Priyaj
• 56,960 points
670 views
0 votes
3 answers

Can we run Spark without using Hadoop?

No, you can run spark without hadoop. ...READ MORE

May 7 in Big Data Hadoop by pradeep
223 views
0 votes
3 answers

What are differences between NameNode and Secondary NameNode?

File metadata information is stored by Namenode ...READ MORE

Apr 7 in Big Data Hadoop by anonymous
2,441 views
0 votes
3 answers

What is Hive? Is Hive a database?

Hive is a data Warehouse infrastructure/system built ...READ MORE

Jul 1 in Big Data Hadoop by Ved Gupta
7,465 views
+1 vote
2 answers

Unable to create external table on HIVE

Hi @Ozer, This error occurred because there is ...READ MORE

Nov 6 in Big Data Hadoop by Richa
169 views
+1 vote
2 answers

How to find the database daily refresh time / sync up time

I use this code to get the ...READ MORE

Sep 17 in Big Data Hadoop by Raman
75 views
0 votes
2 answers

How to use scoop in a Java Program

There is a trick which worked out ...READ MORE

Sep 4 in Big Data Hadoop by ravikiran
• 4,580 points
92 views
+1 vote
2 answers

Error: com/eng/mr/WordCountDriver : Unsupported major.minor version 52.0

The reason why you get this error ...READ MORE

Aug 6 in Big Data Hadoop by Venkita
• 240 points
45 views
+1 vote
2 answers

Hadoop: Error: Exception in thread “main” java.lang.UnsupportedClassVersionError: a

The reason for this error is because ...READ MORE

Aug 6 in Big Data Hadoop by Venkita
• 240 points
123 views
+1 vote
2 answers

Hadoop Administration

Make the following changes to your configuration ...READ MORE

Aug 5 in Big Data Hadoop by Simran
55 views
0 votes
2 answers

Namenode is not getting started

Hi, You can do one thing, first delete all ...READ MORE

Aug 5 in Big Data Hadoop by Namisha
53 views
0 votes
2 answers

Error in running hdfs commands

Hey, You can check this command also  hadoop fs ...READ MORE

Aug 5 in Big Data Hadoop by Rashi
35 views
0 votes
2 answers

Exception in thread "main" java.lang.UnsupportedClassVersionError

Hi, keep in mind do not forget to ...READ MORE

Aug 5 in Big Data Hadoop by Rashi
81 views
0 votes
2 answers

How to set up Map and Reduce Tasks?

Hi, The number of map tasks for a ...READ MORE

Aug 5 in Big Data Hadoop by Rashi
97 views
0 votes
2 answers

What is the relationship between Hadoop and Database?

Hadoop software framework work is very well ...READ MORE

Aug 6 in Big Data Hadoop by Dinesh
112 views
0 votes
2 answers

E0901: Namenode [localhost:8020] not allowed, not in Oozies whitelist

You can add this below property in oozie-site.xml: <property> <name>oozie.service.HadoopAccessorService.jobTracker.whitelist</name> <value>myaddress:8020</value> </property> Hope ...READ MORE

Aug 6 in Big Data Hadoop by Shiva
92 views
0 votes
2 answers

What is ElasticSearch Hadoop?

it as a connector that allows data to flow bi-directionaly so ...READ MORE

Aug 6 in Big Data Hadoop by Dinish
73 views
0 votes
2 answers

Explain to me the difference between Name Node and Secondary Name Node

Secondary namenode is just a helper for ...READ MORE

Aug 6 in Big Data Hadoop by Dhiman
90 views
0 votes
2 answers

if HDFS threshold has been reached. What is the our approach to resolve this issue?

This was a fundamental issue in HDFS ...READ MORE

Jun 24 in Big Data Hadoop by Gitika
• 25,420 points
73 views
0 votes
2 answers

Error While Running Oozie Project

You need to add your current user ...READ MORE

Aug 6 in Big Data Hadoop by Dhimanshu
49 views
0 votes
2 answers

Why we require SSH during hadoop installation?

Hey, SSH setup is required to do different ...READ MORE

Jun 11 in Big Data Hadoop by Gitika
• 25,420 points

edited Jun 11 by Gitika 170 views
0 votes
2 answers

How to pass a password to Sqoop import command?

You can directly pass the password in ...READ MORE

May 15 in Big Data Hadoop by Raj
427 views
0 votes
2 answers

What is the difference between Oozie and Nifi ?

The main difference between Oozie and Nifi ...READ MORE

May 7 in Big Data Hadoop by Omkar
• 68,180 points
649 views