Most viewed questions in Big Data Hadoop

0 votes
1 answer

Command to get status of all running Oozie workflow

Hey, You can use this command to get ...READ MORE

Jun 12, 2019 in Big Data Hadoop by Gitika
• 65,910 points
5,075 views
+1 vote
1 answer

What is the process to perform an incremental data load in Sqoop?

The process to perform incremental data load ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Frankie
• 9,830 points
5,075 views
0 votes
2 answers

Why we require SSH during hadoop installation?

Hey, SSH setup is required to do different ...READ MORE

Jun 11, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Jun 11, 2019 by Gitika 5,054 views
0 votes
1 answer

How to import data to hbase database?

There are 3 Ways to Load Data ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Karan Reddy
5,048 views
0 votes
1 answer

What is the difference between Map-side join and Reduce-side join?

Join is a clause that combines the records ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,046 views
0 votes
1 answer

Hadoop: Error: Could not find or load main class com.sun.tools.javac.Main

It looks like the path is not ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,998 views
+1 vote
1 answer

which version of sqoop i install for hadoop3.1.1 ?

Hi @lucky! The latest version of Sqoop available ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
4,972 views
0 votes
1 answer

Hadoop Hive: How to convert multiple rows into comma separated values?

You can use the aggregator function collect_set to do ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,970 views
0 votes
1 answer

Which latest Hadoop version is stable?

Try Checking this website: http://hadoop.apache.org/releases.html. Here you will ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
4,957 views
0 votes
1 answer

error: value update is not a member of scala.collection.immutable.Map[String, Int]

Yes, If you try to update the value of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,910 points
4,936 views
0 votes
1 answer

Granting SELECT privilege in Hive

You can use this command to do ...READ MORE

May 31, 2019 in Big Data Hadoop by Umar
4,932 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Unrecognized argument

The command you are executing is slightly ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Sam
4,931 views
0 votes
1 answer

What is grunt shell in pig?

Hey, Grunt shell is a shell command.The Grunts ...READ MORE

May 6, 2019 in Big Data Hadoop by Gitika
• 65,910 points
4,927 views
0 votes
1 answer

ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet!

Hi@akhtar, This error occurs if the hbase server ...READ MORE

Mar 30, 2020 in Big Data Hadoop by MD
• 95,440 points
4,914 views
0 votes
1 answer

How to show all partitions of a table in Hive?

Hi@akhtar, You can list down all the partitions ...READ MORE

Dec 18, 2020 in Big Data Hadoop by MD
• 95,440 points
4,909 views
0 votes
1 answer

How to install Zookeeper in Ubuntu?

There are two ways to install Zookeeper: You ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,210 points
4,905 views
0 votes
1 answer

Why is HDFS used for the applications with large data sets, and not for the multiple small files?

HDFS is more efficient for a large ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Neha
• 6,300 points
4,831 views
0 votes
1 answer

Hadoop Mapper is failed because of the following error - “Container killed by the ApplicationMaster”

I suggest you include below property files ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,777 views
0 votes
1 answer

Hadoop: localhost: Error: JAVA_HOME is not set.

Seems like PATH problem in hadoop-env.sh file. Try ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,758 views
0 votes
1 answer

Hive: what location should I mention while creating table?

It can be a hdfs path. The ...READ MORE

May 23, 2019 in Big Data Hadoop by Jishan
4,751 views
0 votes
1 answer

What are the different daemons in yarn?

Hi, The different Daemons in YARN are:- Resources Manager:- Runs ...READ MORE

Apr 24, 2019 in Big Data Hadoop by Gitika
• 65,910 points
4,750 views
0 votes
1 answer

How to see the content of a table in hive?

Hello, If you want to see the content ...READ MORE

May 15, 2019 in Big Data Hadoop by Gitika
• 65,910 points
4,708 views
0 votes
1 answer

What are the different ways of Installing Hadoop into our local machine?

Hadoop runs on Unix and on Windows. ...READ MORE

Aug 4, 2018 in Big Data Hadoop by Neha
• 6,300 points
4,692 views
0 votes
1 answer

Hadoop HDFS: Exception in createBlockOutputStream

It's a connection error. Have you turned ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,672 views
0 votes
1 answer

How to handle exceptions in Spark and Scala?

There is no particular format to handle ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
4,659 views
0 votes
1 answer

Hadoop: How to get the column name along with the output in Hive?

You can get the column names by ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,628 views
0 votes
1 answer

Why does my yarn application not have logs even with logging enabled?

yarn application -list command shows you all ...READ MORE

Mar 19, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,600 views
+1 vote
3 answers

HIVE: java.net.URISyntaxException

Change in hfs-site.xml this properties <name>hive.exec.scratchdir</name> <value>/tmp/hive-${user.name}</value> <name>hive.exec.local.scratchdir</name> <value>/tmp/${user.name}</value> <name>hive.downloaded.resources.dir</name> <value>/tmp/${user.name}_resources</value> <name>hive.scratch.dir.permission</name> ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Roshan
4,579 views
0 votes
1 answer

Is there any way to increase Java Heap size in Hadoop?

You can add some more memory by ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
4,572 views
0 votes
1 answer

How to create a Hive table from sequence file stored in HDFS?

There are two SerDe for SequenceFile as ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,559 views
0 votes
1 answer

Regarding unstructured data handling in hadoop

There are multiple ways to import unstructured ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Jishan
4,490 views
+1 vote
1 answer

How to read HDFS and local files with the same code in Java?

You can try something like this: ​ ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,489 views
0 votes
1 answer

Why do we use job.waitForCompletion(true)?

The main reason for job.waitForCompletion exists is ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Josh
4,475 views
+1 vote
1 answer

How to delete sqoop job?

$ ​sqoop job --delete jobname But be careful ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,210 points
4,380 views
0 votes
1 answer

Hadoop Spark Derby: Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database

As mentioned in the error, there's another ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,349 views
0 votes
1 answer

Sqoop incremental append by date

Consider a table with 3 records which ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,210 points
4,318 views
0 votes
1 answer

What happens when a datanode that is dead becomes active again?

When NameNode notices that it has not ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Rishi
4,315 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,307 views
0 votes
1 answer

Sqoop - moving data from DB2 to HDFS ( hive partition table)

sqoop import --driver com.ibm.db2.jcc.DB2Driver --connect jdbc:db2://db2.my.com:50000/databaseName --username ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Payal
4,299 views
0 votes
1 answer

How can create the dynamic partition table with data in Hive?

Hi, We can see some steps to do ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Gitika
• 65,910 points
4,296 views
0 votes
1 answer

How can I put file to HDFS directly without copying it local disk?

Can use pipe from wget to hdfs. You ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,261 views
+1 vote
1 answer

Namenode v/s Secondary namenode

Name Node is a primary node in ...READ MORE

Sep 9, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
4,259 views
0 votes
1 answer

How to install HBase on Linux?

To install Hbase, you first need the ...READ MORE

Feb 27, 2019 in Big Data Hadoop by Tanisha
4,252 views
–1 vote
1 answer

How to uninstall and install mysql-server in centos?

Please find below the command to uninstall ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,251 views
0 votes
1 answer

Where is Hadoop Classpath?

It is set in hadoop-config.sh. You can add ...READ MORE

Apr 2, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,238 views
0 votes
1 answer

How to get absolute path of files in a directory in Hadoop?

You can use HDFS API like the ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Frankie
• 9,830 points
4,236 views
+1 vote
1 answer

" org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Permissions incorrectly set for dir " problem

This error is caused when hadoop tries ...READ MORE

Sep 9, 2019 in Big Data Hadoop by Kumar
4,216 views
0 votes
1 answer

How to create znode in zookeeper?

Hey, Create a znode with the given path. The flag argument ...READ MORE

May 28, 2019 in Big Data Hadoop by Gitika
• 65,910 points
4,212 views
+1 vote
2 answers

Unable to create external table on HIVE

Hi @Ozer, This error occurred because there is ...READ MORE

Nov 7, 2019 in Big Data Hadoop by Richa
4,200 views
0 votes
1 answer

How to decide number of mappers?

The number of mapper depends on the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,210 points
4,197 views