Most viewed questions in Big Data Hadoop

0 votes
1 answer

How to create a managed table in Hive?

You can use this command: create table employee(Name ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
5,177 views
+1 vote
1 answer

What is the process to perform an incremental data load in Sqoop?

The process to perform incremental data load ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Frankie
• 9,830 points
5,174 views
0 votes
1 answer

How to import data to hbase database?

There are 3 Ways to Load Data ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Karan Reddy
5,153 views
0 votes
2 answers

Why we require SSH during hadoop installation?

Hey, SSH setup is required to do different ...READ MORE

Jun 11, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Jun 11, 2019 by Gitika 5,146 views
0 votes
1 answer

What is the difference between Map-side join and Reduce-side join?

Join is a clause that combines the records ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
5,130 views
+1 vote
1 answer

which version of sqoop i install for hadoop3.1.1 ?

Hi @lucky! The latest version of Sqoop available ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,230 points
5,129 views
0 votes
1 answer

Hadoop: Error: Could not find or load main class com.sun.tools.javac.Main

It looks like the path is not ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
• 69,230 points
5,107 views
0 votes
1 answer

Hadoop Hive: How to convert multiple rows into comma separated values?

You can use the aggregator function collect_set to do ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
5,099 views
0 votes
1 answer

How to show all partitions of a table in Hive?

Hi@akhtar, You can list down all the partitions ...READ MORE

Dec 18, 2020 in Big Data Hadoop by MD
• 95,440 points
5,098 views
0 votes
1 answer

What is grunt shell in pig?

Hey, Grunt shell is a shell command.The Grunts ...READ MORE

May 6, 2019 in Big Data Hadoop by Gitika
• 65,910 points
5,096 views
0 votes
1 answer

Granting SELECT privilege in Hive

You can use this command to do ...READ MORE

May 31, 2019 in Big Data Hadoop by Umar
5,077 views
0 votes
1 answer

error: value update is not a member of scala.collection.immutable.Map[String, Int]

Yes, If you try to update the value of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,910 points
5,059 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Unrecognized argument

The command you are executing is slightly ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Sam
5,058 views
0 votes
1 answer

ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet!

Hi@akhtar, This error occurs if the hbase server ...READ MORE

Mar 30, 2020 in Big Data Hadoop by MD
• 95,440 points
5,057 views
0 votes
1 answer

Which latest Hadoop version is stable?

Try Checking this website: http://hadoop.apache.org/releases.html. Here you will ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
5,008 views
0 votes
1 answer

How to install Zookeeper in Ubuntu?

There are two ways to install Zookeeper: You ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,230 points
4,992 views
0 votes
1 answer

Why is HDFS used for the applications with large data sets, and not for the multiple small files?

HDFS is more efficient for a large ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Neha
• 6,300 points
4,936 views
0 votes
1 answer

Hadoop: localhost: Error: JAVA_HOME is not set.

Seems like PATH problem in hadoop-env.sh file. Try ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,230 points
4,900 views
0 votes
1 answer

What are the different daemons in yarn?

Hi, The different Daemons in YARN are:- Resources Manager:- Runs ...READ MORE

Apr 24, 2019 in Big Data Hadoop by Gitika
• 65,910 points
4,872 views
0 votes
1 answer

Hadoop Mapper is failed because of the following error - “Container killed by the ApplicationMaster”

I suggest you include below property files ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
• 69,230 points
4,867 views
0 votes
1 answer

What are the different ways of Installing Hadoop into our local machine?

Hadoop runs on Unix and on Windows. ...READ MORE

Aug 4, 2018 in Big Data Hadoop by Neha
• 6,300 points
4,828 views
0 votes
1 answer

How to see the content of a table in hive?

Hello, If you want to see the content ...READ MORE

May 15, 2019 in Big Data Hadoop by Gitika
• 65,910 points
4,824 views
0 votes
1 answer

Hive: what location should I mention while creating table?

It can be a hdfs path. The ...READ MORE

May 23, 2019 in Big Data Hadoop by Jishan
4,820 views
0 votes
1 answer

Hadoop HDFS: Exception in createBlockOutputStream

It's a connection error. Have you turned ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,230 points
4,767 views
+1 vote
3 answers

HIVE: java.net.URISyntaxException

Change in hfs-site.xml this properties <name>hive.exec.scratchdir</name> <value>/tmp/hive-${user.name}</value> <name>hive.exec.local.scratchdir</name> <value>/tmp/${user.name}</value> <name>hive.downloaded.resources.dir</name> <value>/tmp/${user.name}_resources</value> <name>hive.scratch.dir.permission</name> ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Roshan
4,722 views
0 votes
1 answer

Why does my yarn application not have logs even with logging enabled?

yarn application -list command shows you all ...READ MORE

Mar 19, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,721 views
0 votes
1 answer

Hadoop: How to get the column name along with the output in Hive?

You can get the column names by ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,230 points
4,711 views
0 votes
1 answer

How to handle exceptions in Spark and Scala?

There is no particular format to handle ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,230 points
4,708 views
0 votes
1 answer

Is there any way to increase Java Heap size in Hadoop?

You can add some more memory by ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
4,657 views
0 votes
1 answer

How to create a Hive table from sequence file stored in HDFS?

There are two SerDe for SequenceFile as ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,230 points
4,648 views
+1 vote
1 answer

How to read HDFS and local files with the same code in Java?

You can try something like this: ​ ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,230 points
4,580 views
0 votes
1 answer

Regarding unstructured data handling in hadoop

There are multiple ways to import unstructured ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Jishan
4,568 views
0 votes
1 answer

Why do we use job.waitForCompletion(true)?

The main reason for job.waitForCompletion exists is ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Josh
4,560 views
+1 vote
1 answer

How to delete sqoop job?

$ ​sqoop job --delete jobname But be careful ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,230 points
4,473 views
0 votes
1 answer

How to install HBase on Linux?

To install Hbase, you first need the ...READ MORE

Feb 27, 2019 in Big Data Hadoop by Tanisha
4,425 views
0 votes
1 answer

Hadoop Spark Derby: Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database

As mentioned in the error, there's another ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
• 69,230 points
4,422 views
+1 vote
1 answer

Namenode v/s Secondary namenode

Name Node is a primary node in ...READ MORE

Sep 9, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
4,405 views
0 votes
1 answer

What happens when a datanode that is dead becomes active again?

When NameNode notices that it has not ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Rishi
4,397 views
0 votes
1 answer

Sqoop incremental append by date

Consider a table with 3 records which ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,230 points
4,391 views
0 votes
1 answer

How can create the dynamic partition table with data in Hive?

Hi, We can see some steps to do ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Gitika
• 65,910 points
4,378 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,378 views
0 votes
1 answer

Sqoop - moving data from DB2 to HDFS ( hive partition table)

sqoop import --driver com.ibm.db2.jcc.DB2Driver --connect jdbc:db2://db2.my.com:50000/databaseName --username ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Payal
4,375 views
–1 vote
1 answer

How to uninstall and install mysql-server in centos?

Please find below the command to uninstall ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,230 points
4,365 views
0 votes
1 answer

How can I put file to HDFS directly without copying it local disk?

Can use pipe from wget to hdfs. You ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,341 views
+1 vote
1 answer

" org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Permissions incorrectly set for dir " problem

This error is caused when hadoop tries ...READ MORE

Sep 9, 2019 in Big Data Hadoop by Kumar
4,336 views
0 votes
1 answer

How can I change data in HDFS?

You can not modified data once stored ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Rishi
4,333 views
+1 vote
2 answers

Unable to create external table on HIVE

Hi @Ozer, This error occurred because there is ...READ MORE

Nov 7, 2019 in Big Data Hadoop by Richa
4,317 views
0 votes
1 answer

Where is Hadoop Classpath?

It is set in hadoop-config.sh. You can add ...READ MORE

Apr 2, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,315 views
0 votes
1 answer

How to create znode in zookeeper?

Hey, Create a znode with the given path. The flag argument ...READ MORE

May 28, 2019 in Big Data Hadoop by Gitika
• 65,910 points
4,308 views
0 votes
1 answer

How to decide number of mappers?

The number of mapper depends on the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,230 points
4,305 views