Most viewed questions in Big Data Hadoop

0 votes
1 answer

What are the hardware requirements for installing Hadoop on my Laptop?

You can either install Apache Hadoop on ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 7,317 views
0 votes
1 answer

Change the owner and group of a file in Hadoop.

Hi@akhtar, You can use the Chown command. This ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
 • 95,440 points • 7,222 views
0 votes
2 answers

How to know Hive and Hadoop versions from command prompt?

Hi, Hadoop and hive have their individual commands. ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
 • 38,230 points • 7,185 views
0 votes
1 answer

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

 Try using the below build.sbt, code.scala and command ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Kishan
 • 7,122 views
0 votes
1 answer

Hadoop: java.lang.IllegalArgumentException: Wrong FS: expected: file:///

Try this: Configuration configuration = new Configuration(); FileSystem fs ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 7,095 views
0 votes
1 answer

can't find start-all.sh in hadoop installation

Actually, you are not mentioning the path for ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 7,053 views
0 votes
2 answers

How do I output the results of a HiveQL query to CSV?

Hi, The insert overwrite directory is running in ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
 • 38,230 points • 7,040 views
0 votes
2 answers

Limit the maximum number of dynamic partitions in Hive

if you are already on hive shell ...READ MORE

Jul 23, 2020 in Big Data Hadoop by Shantanu
 • 190 points • 7,006 views
0 votes
1 answer

How to view contents of file in hadoop hdfs?

Hi@akhtar, You can use the Hadoop filesystem command ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
 • 95,440 points • 6,960 views
+2 votes
1 answer

how to escape delimiter in hive?

Refer to the below code used to ...READ MORE

Oct 31, 2019 in Big Data Hadoop by Kiran
 • 6,941 views
0 votes
1 answer

What is the difference between Writable & WritableComparable in Hadoop?

Writable in an interface in Hadoop and types ...READ MORE

Oct 3, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 6,894 views
0 votes
1 answer

How to programmatically access hadoop cluster where kerberos is enable?

Okay,here's the code snippet to work in the ...READ MORE

Mar 27, 2018 in Big Data Hadoop by coldcode
 • 2,080 points • 6,857 views
0 votes
1 answer

Not able to find HDFS directory on my system?

I guess you didn't understand it correctly dfs.datanode.data.dir, ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 6,853 views
0 votes
1 answer

org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /try.txt._COPYING_ could only be replicated to 0 nodes instead of minReplication (=1).

Hi@akhtar, This error may occur if your datanode ...READ MORE

Apr 7, 2020 in Big Data Hadoop by MD
 • 95,440 points • 6,851 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Error parsing arguments

There are two mistakes in the command ...READ MORE

Aug 2, 2019 in Big Data Hadoop by Kunal
 • 6,792 views
0 votes
2 answers

Meaning of fs.defaultFS property in core-site.xml in hadoop

It allows to run dfs commands more ...READ MORE

Jan 22, 2020 in Big Data Hadoop by MD
 • 95,440 points • 6,788 views
0 votes
1 answer

Hive: Assign subquery to variable

Refer to this example: Step1: Check table test1 ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Tina
 • 6,772 views
0 votes
1 answer

How to set replication factor in Hadoop?

Hi@akhtar, You can find setrep command in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
 • 95,440 points • 6,757 views
0 votes
1 answer

Hadoop Java: org.apache.hadoop.conf.Configuration does not exist error

To solve this error, add hadoop-common to ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 6,748 views
0 votes
1 answer

Converting CSV files to Parquet

--Create Hive external Table for existing data CREATE ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Yogi
 • 6,730 views
+1 vote
1 answer

Sqoop: How to load all tables except one?

You can use the import-all-tables option and along with ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 6,708 views
0 votes
1 answer

How to move data from Oracle database to Hadoop?

Yes, you heard it correctly. Apache Sqoop is ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 6,673 views
0 votes
1 answer

How to append files from local system to HDFS?

Hi@akhtar, You can use appendToFile in your Hadoop ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
 • 95,440 points • 6,621 views
+1 vote
0 answers

Job failed as tasks failed. failedMaps

Hello All, I am new to hadoop, i ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Hemanth
 • 250 points
edited Aug 1, 2019 by Omkar • 6,609 views
0 votes
3 answers

Sqoop: java.lang.RuntimeException: Could not load db driver class: com.mysql.jdbc.Driver

I add mysql driver for sqoop and it ...READ MORE

Mar 1, 2020 in Big Data Hadoop by Manh Quang
 • 180 points • 6,541 views
+1 vote
1 answer

Hadoop home path?

you can manually input the hadoop home ...READ MORE

Mar 26, 2018 in Big Data Hadoop by Ashish
 • 2,650 points • 6,522 views
0 votes
1 answer

After installing Hadoop on Windows7, NameNode failed to start

You need to install Hadoop winutils to ...READ MORE

May 3, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 6,507 views
0 votes
1 answer

Spark - load CSV file as DataFrame?

spark-csv is part of core Spark functionality ...READ MORE

Sep 25, 2018 in Big Data Hadoop by slayer
 • 29,350 points • 6,505 views
0 votes
1 answer

If there are two joins in hive, how many mapreduce jobs will run?

There are two conditions for no. of ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 6,439 views
0 votes
1 answer

How to set variables in HIVE scripts

You need to use the special hiveconf for variable ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
 • 65,930 points • 6,408 views
0 votes
1 answer

Hadoop: "Caused by: java.lang.ClassNotFoundException" error

Have you placed the jar files in ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 6,387 views
0 votes
1 answer

What is "java.sql.SQLException: org.apache.thrift.transport.TTransportException" in Hive?

This particular exception is related to Hive logs. ...READ MORE

Jul 30, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 6,375 views
0 votes
2 answers

How to pass a password to Sqoop import command?

You can directly pass the password in ...READ MORE

May 15, 2019 in Big Data Hadoop by Raj
 • 6,356 views
0 votes
1 answer

Error: Container is running beyond Memory Limits

I had a similar problem while I was working ...READ MORE

Jun 20, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 6,348 views
0 votes
1 answer

How do you handle the failure of Data node?

HDFS has Master Slave architecture in which Master ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
 • 65,930 points
edited Apr 9, 2019 by Gitika • 6,266 views
0 votes
1 answer

Where can I find hadoop-streaming.jar JAR file?

You will find the streaming jar here: ...READ MORE

Mar 21, 2018 in Big Data Hadoop by coldcode
 • 2,080 points • 6,218 views
0 votes
1 answer

What is the command to check the number of cores in Spark?

Go to your Spark Web UI & ...READ MORE

May 17, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 6,206 views
0 votes
1 answer

SyntaxException: line 1:67 no viable alternative at input ',' (... University with replication={'class':[SimpleStrategy],...)

Hi@akhtar, It is showing syntax error in your ...READ MORE

Apr 1, 2020 in Big Data Hadoop by MD
 • 95,440 points • 6,109 views
0 votes
2 answers

What is a container in YARN?

Yarn container are a process space where ...READ MORE

May 2, 2020 in Big Data Hadoop by anonymous
 • 6,080 views
0 votes
1 answer

Cant connec to zookeeper: KeeperErrorCode = ConnectionLoss for HBase

Mostly HMaster is not running. Enter the ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,987 views
0 votes
1 answer

What is hadoop.tmp.dir ?

hadoop.tmp.dir is used as the base for temporary ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 5,972 views
0 votes
1 answer

What is the purpose of shuffling and sorting phase in the reducer in Map Reduce?

Hi@akhtar, Shuffle phase in Hadoop transfers the map output from ...READ MORE

Dec 20, 2020 in Big Data Hadoop by MD
 • 95,440 points • 5,947 views
0 votes
1 answer

What is thrift in Hive?

Hey, Thrift comes in the architectural part of ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 5,873 views
0 votes
2 answers

Installing HBase on windows

This procedure worked for me. https://medium.com/@bishupaulose/install ...READ MORE

Aug 16, 2019 in Big Data Hadoop by Sam
 • 5,856 views
0 votes
1 answer

How Namenode handles data node failures?

Let me explain you the whole scenario. NameNode ...READ MORE

Jul 11, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 5,850 views
+2 votes
1 answer

Hadoop: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved org.apache.hadoop.io.LongWritable

Add these 2 lines in your code ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,751 views
0 votes
1 answer

Unable to move Hadoop Hive tables from Source to Destination.

First, check the permissions of HDFS Directory ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,741 views
0 votes
1 answer

How do I include all the Hadoop dependencies using Maven?

This is a dependency mismatch error. I ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 5,741 views
0 votes
1 answer

Warning: Unable to load Hadoop Native Library for your platform. [closed]

 I had the same issue. It's solved ...READ MORE

Jun 28, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 5,735 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.