Most viewed questions in Big Data Hadoop

0 votes
1 answer

Error while starting the daemon process in windows 10

Hi@Arun, By default, the parameter "dfs.datanode.failed.volumes.tolerated" is set ...READ MORE

Apr 20, 2020 in Big Data Hadoop by MD
 • 95,460 points • 8,411 views
0 votes
1 answer

can't find start-all.sh in hadoop installation

Actually, you are not mentioning the path for ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 8,344 views
0 votes
1 answer

Change the owner and group of a file in Hadoop.

Hi@akhtar, You can use the Chown command. This ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
 • 95,460 points • 8,329 views
0 votes
1 answer

How to view contents of file in hadoop hdfs?

Hi@akhtar, You can use the Hadoop filesystem command ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
 • 95,460 points • 8,298 views
0 votes
1 answer

How to append files from local system to HDFS?

Hi@akhtar, You can use appendToFile in your Hadoop ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
 • 95,460 points • 8,266 views
0 votes
1 answer

“no such file or directory" in case of hadoop fs -ls

The behaviour that you are seeing is ...READ MORE

May 9, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points
edited May 9, 2018 by nitinrawat895 • 8,265 views
0 votes
1 answer

How does Avro schema evolution work?

If you have one avro file and ...READ MORE

Sep 19, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 8,250 views
0 votes
1 answer

How do you handle the failure of Data node?

HDFS has Master Slave architecture in which Master ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited Apr 9, 2019 by Gitika • 8,179 views
0 votes
1 answer

What are the hardware requirements for installing Hadoop on my Laptop?

You can either install Apache Hadoop on ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 8,115 views
0 votes
1 answer

How to set variables in HIVE scripts

You need to use the special hiveconf for variable ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
 • 65,770 points • 8,051 views
0 votes
1 answer

How to set replication factor in Hadoop?

Hi@akhtar, You can find setrep command in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
 • 95,460 points • 7,948 views
0 votes
2 answers

Meaning of fs.defaultFS property in core-site.xml in hadoop

It allows to run dfs commands more ...READ MORE

Jan 22, 2020 in Big Data Hadoop by MD
 • 95,460 points • 7,912 views
0 votes
1 answer

org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /try.txt._COPYING_ could only be replicated to 0 nodes instead of minReplication (=1).

Hi@akhtar, This error may occur if your datanode ...READ MORE

Apr 7, 2020 in Big Data Hadoop by MD
 • 95,460 points • 7,883 views
0 votes
1 answer

Hadoop: java.lang.IllegalArgumentException: Wrong FS: expected: file:///

Try this: Configuration configuration = new Configuration(); FileSystem fs ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 7,883 views
0 votes
2 answers

Limit the maximum number of dynamic partitions in Hive

if you are already on hive shell ...READ MORE

Jul 23, 2020 in Big Data Hadoop by Shantanu
 • 190 points • 7,878 views
0 votes
1 answer

What is the difference between Writable & WritableComparable in Hadoop?

Writable in an interface in Hadoop and types ...READ MORE

Oct 3, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 7,853 views
+1 vote
0 answers

Job failed as tasks failed. failedMaps

Hello All, I am new to hadoop, i ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Hemanth
 • 250 points
edited Aug 1, 2019 by Omkar • 7,801 views
0 votes
1 answer

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

 Try using the below build.sbt, code.scala and command ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Kishan
 • 7,742 views
0 votes
1 answer

Not able to find HDFS directory on my system?

I guess you didn't understand it correctly dfs.datanode.data.dir, ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 7,713 views
+1 vote
1 answer

Sqoop: How to load all tables except one?

You can use the import-all-tables option and along with ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 7,651 views
+2 votes
1 answer

how to escape delimiter in hive?

Refer to the below code used to ...READ MORE

Oct 31, 2019 in Big Data Hadoop by Kiran
 • 7,638 views
0 votes
3 answers

Sqoop: java.lang.RuntimeException: Could not load db driver class: com.mysql.jdbc.Driver

I add mysql driver for sqoop and it ...READ MORE

Mar 1, 2020 in Big Data Hadoop by Manh Quang
 • 180 points • 7,587 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Error parsing arguments

There are two mistakes in the command ...READ MORE

Aug 2, 2019 in Big Data Hadoop by Kunal
 • 7,581 views
0 votes
1 answer

Hadoop Java: org.apache.hadoop.conf.Configuration does not exist error

To solve this error, add hadoop-common to ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 7,575 views
0 votes
1 answer

Hive: Assign subquery to variable

Refer to this example: Step1: Check table test1 ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Tina
 • 7,544 views
0 votes
1 answer

How to programmatically access hadoop cluster where kerberos is enable?

Okay,here's the code snippet to work in the ...READ MORE

Mar 27, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 7,434 views
0 votes
1 answer

What is the purpose of shuffling and sorting phase in the reducer in Map Reduce?

Hi@akhtar, Shuffle phase in Hadoop transfers the map output from ...READ MORE

Dec 20, 2020 in Big Data Hadoop by MD
 • 95,460 points • 7,422 views
0 votes
1 answer

Converting CSV files to Parquet

--Create Hive external Table for existing data CREATE ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Yogi
 • 7,421 views
0 votes
1 answer

Where can I find hadoop-streaming.jar JAR file?

You will find the streaming jar here: ...READ MORE

Mar 21, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 7,370 views
0 votes
1 answer

How to move data from Oracle database to Hadoop?

Yes, you heard it correctly. Apache Sqoop is ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 7,340 views
0 votes
2 answers

How to pass a password to Sqoop import command?

You can directly pass the password in ...READ MORE

May 15, 2019 in Big Data Hadoop by Raj
 • 7,219 views
0 votes
1 answer

After installing Hadoop on Windows7, NameNode failed to start

You need to install Hadoop winutils to ...READ MORE

May 3, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 7,197 views
0 votes
1 answer

What is "java.sql.SQLException: org.apache.thrift.transport.TTransportException" in Hive?

This particular exception is related to Hive logs. ...READ MORE

Jul 30, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 7,176 views
+1 vote
1 answer

Hadoop home path?

you can manually input the hadoop home ...READ MORE

Mar 26, 2018 in Big Data Hadoop by Ashish
 • 2,650 points • 7,158 views
0 votes
1 answer

SyntaxException: line 1:67 no viable alternative at input ',' (... University with replication={'class':[SimpleStrategy],...)

Hi@akhtar, It is showing syntax error in your ...READ MORE

Apr 1, 2020 in Big Data Hadoop by MD
 • 95,460 points • 7,116 views
0 votes
1 answer

What is the command to check the number of cores in Spark?

Go to your Spark Web UI & ...READ MORE

May 17, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 7,057 views
0 votes
1 answer

Hadoop: "Caused by: java.lang.ClassNotFoundException" error

Have you placed the jar files in ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 7,053 views
0 votes
1 answer

What is hadoop.tmp.dir ?

hadoop.tmp.dir is used as the base for temporary ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 7,011 views
0 votes
1 answer

If there are two joins in hive, how many mapreduce jobs will run?

There are two conditions for no. of ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 6,936 views
0 votes
1 answer

Spark - load CSV file as DataFrame?

spark-csv is part of core Spark functionality ...READ MORE

Sep 25, 2018 in Big Data Hadoop by slayer
 • 29,370 points • 6,866 views
0 votes
1 answer

Cant connec to zookeeper: KeeperErrorCode = ConnectionLoss for HBase

Mostly HMaster is not running. Enter the ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 6,864 views
0 votes
1 answer

Error: Container is running beyond Memory Limits

I had a similar problem while I was working ...READ MORE

Jun 20, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 6,847 views
0 votes
2 answers

What is a container in YARN?

Yarn container are a process space where ...READ MORE

May 2, 2020 in Big Data Hadoop by anonymous
 • 6,816 views
0 votes
1 answer

What's the difference between Hadoop and NoSQL ?

Let's start with the definitions Hadoop is an ...READ MORE

Apr 2, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 6,766 views
0 votes
1 answer

What is thrift in Hive?

Hey, Thrift comes in the architectural part of ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 6,753 views
+1 vote
2 answers

How to delete and update a record in Hive?

Hi, Earlier, there was no operation supported for ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 6,736 views
+2 votes
1 answer

Hadoop: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved org.apache.hadoop.io.LongWritable

Add these 2 lines in your code ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 6,606 views
0 votes
1 answer

How do I include all the Hadoop dependencies using Maven?

This is a dependency mismatch error. I ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 6,560 views
–1 vote
1 answer

Why is Hive not good for OLTP?

Apache Hive is mainly used for batch processing i.e. ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 6,543 views
0 votes
1 answer

How setrep command is used and what is the description to this?

Hi, This HDFS command is used to change ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 6,528 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.