Most viewed questions in Big Data Hadoop

0 votes
1 answer

Unable to move Hadoop Hive tables from Source to Destination.

First, check the permissions of HDFS Directory ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,900 views
–1 vote
1 answer

Why is Hive not good for OLTP?

Apache Hive is mainly used for batch processing i.e. ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,886 views
0 votes
1 answer

Warning: Unable to load Hadoop Native Library for your platform. [closed]

 I had the same issue. It's solved ...READ MORE

Jun 28, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
5,820 views
0 votes
1 answer

Hadoop Java Error: java.lang.NoClassDefFoundError: WordCount (wrong name: org/myorg/WordCount)

Hey, try this code import java.io.IOException; import java.util.Iterator; import java.util.StringTokenizer; import ...READ MORE

Sep 19, 2018 in Big Data Hadoop by slayer
• 29,350 points
5,810 views
0 votes
1 answer

I am receiving a warning which says: Failed to locate the winutils binary in the Hadoop binary path

I see that you are facing multiple ...READ MORE

May 31, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
5,789 views
0 votes
1 answer

Multiple input for MapReduce job

We use MultipleInputs class which supports MapReduce ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Jim
5,776 views
+1 vote
1 answer

Hadoop Installation Issue on Windows

Below is the main error you are ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
5,735 views
0 votes
1 answer

Unzip files in hdfs

To unzip a gzipped (or bzipped) file, ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Joe
5,734 views
0 votes
1 answer

Why is Hive called as Data Warehouse?

Hive is a data warehouse infrastructure tool ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Joshua
5,712 views
+1 vote
2 answers

Execute Pig Script from Grunt Shell

From your current directory run  pig -x local Then ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Kunal
5,694 views
0 votes
1 answer

Hive partitioning: Dynamic and static

Partitions are created depending on the end ...READ MORE

Feb 1, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,637 views
0 votes
2 answers

Hive update and delete limitations

Vinyl-like crackle sounds. And what is my ...READ MORE

May 3, 2020 in Big Data Hadoop by Carter
• 140 points
5,604 views
0 votes
1 answer

Spark.read.csv to create RDD into Dataframe

You can use a case class and ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,564 views
0 votes
1 answer

Difference between hive.exec.compress.output=true; and mapreduce.output.fileoutputformat.compress=true;

Hey there! The definition of these two properties ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,551 views
0 votes
1 answer

SQOOP Export command failing

First create a table, which should have ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,493 views
+1 vote
2 answers

What does hadoop fs -du command gives as output?

du command is used for to see ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
5,492 views
0 votes
1 answer

How to find the number of blocks a hdfs file is divided into?

Yes. you can use the hadoop fsck command to do ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,482 views
0 votes
1 answer

Hadoop Hive: ClassNotFoundException: org.apache.hive.jdbc.HiveDriver

You have to use the right dependency <dependency> ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,470 views
0 votes
1 answer

What is SerDe in Hadoop Hive?

The SerDe interface allows you to instruct ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Akshay
5,442 views
0 votes
1 answer

Parquet to ORC format in Hive

Follow the below steps to load the ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Raj
5,432 views
0 votes
1 answer

apache.spark.sql.AnalysisException: Text data source does not support int data type.;

Hi@akhtar, I think your output is in different ...READ MORE

Feb 13, 2020 in Big Data Hadoop by MD
• 95,440 points
5,428 views
0 votes
1 answer

How to print the content of a file in console present in HDFS?

Yes, you can use hdfs dfs command ...READ MORE

Apr 19, 2018 in Big Data Hadoop by Shubham
• 13,490 points
5,380 views
–1 vote
1 answer

unable to start hive server

It seems that your hive server is ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,344 views
0 votes
1 answer

Command to see the indexes of a table in Hive?

Hey, The command you can use to see ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Jun 26, 2019 by Gitika 5,333 views
0 votes
1 answer

How to delete a file from Hadoop hdfs using java?

Try this: FileSystem fs = FileSystem.get(getConf()); fs.delete(new ...READ MORE

Nov 28, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,333 views
0 votes
1 answer

What does NameNode stores and where it stores?

NameNode records the metadata of all the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
5,327 views
0 votes
1 answer

How to clear yarn cache?

Yarn has a command by default to clear ...READ MORE

Feb 5, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,320 views
0 votes
1 answer

Hadoop: Format namenode gives error: Shutting down NameNode at java.net.UnknownHostException

UnknownHostException is thrown when hadoop tries to resolve ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,316 views
–1 vote
1 answer

Apache Spark - Nested JSON array to flatten columns

It depends on the structure of your ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,310 views
0 votes
1 answer

How setrep command is used and what is the description to this?

Hi, This HDFS command is used to change ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Gitika
• 65,910 points
5,297 views
0 votes
1 answer

How hadoop mapreduce job is submitted to worker nodes?

Alright, I think you are basically looking ...READ MORE

Mar 30, 2018 in Big Data Hadoop by Ashish
• 2,650 points
5,276 views
0 votes
1 answer

Hadoop: How to copy directory from local system to hdfs using Java code?

Just use the FileSystem's copyFromLocalFile method. If the source Path ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,273 views
+2 votes
1 answer

How to calculate Maximum salary of the employee with the name using the Map Reduce Technique

Please try the below code and it ...READ MORE

Jul 25, 2018 in Big Data Hadoop by Neha
• 6,300 points
5,271 views
0 votes
1 answer

How to download hadoop jar files for adding eclipse

Hi@Manl, To import jar file in your Eclipse ...READ MORE

Jul 20, 2020 in Big Data Hadoop by MD
• 95,440 points
5,269 views
0 votes
2 answers

Command to check the Hadoop distribution as well as it’s version which is installed in my cluster

One of the options to check the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
5,268 views
0 votes
1 answer

What is the command to navigate in HDFS?

First of all there is no command ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,490 points
5,211 views
0 votes
1 answer

How to resolve corrupted blocks in Hadoop?

You can use hdfs fsck / to ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Nandini
5,191 views
0 votes
1 answer

I get an error stating- Hadoop: «ERROR : JAVA_HOME is not set». How to resolve this?

Make sure that you have removed the ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Frankie
• 9,830 points
5,170 views
0 votes
1 answer

Hadoop Hive: recursively descending into subdirectories without partitions or editing hive-site.xml

 I set the following properties before I ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,168 views
0 votes
1 answer

Sqoop installation on Linux

Before installing Sqoop, make sure Hadoop is ...READ MORE

Feb 26, 2019 in Big Data Hadoop by Suman
5,153 views
0 votes
1 answer

Error: Execution Error, Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Permission denied:

Hey, The error you are getting because the ...READ MORE

May 15, 2019 in Big Data Hadoop by Gitika
• 65,910 points
5,145 views
0 votes
1 answer

What is the role of Job tracker Hadoop?

Job tracker's function is resource management, tracking ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
• 65,910 points
5,137 views
0 votes
1 answer

error:- /zookeeper_server.pid: Permission denied FAILED TO WRITE PID

Hey, The default zookeeper installation (tar extract) comes ...READ MORE

May 27, 2019 in Big Data Hadoop by Gitika
• 65,910 points
5,127 views
0 votes
1 answer

How to create a managed table in Hive?

You can use this command: create table employee(Name ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,123 views
0 votes
1 answer

Hbase: Client not able to connect with remote Hbase server

You have to remove the localhost entry from hbase server's ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,106 views
0 votes
1 answer

Connect to Hive using Pyhive

Here's how we can connect to Hive ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,101 views
0 votes
1 answer

How can I access S3/S3n from a local Hadoop 2.6 installation?

For some reason, the jar hadoop-aws-[version].jar which contains the ...READ MORE

Oct 3, 2018 in Big Data Hadoop by digger
• 26,740 points
5,101 views
0 votes
1 answer

Which of the following is the daemon of Hadoop?

Hadoop is an open-source software framework for ...READ MORE

Dec 10, 2021 in Big Data Hadoop by CoderGirl
• 500 points
5,083 views
0 votes
1 answer

Hive local inpath gives invalid path error

You are using the below command to ...READ MORE

May 23, 2019 in Big Data Hadoop by Jill
5,080 views
0 votes
1 answer

What is the difference between MapReduce and YARN in Hadoop?

MapReduce: MapReduce is an algorithm used to store ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,055 views