Most viewed questions in Big Data Hadoop

0 votes
1 answer

Unable to move Hadoop Hive tables from Source to Destination.

First, check the permissions of HDFS Directory ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,908 views
–1 vote
1 answer

Why is Hive not good for OLTP?

Apache Hive is mainly used for batch processing i.e. ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,901 views
0 votes
1 answer

Warning: Unable to load Hadoop Native Library for your platform. [closed]

 I had the same issue. It's solved ...READ MORE

Jun 28, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
5,832 views
0 votes
1 answer

Hadoop Java Error: java.lang.NoClassDefFoundError: WordCount (wrong name: org/myorg/WordCount)

Hey, try this code import java.io.IOException; import java.util.Iterator; import java.util.StringTokenizer; import ...READ MORE

Sep 19, 2018 in Big Data Hadoop by slayer
• 29,350 points
5,816 views
0 votes
1 answer

I am receiving a warning which says: Failed to locate the winutils binary in the Hadoop binary path

I see that you are facing multiple ...READ MORE

May 31, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
5,807 views
0 votes
1 answer

Multiple input for MapReduce job

We use MultipleInputs class which supports MapReduce ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Jim
5,788 views
0 votes
1 answer

Unzip files in hdfs

To unzip a gzipped (or bzipped) file, ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Joe
5,755 views
+1 vote
1 answer

Hadoop Installation Issue on Windows

Below is the main error you are ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
5,752 views
0 votes
1 answer

Why is Hive called as Data Warehouse?

Hive is a data warehouse infrastructure tool ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Joshua
5,737 views
+1 vote
2 answers

Execute Pig Script from Grunt Shell

From your current directory run  pig -x local Then ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Kunal
5,707 views
0 votes
1 answer

Hive partitioning: Dynamic and static

Partitions are created depending on the end ...READ MORE

Feb 1, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,648 views
0 votes
2 answers

Hive update and delete limitations

Vinyl-like crackle sounds. And what is my ...READ MORE

May 3, 2020 in Big Data Hadoop by Carter
• 140 points
5,620 views
0 votes
1 answer

Spark.read.csv to create RDD into Dataframe

You can use a case class and ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,571 views
0 votes
1 answer

Difference between hive.exec.compress.output=true; and mapreduce.output.fileoutputformat.compress=true;

Hey there! The definition of these two properties ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,560 views
0 votes
1 answer

SQOOP Export command failing

First create a table, which should have ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,517 views
+1 vote
2 answers

What does hadoop fs -du command gives as output?

du command is used for to see ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
5,502 views
0 votes
1 answer

How to find the number of blocks a hdfs file is divided into?

Yes. you can use the hadoop fsck command to do ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,489 views
0 votes
1 answer

Hadoop Hive: ClassNotFoundException: org.apache.hive.jdbc.HiveDriver

You have to use the right dependency <dependency> ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,483 views
0 votes
1 answer

apache.spark.sql.AnalysisException: Text data source does not support int data type.;

Hi@akhtar, I think your output is in different ...READ MORE

Feb 13, 2020 in Big Data Hadoop by MD
• 95,440 points
5,448 views
0 votes
1 answer

What is SerDe in Hadoop Hive?

The SerDe interface allows you to instruct ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Akshay
5,446 views
0 votes
1 answer

Parquet to ORC format in Hive

Follow the below steps to load the ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Raj
5,444 views
0 votes
1 answer

How to print the content of a file in console present in HDFS?

Yes, you can use hdfs dfs command ...READ MORE

Apr 19, 2018 in Big Data Hadoop by Shubham
• 13,490 points
5,391 views
–1 vote
1 answer

unable to start hive server

It seems that your hive server is ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,353 views
0 votes
1 answer

Command to see the indexes of a table in Hive?

Hey, The command you can use to see ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Jun 26, 2019 by Gitika 5,351 views
0 votes
1 answer

How to delete a file from Hadoop hdfs using java?

Try this: FileSystem fs = FileSystem.get(getConf()); fs.delete(new ...READ MORE

Nov 28, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,341 views
0 votes
1 answer

What does NameNode stores and where it stores?

NameNode records the metadata of all the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
5,335 views
0 votes
1 answer

How to clear yarn cache?

Yarn has a command by default to clear ...READ MORE

Feb 5, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,326 views
0 votes
1 answer

How setrep command is used and what is the description to this?

Hi, This HDFS command is used to change ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Gitika
• 65,910 points
5,325 views
0 votes
1 answer

Hadoop: Format namenode gives error: Shutting down NameNode at java.net.UnknownHostException

UnknownHostException is thrown when hadoop tries to resolve ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,325 views
–1 vote
1 answer

Apache Spark - Nested JSON array to flatten columns

It depends on the structure of your ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,315 views
0 votes
1 answer

How hadoop mapreduce job is submitted to worker nodes?

Alright, I think you are basically looking ...READ MORE

Mar 30, 2018 in Big Data Hadoop by Ashish
• 2,650 points
5,291 views
0 votes
1 answer

Hadoop: How to copy directory from local system to hdfs using Java code?

Just use the FileSystem's copyFromLocalFile method. If the source Path ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,289 views
0 votes
1 answer

How to download hadoop jar files for adding eclipse

Hi@Manl, To import jar file in your Eclipse ...READ MORE

Jul 20, 2020 in Big Data Hadoop by MD
• 95,440 points
5,285 views
0 votes
2 answers

Command to check the Hadoop distribution as well as it’s version which is installed in my cluster

One of the options to check the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
5,283 views
+2 votes
1 answer

How to calculate Maximum salary of the employee with the name using the Map Reduce Technique

Please try the below code and it ...READ MORE

Jul 25, 2018 in Big Data Hadoop by Neha
• 6,300 points
5,282 views
0 votes
1 answer

What is the command to navigate in HDFS?

First of all there is no command ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,490 points
5,225 views
0 votes
1 answer

I get an error stating- Hadoop: «ERROR : JAVA_HOME is not set». How to resolve this?

Make sure that you have removed the ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Frankie
• 9,830 points
5,214 views
0 votes
1 answer

How to resolve corrupted blocks in Hadoop?

You can use hdfs fsck / to ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Nandini
5,205 views
0 votes
1 answer

Hadoop Hive: recursively descending into subdirectories without partitions or editing hive-site.xml

 I set the following properties before I ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,177 views
0 votes
1 answer

What is the role of Job tracker Hadoop?

Job tracker's function is resource management, tracking ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
• 65,910 points
5,160 views
0 votes
1 answer

Error: Execution Error, Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Permission denied:

Hey, The error you are getting because the ...READ MORE

May 15, 2019 in Big Data Hadoop by Gitika
• 65,910 points
5,159 views
0 votes
1 answer

Sqoop installation on Linux

Before installing Sqoop, make sure Hadoop is ...READ MORE

Feb 26, 2019 in Big Data Hadoop by Suman
5,159 views
0 votes
1 answer

error:- /zookeeper_server.pid: Permission denied FAILED TO WRITE PID

Hey, The default zookeeper installation (tar extract) comes ...READ MORE

May 27, 2019 in Big Data Hadoop by Gitika
• 65,910 points
5,148 views
0 votes
1 answer

How to create a managed table in Hive?

You can use this command: create table employee(Name ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,128 views
0 votes
1 answer

Which of the following is the daemon of Hadoop?

Hadoop is an open-source software framework for ...READ MORE

Dec 10, 2021 in Big Data Hadoop by CoderGirl
• 500 points
5,115 views
0 votes
1 answer

Hbase: Client not able to connect with remote Hbase server

You have to remove the localhost entry from hbase server's ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,113 views
0 votes
1 answer

Connect to Hive using Pyhive

Here's how we can connect to Hive ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,110 views
0 votes
1 answer

How can I access S3/S3n from a local Hadoop 2.6 installation?

For some reason, the jar hadoop-aws-[version].jar which contains the ...READ MORE

Oct 3, 2018 in Big Data Hadoop by digger
• 26,740 points
5,108 views
0 votes
1 answer

Hive local inpath gives invalid path error

You are using the below command to ...READ MORE

May 23, 2019 in Big Data Hadoop by Jill
5,097 views
0 votes
1 answer

What is the difference between MapReduce and YARN in Hadoop?

MapReduce: MapReduce is an algorithm used to store ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,066 views