Most viewed questions in Big Data Hadoop

+1 vote
2 answers

How to delete and update a record in Hive?

Hi, Earlier, there was no operation supported for ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
 • 38,230 points • 5,700 views
–1 vote
1 answer

Why is Hive not good for OLTP?

Apache Hive is mainly used for batch processing i.e. ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 5,624 views
0 votes
1 answer

Hadoop Java Error: java.lang.NoClassDefFoundError: WordCount (wrong name: org/myorg/WordCount)

Hey, try this code import java.io.IOException; import java.util.Iterator; import java.util.StringTokenizer; import ...READ MORE

Sep 19, 2018 in Big Data Hadoop by slayer
 • 29,350 points • 5,619 views
0 votes
1 answer

Hive partitioning: Dynamic and static

Partitions are created depending on the end ...READ MORE

Feb 1, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 5,541 views
0 votes
1 answer

I am receiving a warning which says: Failed to locate the winutils binary in the Hadoop binary path

I see that you are facing multiple ...READ MORE

May 31, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 5,527 views
+1 vote
1 answer

Hadoop Installation Issue on Windows

Below is the main error you are ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 5,497 views
+1 vote
2 answers

Execute Pig Script from Grunt Shell

From your current directory run  pig -x local Then ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Kunal
 • 5,487 views
0 votes
1 answer

Spark.read.csv to create RDD into Dataframe

You can use a case class and ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 5,481 views
0 votes
1 answer

Multiple input for MapReduce job

We use MultipleInputs class which supports MapReduce ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Jim
 • 5,480 views
0 votes
1 answer

What's the difference between Hadoop and NoSQL ?

Let's start with the definitions Hadoop is an ...READ MORE

Apr 2, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 5,470 views
0 votes
1 answer

Difference between hive.exec.compress.output=true; and mapreduce.output.fileoutputformat.compress=true;

Hey there! The definition of these two properties ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,367 views
0 votes
1 answer

Unzip files in hdfs

To unzip a gzipped (or bzipped) file, ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Joe
 • 5,354 views
0 votes
2 answers

Hive update and delete limitations

Vinyl-like crackle sounds. And what is my ...READ MORE

May 3, 2020 in Big Data Hadoop by Carter
 • 140 points • 5,329 views
0 votes
1 answer

How to find the number of blocks a hdfs file is divided into?

Yes. you can use the hadoop fsck command to do ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,304 views
+1 vote
2 answers

What does hadoop fs -du command gives as output?

du command is used for to see ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
 • 5,287 views
0 votes
1 answer

What is SerDe in Hadoop Hive?

The SerDe interface allows you to instruct ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Akshay
 • 5,286 views
0 votes
1 answer

Why is Hive called as Data Warehouse?

Hive is a data warehouse infrastructure tool ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Joshua
 • 5,271 views
0 votes
1 answer

SQOOP Export command failing

First create a table, which should have ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 5,249 views
0 votes
1 answer

How to clear yarn cache?

Yarn has a command by default to clear ...READ MORE

Feb 5, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 5,214 views
–1 vote
1 answer

Apache Spark - Nested JSON array to flatten columns

It depends on the structure of your ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 5,212 views
0 votes
1 answer

Hadoop Hive: ClassNotFoundException: org.apache.hive.jdbc.HiveDriver

You have to use the right dependency <dependency> ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,196 views
0 votes
1 answer

How to delete a file from Hadoop hdfs using java?

Try this: FileSystem fs = FileSystem.get(getConf()); fs.delete(new ...READ MORE

Nov 28, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,174 views
0 votes
1 answer

How to print the content of a file in console present in HDFS?

Yes, you can use hdfs dfs command ...READ MORE

Apr 19, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 5,168 views
–1 vote
1 answer

unable to start hive server

It seems that your hive server is ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 5,136 views
0 votes
1 answer

Parquet to ORC format in Hive

Follow the below steps to load the ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Raj
 • 5,132 views
0 votes
1 answer

Hadoop: Format namenode gives error: Shutting down NameNode at java.net.UnknownHostException

UnknownHostException is thrown when hadoop tries to resolve ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,130 views
0 votes
2 answers

Command to check the Hadoop distribution as well as it’s version which is installed in my cluster

One of the options to check the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 5,103 views
0 votes
1 answer

How hadoop mapreduce job is submitted to worker nodes?

Alright, I think you are basically looking ...READ MORE

Mar 30, 2018 in Big Data Hadoop by Ashish
 • 2,650 points • 5,097 views
+2 votes
1 answer

How to calculate Maximum salary of the employee with the name using the Map Reduce Technique

Please try the below code and it ...READ MORE

Jul 25, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 5,088 views
0 votes
1 answer

Hadoop: How to copy directory from local system to hdfs using Java code?

Just use the FileSystem's copyFromLocalFile method. If the source Path ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,073 views
0 votes
1 answer

apache.spark.sql.AnalysisException: Text data source does not support int data type.;

Hi@akhtar, I think your output is in different ...READ MORE

Feb 13, 2020 in Big Data Hadoop by MD
 • 95,440 points • 5,069 views
0 votes
1 answer

How to create a managed table in Hive?

You can use this command: create table employee(Name ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,032 views
0 votes
1 answer

What does NameNode stores and where it stores?

NameNode records the metadata of all the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 5,012 views
0 votes
1 answer

Hbase: Client not able to connect with remote Hbase server

You have to remove the localhost entry from hbase server's ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,009 views
0 votes
1 answer

Connect to Hive using Pyhive

Here's how we can connect to Hive ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 5,003 views
0 votes
1 answer

How to download hadoop jar files for adding eclipse

Hi@Manl, To import jar file in your Eclipse ...READ MORE

Jul 20, 2020 in Big Data Hadoop by MD
 • 95,440 points • 4,986 views
0 votes
1 answer

Hadoop Hive: recursively descending into subdirectories without partitions or editing hive-site.xml

 I set the following properties before I ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 4,985 views
0 votes
1 answer

Command to see the indexes of a table in Hive?

Hey, The command you can use to see ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
 • 65,930 points
edited Jun 26, 2019 by Gitika • 4,982 views
0 votes
1 answer

Sqoop installation on Linux

Before installing Sqoop, make sure Hadoop is ...READ MORE

Feb 26, 2019 in Big Data Hadoop by Suman
 • 4,978 views
0 votes
1 answer

How can I access S3/S3n from a local Hadoop 2.6 installation?

For some reason, the jar hadoop-aws-[version].jar which contains the ...READ MORE

Oct 3, 2018 in Big Data Hadoop by digger
 • 26,740 points • 4,966 views
0 votes
1 answer

What is the role of Job tracker Hadoop?

Job tracker's function is resource management, tracking ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 4,924 views
0 votes
1 answer

How to resolve corrupted blocks in Hadoop?

You can use hdfs fsck / to ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Nandini
 • 4,918 views
0 votes
1 answer

What is the command to navigate in HDFS?

First of all there is no command ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 4,915 views
0 votes
1 answer

Error: Execution Error, Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Permission denied:

Hey, The error you are getting because the ...READ MORE

May 15, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 4,896 views
+1 vote
1 answer

What is the process to perform an incremental data load in Sqoop?

The process to perform incremental data load ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,876 views
0 votes
1 answer

What is the difference between MapReduce and YARN in Hadoop?

MapReduce: MapReduce is an algorithm used to store ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 4,863 views
0 votes
1 answer

Hive local inpath gives invalid path error

You are using the below command to ...READ MORE

May 23, 2019 in Big Data Hadoop by Jill
 • 4,845 views
0 votes
1 answer

What is the difference between Map-side join and Reduce-side join?

Join is a clause that combines the records ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 4,835 views
0 votes
1 answer

error:- /zookeeper_server.pid: Permission denied FAILED TO WRITE PID

Hey, The default zookeeper installation (tar extract) comes ...READ MORE

May 27, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 4,822 views
0 votes
1 answer

Hadoop Hive: How to convert multiple rows into comma separated values?

You can use the aggregator function collect_set to do ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 4,811 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.