Most voted questions in Big Data Hadoop

–1 vote
1 answer

Hive partition tables

Yes, you can create manual partition. Here's ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,507 views
–1 vote
1 answer

Issue with MySql Server connection

Try to restart the mysqld server and then login: sudo ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,220 points
834 views
–1 vote
1 answer

unable to start hive server

It seems that your hive server is ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,220 points
6,163 views
–1 vote
1 answer

Apache Spark - Nested JSON array to flatten columns

It depends on the structure of your ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,220 points
5,860 views
–1 vote
1 answer

Pig code in Eclipse shows error :LongWritable cannot be resolved to a type

To rectify this errors, you need to ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,076 views
–1 vote
1 answer

File is available at HDFS location. Still system throws en error.

This is happening because the file name ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,220 points
525 views
–1 vote
1 answer

How to access Hadoop counter values using API?

You can use the job object to access the ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,243 views
–1 vote
1 answer

IDE Eclipse: Failed to locate the winutils binary in the hadoop binary path

Try this: First, click on file import appliance. Now ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,870 views
–1 vote
1 answer

Beeline and Hive Query Editor in Embedded mode

Running Hive client tools with embedded servers ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,547 views
–1 vote
1 answer

Beeline vs Hive Query Editor

Hive CLI connects to a remote HiveServer1 ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,553 views
–1 vote
1 answer

Incremental append in Sqoop

You are right. As Hadoop follows WORM ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,932 views
–1 vote
1 answer

When to use Sqoop?

Sqoop is used to transfer any data ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,220 points
837 views
–1 vote
1 answer

Serde query understanding

In the query mentioned in your question, ...READ MORE

Dec 29, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,446 views
–1 vote
1 answer

Namenode not running

Never mind. I forgot to run hadoop namenode ...READ MORE

Dec 27, 2018 in Big Data Hadoop by digger
• 26,740 points
2,691 views
–1 vote
1 answer

Spark multiple version without major version

Yes. It is not necessary to set ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,046 views
–1 vote
1 answer

How to use multiple spark version?

You can use the  SPARK_MAJOR_VERSION for this. Suppose ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,391 views
–1 vote
1 answer

Cant open spark-shell webconsole

Seems like you have installed Spark2 but ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,623 views
–1 vote
1 answer

Serde input and output

Input Processing Hive's execution engine (referred to as ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,140 views
–1 vote
1 answer

How to uninstall and install mysql-server in centos?

Please find below the command to uninstall ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,837 views
–1 vote
1 answer

Job History Server edit logs

When the application master fails, each file ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,222 views
–1 vote
1 answer

Namenode start error

Seems like the content in core-site.xml file is ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
590 views
–1 vote
1 answer

How we can run spark SQL over hive tables in our cluster?

Open spark-shell. scala> import org.apache.spark.sql.hive._ scala> val hc = ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,816 views
–1 vote
1 answer

Hadoop cluster is not running in vm

First check if all daemons are running: sudo ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
862 views
–1 vote
1 answer

Can't seem to make hdfs commands to work

Check the ip address mentioned in core-site.xml ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,241 views
–1 vote
1 answer

Facing the below error while installing mysql in VM

We would like to say that the ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,093 views
–1 vote
1 answer

Not able to access hadoop cluster

The issue which you are facing is ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
768 views
–1 vote
1 answer

Hadoop unit not found error

Unfortunately the command that you are giving ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
626 views
–1 vote
1 answer

How to start namenode and datanode individually?

You can use these commands. For namenode: ./hadoop-daemon.sh start ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
11,788 views
–1 vote
1 answer

Mapreduce in Python

mapper.py #!/usr/bin/python import sys #Word Count Example # input comes from ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,182 views
–1 vote
1 answer

How many FSimage files will be created in hard disk?

In Hdfs, data and metadata are decoupled. ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,424 views
–1 vote
1 answer

What is shared FS in the standby namenode?

Shared FS Basically implies to the high ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
897 views
–1 vote
1 answer

Is standby node missing in Hadoop 1.0?

Yes, Hadoop 1.0 didn't have standby namenode. ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
717 views
–1 vote
1 answer

Need help in Installation of Hadoop

To set up Hadoop VM in centOS ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,220 points
570 views
–1 vote
1 answer

Display contents of my Parquet file.

Make sure you are running from the ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,274 views
–1 vote
1 answer

Sqoop split-by problem

Hello. The -m or --num-mappers is just a ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,501 views
–1 vote
1 answer

Copying jar file into hadoop

hdfs dfs -put input_file_name output_location READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,470 views
–1 vote
1 answer

Getting error when writing to HDFS. Unable to load native-hadoop library for your platform

Try this: sudo service hadoop-master restart After that try ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,697 views
–1 vote
1 answer

Where does reduce take place in Hadoop MapReduce?

A MapReduce job usually splits the input data-set into ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,464 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
4,824 views