Most voted questions in Big Data Hadoop

–1 vote
1 answer

Jobtracker and tasktracker is nor running.

Hi. You'll need to run start-mapred.sh if you want the ...READ MORE

Jan 19, 2019 in Big Data Hadoop by Omkar
• 69,210 points
594 views
–1 vote
1 answer

Getting error while starting hdfs namenode -format

Check your /etc/hosts file, the format should be like ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,879 views
–1 vote
1 answer

Namenode daemon not starting properly

Add this in your hdfs-site.xml <property> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,058 views
–1 vote
1 answer

Hadoop error: can not start-all.sh

Try adding <property> <name>dfs.name.dir</name> <value>/path/to/hdfs/dir</value> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,645 views
–1 vote
1 answer

Hadoop daemons not starting

You have to write this directory in ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,387 views
–1 vote
1 answer

Not able to run java mapreduce

The error which you are getting i.e ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,036 views
–1 vote
1 answer

Json and snappy compression

Refer the below screenshot for your above ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,283 views
–1 vote
1 answer

Error while creating Hive Database table

In your error, it says that the ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,612 views
–1 vote
1 answer

Not able to execute mapreduce code

Follow the below steps to execute the ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
474 views
–1 vote
1 answer

Pig command error: Failed to parse: Pig script failed to parse

There's a typo in your command: Right command: custdata ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,708 views
–1 vote
1 answer

Why is Hive not good for OLTP?

Apache Hive is mainly used for batch processing i.e. ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,898 views
–1 vote
1 answer

How to change the default HUE logs path?

You can change/replace the LOG_DIR variable to ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
846 views
–1 vote
1 answer

Changing map and reduce slots

Follow these steps to set the map ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,210 points
818 views
–1 vote
1 answer

How to Set cluster Rebalancer threshold

The command you are using is wrong. ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,210 points
337 views
–1 vote
1 answer

How to restrict nodes that talk to namenode?

Step 1: Create includes file in /home/hadoop ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,210 points
444 views
–1 vote
1 answer

Create Hive table with bucketing and ORC file format

create table hive_dml (emp_id int, first_name string, last_name ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,272 views
–1 vote
1 answer

Setting Hive properties

Hey. It's definitely not a stupid question. ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,145 views
–1 vote
1 answer

How to start pyspark?

Follow these steps: First start hadoop daemons: cd $HADOOP_HOME/sbin ./start-all.sh Now ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,210 points
378 views
–1 vote
1 answer

Hive partition tables

Yes, you can create manual partition. Here's ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,000 views
–1 vote
1 answer

Issue with MySql Server connection

Try to restart the mysqld server and then login: sudo ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
470 views
–1 vote
1 answer

unable to start hive server

It seems that your hive server is ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,351 views
–1 vote
1 answer

Apache Spark - Nested JSON array to flatten columns

It depends on the structure of your ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,315 views
–1 vote
1 answer

Pig code in Eclipse shows error :LongWritable cannot be resolved to a type

To rectify this errors, you need to ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,500 views
–1 vote
1 answer

File is available at HDFS location. Still system throws en error.

This is happening because the file name ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
345 views
–1 vote
1 answer

How to access Hadoop counter values using API?

You can use the job object to access the ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
957 views
–1 vote
1 answer

IDE Eclipse: Failed to locate the winutils binary in the hadoop binary path

Try this: First, click on file import appliance. Now ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,558 views
–1 vote
1 answer

Beeline and Hive Query Editor in Embedded mode

Running Hive client tools with embedded servers ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,275 views
–1 vote
1 answer

Beeline vs Hive Query Editor

Hive CLI connects to a remote HiveServer1 ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,095 views
–1 vote
1 answer

Incremental append in Sqoop

You are right. As Hadoop follows WORM ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,125 views
–1 vote
1 answer

When to use Sqoop?

Sqoop is used to transfer any data ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
582 views
–1 vote
1 answer

Serde query understanding

In the query mentioned in your question, ...READ MORE

Dec 29, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,159 views
–1 vote
1 answer

Namenode not running

Never mind. I forgot to run hadoop namenode ...READ MORE

Dec 27, 2018 in Big Data Hadoop by digger
• 26,740 points
2,275 views
–1 vote
1 answer

Spark multiple version without major version

Yes. It is not necessary to set ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,210 points
572 views
–1 vote
1 answer

How to use multiple spark version?

You can use the  SPARK_MAJOR_VERSION for this. Suppose ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,945 views
–1 vote
1 answer

Cant open spark-shell webconsole

Seems like you have installed Spark2 but ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,336 views
–1 vote
1 answer

Serde input and output

Input Processing Hive's execution engine (referred to as ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,210 points
639 views
–1 vote
1 answer

How to uninstall and install mysql-server in centos?

Please find below the command to uninstall ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,234 views
–1 vote
1 answer

Job History Server edit logs

When the application master fails, each file ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
869 views
–1 vote
1 answer

Namenode start error

Seems like the content in core-site.xml file is ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
350 views
–1 vote
1 answer

How we can run spark SQL over hive tables in our cluster?

Open spark-shell. scala> import org.apache.spark.sql.hive._ scala> val hc = ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,136 views
–1 vote
1 answer

Hadoop cluster is not running in vm

First check if all daemons are running: sudo ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
594 views
–1 vote
1 answer

Can't seem to make hdfs commands to work

Check the ip address mentioned in core-site.xml ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
773 views
–1 vote
1 answer

Facing the below error while installing mysql in VM

We would like to say that the ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
709 views
–1 vote
1 answer

Not able to access hadoop cluster

The issue which you are facing is ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
444 views
–1 vote
1 answer

Hadoop unit not found error

Unfortunately the command that you are giving ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
427 views
–1 vote
1 answer

How to start namenode and datanode individually?

You can use these commands. For namenode: ./hadoop-daemon.sh start ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
9,899 views
–1 vote
1 answer

Mapreduce in Python

mapper.py #!/usr/bin/python import sys #Word Count Example # input comes from ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
870 views
–1 vote
1 answer

How many FSimage files will be created in hard disk?

In Hdfs, data and metadata are decoupled. ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,052 views
–1 vote
1 answer

What is shared FS in the standby namenode?

Shared FS Basically implies to the high ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
512 views
–1 vote
1 answer

Is standby node missing in Hadoop 1.0?

Yes, Hadoop 1.0 didn't have standby namenode. ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
494 views