Trending questions in Big Data Hadoop

0 votes
1 answer

How to run Hadoop in Docker containers?

Hi, You can run Hadoop in Docker container. Follow ...READ MORE

Jan 24, 2020 in Big Data Hadoop by MD
• 95,440 points
1,820 views
0 votes
1 answer

How to create a Hive table from sequence file stored in HDFS?

There are two SerDe for SequenceFile as ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,544 views
0 votes
1 answer

How to delete a file from Hadoop hdfs using java?

Try this: FileSystem fs = FileSystem.get(getConf()); fs.delete(new ...READ MORE

Nov 28, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,338 views
0 votes
1 answer

Different Hadoop Modes

Hadoop can run in 3 different modes. 1. ...READ MORE

Jun 13, 2018 in Big Data Hadoop by shams
• 3,670 points
12,568 views
0 votes
1 answer

MySql connection localhost vs 127.0.0.1

The difference is that when you use localhost, ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,074 views
0 votes
1 answer

Path to hiverc file

The hiverc file is not created by default. ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Jishan
1,873 views
0 votes
1 answer

Hadoop installation on Ubuntu.

I have the perfect solution for you, ...READ MORE

Mar 8, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
916 views
0 votes
1 answer

Sqoop error while importing data from MySql

As the error states, the target directory ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,897 views
0 votes
2 answers

Which one among the both MapRed and MapReduce is considered better to create a Hadoop job?

The new API is cleaner and faster. ...READ MORE

Mar 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
729 views
0 votes
1 answer

What is SerDe in Hadoop Hive?

The SerDe interface allows you to instruct ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Akshay
5,444 views
–1 vote
1 answer

Json and snappy compression

Refer the below screenshot for your above ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,278 views
0 votes
1 answer

Hadoop: Error: Could not find or load main class com.sun.tools.javac.Main

It looks like the path is not ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,978 views
0 votes
1 answer

Location of Sqoop job

It depends on how you are running ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,414 views
0 votes
1 answer

How to install Hadoop in Ubuntu?

Hey. Follow these steps to install hadoop. First ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,419 views
0 votes
1 answer

What do you understand by an inner bag and outer bag in Pig?

Outer bag or relation is nothing but ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Frankie
• 9,830 points
1,266 views
0 votes
1 answer

Hive installation on Linux

Download hive from: http://www.apache.org/dyn/closer.cgi/hive/ Extract the files using ...READ MORE

Feb 28, 2019 in Big Data Hadoop by Mahesh
990 views
0 votes
1 answer

Doubt regarding --last-value in sqoop while importing.

I think you are a little confused. ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,337 views
–1 vote
1 answer

Namenode daemon not starting properly

Add this in your hdfs-site.xml <property> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,054 views
0 votes
1 answer

How does Avro schema evolution work?

If you have one avro file and ...READ MORE

Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
7,951 views
–1 vote
1 answer

Unable to execute the jar file wordcount.

I see that the command that you ...READ MORE

Jan 21, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,610 views
0 votes
1 answer

Bucketing in Hive

By default, only 1 bucket will be ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,661 views
0 votes
1 answer

Sqoop overwrite a directory

You can use the --hive-overwrite: $ sqoop import --connect ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,648 views
0 votes
1 answer

What does hadoop mean?

I see that you are confused about ...READ MORE

Mar 6, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
643 views
0 votes
1 answer

How to import PIG data into HBase?

Follow the below steps to do it: # ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,503 views
0 votes
1 answer

Unable to run import script using sqoop

You are writing incorrect command. Please write ...READ MORE

Mar 8, 2019 in Big Data Hadoop by Raj
561 views
0 votes
1 answer

Sqoop installation on Linux

Before installing Sqoop, make sure Hadoop is ...READ MORE

Feb 26, 2019 in Big Data Hadoop by Kriti
983 views
0 votes
1 answer

Hadoop Mapper is failed because of the following error - “Container killed by the ApplicationMaster”

I suggest you include below property files ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,762 views
0 votes
1 answer

What is the difference between Writable & WritableComparable in Hadoop?

Writable in an interface in Hadoop and types ...READ MORE

Oct 3, 2018 in Big Data Hadoop by Frankie
• 9,830 points
7,284 views
0 votes
1 answer

Validation in Spark

This can be prevented if you use ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,253 views
–1 vote
1 answer

Create Hive table with bucketing and ORC file format

create table hive_dml (emp_id int, first_name string, last_name ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,270 views
0 votes
1 answer

Unable to execute HDFS commands on the terminal

Maybe because you have not started hadoop ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,705 views
0 votes
1 answer

Point data from Hive to Hbase

Refer to the below steps to transfer ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,342 views
0 votes
1 answer

Installing Pig on Linux System

It was a good thing that you ...READ MORE

Feb 27, 2019 in Big Data Hadoop by Yuri
763 views
0 votes
1 answer

com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

Sqoop is not able to communicate with ...READ MORE

Jan 29, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,038 views
0 votes
1 answer

Hadoop: How to copy directory from local system to hdfs using Java code?

Just use the FileSystem's copyFromLocalFile method. If the source Path ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,282 views
0 votes
1 answer

Hadoop: Format namenode gives error: Shutting down NameNode at java.net.UnknownHostException

UnknownHostException is thrown when hadoop tries to resolve ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,321 views
0 votes
1 answer

Hadoop Hive: recursively descending into subdirectories without partitions or editing hive-site.xml

 I set the following properties before I ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,169 views
0 votes
1 answer

Update new sql data in sqoop

You can use incremental for this. When ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,333 views
0 votes
1 answer

Error while hitting the hadoop jar command to execute my map reduce

Since your jar file was inside the ...READ MORE

Feb 12, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,313 views
0 votes
1 answer

How to install scala on Ubuntu?

You can install Scala using apt-get using the ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,210 points
965 views
0 votes
2 answers

Command to check the Hadoop distribution as well as it’s version which is installed in my cluster

One of the options to check the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
5,274 views
0 votes
1 answer

Value for HADOOP_CONF_DIR from Cluster

Install Hadoop as well. In my case ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Frankie
• 9,830 points
2,948 views
0 votes
1 answer

Sqoop import where clause problem

The syntax you are using is wrong. ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,773 views
0 votes
1 answer

How to get absolute path of files in a directory in Hadoop?

You can use HDFS API like the ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Frankie
• 9,830 points
4,223 views
0 votes
1 answer

Not able to run hdfs commands

Because you said it ran yesterday and ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,927 views
0 votes
1 answer

Sqoop import failed while importing mysql table to Hbase

There is a spelling mistake in your ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,432 views
0 votes
1 answer

How to count meta data?

In Hadoop, Namenode consumes about 150 bytes ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,380 views
0 votes
1 answer

How to perform a word count on a dataframe column?

You can use the below code to ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,066 views
0 votes
1 answer

Hadoop Hive: Correlating expression cannot contain unqualified column references

Try the following command and see if ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,171 views
0 votes
1 answer

To whom is the Hadoop job submitted?

When a hadoop job is submitted, it ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Loki
867 views