Trending questions in Big Data Hadoop

+1 vote
0 answers

hdfs namenode -format not working, not showing anything.

can someone help me with this please, ...READ MORE

Sep 6, 2019 in Big Data Hadoop by nar
930 views
0 votes
1 answer

What happens when a datanode that is dead becomes active again?

When NameNode notices that it has not ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Rishi
4,264 views
0 votes
1 answer

Managed Table vs External Table

External table is created for external use ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,210 points
12,415 views
0 votes
1 answer

How to call MapReduce program using a simple Java Program?

Because map and reduce run on different ...READ MORE

Sep 4, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
964 views
0 votes
1 answer

How can create the dynamic partition table with data in Hive?

Hi, We can see some steps to do ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Gitika
• 65,910 points
4,252 views
0 votes
1 answer

Exception in thread "main" java.lang.NoClassDefFoundError

As far I can make out from ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Arpit
2,015 views
0 votes
1 answer

Write data into hive table in a parquet

Below is an example query which you ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Sadu
2,619 views
+1 vote
0 answers

Directory not found while using java -classpath

I'm using command java -classpath  ${HADOOP_CLASSPATH} -d '/home/shravanth/Desktop/wordcount/classes' ...READ MORE

Sep 14, 2019 in Big Data Hadoop by shravanth
436 views
0 votes
1 answer

Why we use 'help' command in Hadoop Sqoop?

Hi, The command sqoop help lists the tools ...READ MORE

Feb 4, 2020 in Big Data Hadoop by MD
• 95,440 points
637 views
0 votes
1 answer

How to restart failed Namenode?

You need to solve the issue which ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Ishan
2,624 views
0 votes
1 answer

error:- /zookeeper_server.pid: Permission denied FAILED TO WRITE PID

Hey, The default zookeeper installation (tar extract) comes ...READ MORE

May 27, 2019 in Big Data Hadoop by Gitika
• 65,910 points
5,059 views
0 votes
1 answer

Spark : java.lang.ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream

Create a spark-env.cmd file looking like this @echo off set ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
11,320 views
0 votes
1 answer

Hadoop HDFS: How to delete old files from HDFS?

You can use commands like this: hdfs dfs ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
• 69,210 points
13,390 views
0 votes
1 answer

Granting SELECT privilege in Hive

You can use this command to do ...READ MORE

May 31, 2019 in Big Data Hadoop by Umar
4,860 views
0 votes
1 answer

How to delete a column family from table in HBase?

Hey, You can delete a column family from ...READ MORE

Jun 21, 2019 in Big Data Hadoop by Gitika
• 65,910 points
3,957 views
0 votes
1 answer

Current Date in Hive

Try this instead: select from_unixtime(unix_timestamp()); If you have an ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Tina
2,448 views
0 votes
1 answer

Difference between Text and String in Hadoop

The binary representation of a Text object ...READ MORE

Aug 8, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,842 views
0 votes
2 answers

Is there a .NET equivalent to Apache Hadoop?

Hadoop is a Java-based platform. So, to ...READ MORE

Jul 16, 2020 in Big Data Hadoop by Suhana
• 340 points
1,382 views
0 votes
1 answer

How do you handle the failure of Data node?

HDFS has Master Slave architecture in which Master ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Apr 9, 2019 by Gitika 7,031 views
0 votes
1 answer

Hadoop: error: Cannot lock storage /app/hadoop/tmp/dfs/name. The directory is already locked.

Hi, Check your dfs.name.dir and dfs.data.dir path in hdfs-site.xml. Or ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,883 views
0 votes
1 answer

Hive local inpath gives invalid path error

You are using the below command to ...READ MORE

May 23, 2019 in Big Data Hadoop by Jill
5,032 views
0 votes
0 answers

ava.sql.SQLException: Error while processing statement:

Hi everyone, I am facing one issue ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Hemanth
• 250 points

edited Aug 7, 2019 by Omkar 1,788 views
0 votes
1 answer

Parquet & Avro File hadling with HIVE

For avro you can follow the format ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Tarun
2,290 views
0 votes
1 answer

How to import data to hbase database?

First you have to have the file ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Kiran
2,361 views
0 votes
1 answer

Output types of mapper and reducer does not match

job.setOutputValueClass will set the types expected as ...READ MORE

Jul 22, 2019 in Big Data Hadoop by Reena
2,389 views
0 votes
1 answer

Sqoop: Dsqoop.export.records.per.statement option

Dsqoop.export.records.per.statement=1 is as the name suggests how many ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Krish
2,688 views
0 votes
1 answer

How to find in incorrect file/records in hive?

A value with a wrong datatype causes ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Ritu
2,202 views
0 votes
2 answers

What is a container in YARN?

Yarn container are a process space where ...READ MORE

May 2, 2020 in Big Data Hadoop by anonymous
6,259 views
0 votes
1 answer

Use of Group ALL in Pig

Suppose we have a data set as ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Roshan
2,805 views
0 votes
1 answer

how to store images and videos on to HDFS?

HDFS is capable to accept data in ...READ MORE

Jul 16, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,536 views
+1 vote
2 answers

Hadoop: Error: Exception in thread “main” java.lang.UnsupportedClassVersionError: a

The reason for this error is because ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Venkita
• 240 points
1,501 views
0 votes
1 answer

How to unzip a zipped file stored in Hadoop hdfs?

hadoop fs -text /hdfs-path-to-zipped-file.gz | hadoop fs ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,210 points
11,782 views
0 votes
1 answer
0 votes
1 answer

How to check the size of a file in Hadoop HDFS?

You can use the  hadoop fs -ls command to ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
12,646 views
0 votes
1 answer

Hadoop: ERROR datanode.DataNode: All directories in dfs.data.dir are invalid.

Hi, Try this, first delete all contents from ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,542 views
0 votes
1 answer

Error: Execution Error, Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Permission denied:

Hey, The error you are getting because the ...READ MORE

May 15, 2019 in Big Data Hadoop by Gitika
• 65,910 points
5,105 views
0 votes
1 answer

Sqoop export not working

The issue that you might be getting ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Tina
2,395 views
0 votes
1 answer

Error: ERROR security.UserGroupInformation: PriviledgedActionException as:root (auth:SIMPLE)

Hey, For me, my Hadoop NameNode was in ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,416 views
0 votes
1 answer

Pig: Remove header line in csv file

Refer to the below file det.txt: Name,Age,Location a,10,chennai b,20,bangalore We will ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Yogi
1,729 views
0 votes
0 answers

HIve query data dates issue

Hello All, I am facing one issue, my ...READ MORE

Aug 22, 2019 in Big Data Hadoop by anonymous

edited Aug 22, 2019 by Omkar 841 views
0 votes
1 answer

Hive: what location should I mention while creating table?

It can be a hdfs path. The ...READ MORE

May 23, 2019 in Big Data Hadoop by Jishan
4,692 views
0 votes
1 answer

PIG Error while loading file: -bash: syntax error near unexpected token `('

Since your data is delimited with tabs ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Ritu
1,712 views
0 votes
1 answer

How to load data from flat files into Hive?

Hey, You can load data from flat files ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,910 points
3,078 views
0 votes
1 answer
0 votes
1 answer