Most viewed questions in Big Data Hadoop

0 votes
1 answer

Hadoop Mapreduce: Error: Could not find or load main class com.sun.tools.javac.Main

You have to add HADOOP_CLASSPATH environment parameter: expor ...READ MORE

Oct 30, 2018 in Big Data Hadoop by Omkar
• 69,180 points
4,094 views
0 votes
1 answer

How to subtract month from Impala time stamp?

You don't need another method, you can ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Tina
4,076 views
0 votes
1 answer

Getting error while loading data into hive table

In the command you have used, the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,180 points
4,070 views
0 votes
1 answer

Map-reduce code for finding average salary

You can choose your mapper output key ...READ MORE

May 22, 2019 in Big Data Hadoop by Yogi
4,052 views
0 votes
2 answers

How to convert .txt file to Hadoop's sequence file format

import java.io.IOException; import java.net.URI; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.FileSystem; import org.apache.hadoop.fs.Path; import org.apache.hadoop.io.IOUtils; import ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Sanjay
4,051 views
0 votes
1 answer

Hadoop Hive: message:Version information not found in metastore. Unable to instantiate

These are the necessary tables required for metastore that are ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,180 points
4,049 views
0 votes
1 answer

Use of Group ALL in Pig

Suppose we have a data set as ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Roshan
4,016 views
+2 votes
5 answers

Not able to start hadoop dfs

You can re-install openssh-client and openssh-server: $ sudo ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Jino
4,013 views
0 votes
1 answer

How can we retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Lohit
4,009 views
0 votes
1 answer

How to create a Hive table with a sequence file?

In Hive we can create a sequence ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,180 points
4,007 views
0 votes
1 answer

How should I provide a URL for hdfs file system?

If you are trying to access your ...READ MORE

Sep 10, 2018 in Big Data Hadoop by Frankie
• 9,830 points
4,006 views
0 votes
1 answer

MapReduce to count alphabets

Please find the code below for alphabet ...READ MORE

May 23, 2019 in Big Data Hadoop by Firoz
4,001 views
0 votes
1 answer

What is Hue?

As you said, Hue is a web ...READ MORE

Mar 22, 2018 in Big Data Hadoop by Ashish
• 2,650 points

edited Mar 22, 2018 by Ashish 3,990 views
0 votes
1 answer

What are the modes of Hive metastore?

Hey, The metastore stores the schema and partition ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,984 views
0 votes
1 answer

Hadoop Hive query to filter employees

select * from tablename where DOJ> '2018-01-01' ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,983 views
0 votes
1 answer

Pig mapreduce mode vs local mode?

Both MapReduce mode and local mode seem ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,977 views
0 votes
1 answer

How to choose number of Executors and Executor cores?

Refer to the below when you are ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Veer
3,968 views
0 votes
1 answer

Getting error in command hdfs dfs -mkdir

You are getting this error because the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,966 views
–1 vote
1 answer

Unable to execute the jar file wordcount.

I see that the command that you ...READ MORE

Jan 21, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,965 views
0 votes
1 answer

How to restart failed Namenode?

You need to solve the issue which ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Ishan
3,959 views
0 votes
1 answer

mkdir: cannot create directory `/var/run/hadoop': Permission denied.

Hi@akhtar, You need to set the path of ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,460 points
3,956 views
0 votes
1 answer

What was Hadoop written in?

The Hadoop framework is mostly written in ...READ MORE

Dec 9, 2021 in Big Data Hadoop by Kavya
• 700 points
3,936 views
0 votes
1 answer

How to load data from flat files into Hive?

Hey, You can load data from flat files ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,929 views
0 votes
1 answer

Copy files to all Hadoop DFS directories

Hi @Bhavish. There is no Hadoop command ...READ MORE

Feb 24, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,895 views
0 votes
1 answer

Sqoop import: import failed error

The problem which you are facing is ...READ MORE

Feb 12, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,885 views
+1 vote
1 answer

Need help Installing Sqoop on Windows.

Download Sqoop from this link: http://www.apache.org/dyn/closer.lua/sqoop/1.4.7 This link is ...READ MORE

Feb 25, 2019 in Big Data Hadoop by Chandu
3,880 views
–1 vote
1 answer

Namenode daemon not starting properly

Add this in your hdfs-site.xml <property> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,878 views
0 votes
1 answer

Hadoop: java.io.IOException: File could only be replicated to 0 nodes instead of minReplication (=1)

Try this, first stop all the daemons, ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,874 views
0 votes
1 answer

Sqoop transfer file from MySql to HBase

Sqoop doesn’t permit you to import, all ...READ MORE

Feb 12, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,871 views
+1 vote
1 answer

What is difference between Hadoop Namenode HA and HDFS federation?

The main difference between HDFS High Availability ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,862 views
0 votes
1 answer

Error creating External Tables in Hive

The path which you have given for ...READ MORE

Feb 9, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,861 views
0 votes
1 answer

How to fix corrupt HDFS FIles?

You can use hdfs fsck / to ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,850 views
0 votes
1 answer

java.lang.NoSuchMethodError: org.apache.hadoop.fs.FSOutputSummer

Seems like you have not set the ...READ MORE

Jan 29, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,841 views
0 votes
1 answer

How does Hive job execution flow works?

Hey, Hive query is received from UI or ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,840 views
0 votes
1 answer

Error: input path does not exist

Hey, This error looks like your job History ...READ MORE

Apr 30, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,838 views
0 votes
1 answer

Copy a directory from one node in the cluster to another in HDFS.

Hi@akhtar, You can copy a directory from one ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,460 points
3,834 views
0 votes
1 answer

How to install Hadoop on Windows system?

First you need to download Hadoop files. ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,827 views
0 votes
1 answer

How to see the report of Hadoop Cluster from command line?

Hi@akhtar, You can see the report of Hadoop Cluster ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,460 points
3,800 views
0 votes
1 answer

Not able to insert data into hive table

Seems like a hive version problem.​ insert operation is ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,791 views
+1 vote
1 answer
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,757 views
0 votes
1 answer

Hive: "SET LOCATION" command not changing the location of the database

The SET LOCATION command does not change ...READ MORE

May 20, 2019 in Big Data Hadoop by Yash
3,749 views
0 votes
1 answer

Help me solve this error "Unable to load Hadoop Native library for your platform"

I hope I understood your query properly I ...READ MORE

Jun 20, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
3,748 views
0 votes
1 answer

Hadoop fs mkdir and testing existence FileSystem.exists

FileSystem.get(conf) may return the local file system where ...READ MORE

Sep 18, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,744 views
0 votes
1 answer

ERROR tool.BaseSqoopTool: Got error creating database manager: java.io.IOException: No manager for connect string

Hi@akhtar, I think your jdbc jars are not ...READ MORE

Apr 24, 2020 in Big Data Hadoop by MD
• 95,460 points
3,727 views
0 votes
1 answer

Sqoop: Dsqoop.export.records.per.statement option

Dsqoop.export.records.per.statement=1 is as the name suggests how many ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Krish
3,724 views
0 votes
1 answer

Sqoop could not load db driver class

Hello, Have you tried to put the both ...READ MORE

Dec 13, 2019 in Big Data Hadoop by Alexandru
• 510 points
3,713 views
0 votes
1 answer

Hive: How to know the path of a created table?

You can use the DESCRIBE command to ...READ MORE

Nov 28, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,713 views
0 votes
1 answer

What is difference between Oozie workflow, coordinator and bundle ?

Workflow does not have time specifications to ...READ MORE

Mar 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
3,697 views