Most viewed questions in Big Data Hadoop

0 votes
1 answer

Hadoop Mapreduce: Error: Could not find or load main class com.sun.tools.javac.Main

You have to add HADOOP_CLASSPATH environment parameter: expor ...READ MORE

Oct 30, 2018 in Big Data Hadoop by Omkar
• 69,180 points
4,071 views
0 votes
1 answer

How to subtract month from Impala time stamp?

You don't need another method, you can ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Tina
4,056 views
0 votes
1 answer

Map-reduce code for finding average salary

You can choose your mapper output key ...READ MORE

May 22, 2019 in Big Data Hadoop by Yogi
4,037 views
0 votes
1 answer

Hadoop Hive: message:Version information not found in metastore. Unable to instantiate

These are the necessary tables required for metastore that are ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,180 points
4,028 views
0 votes
2 answers

How to convert .txt file to Hadoop's sequence file format

import java.io.IOException; import java.net.URI; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.FileSystem; import org.apache.hadoop.fs.Path; import org.apache.hadoop.io.IOUtils; import ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Sanjay
4,026 views
0 votes
1 answer

Getting error while loading data into hive table

In the command you have used, the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,180 points
4,024 views
0 votes
1 answer

Use of Group ALL in Pig

Suppose we have a data set as ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Roshan
4,005 views
0 votes
1 answer

How can we retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Lohit
4,000 views
0 votes
1 answer

How to create a Hive table with a sequence file?

In Hive we can create a sequence ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,998 views
0 votes
1 answer

How should I provide a URL for hdfs file system?

If you are trying to access your ...READ MORE

Sep 10, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,996 views
0 votes
1 answer

MapReduce to count alphabets

Please find the code below for alphabet ...READ MORE

May 23, 2019 in Big Data Hadoop by Firoz
3,993 views
0 votes
1 answer

What are the modes of Hive metastore?

Hey, The metastore stores the schema and partition ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,976 views
+2 votes
5 answers

Not able to start hadoop dfs

You can re-install openssh-client and openssh-server: $ sudo ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Jino
3,974 views
0 votes
1 answer

What is Hue?

As you said, Hue is a web ...READ MORE

Mar 22, 2018 in Big Data Hadoop by Ashish
• 2,650 points

edited Mar 22, 2018 by Ashish 3,974 views
0 votes
1 answer

Hadoop Hive query to filter employees

select * from tablename where DOJ> '2018-01-01' ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,971 views
0 votes
1 answer

Pig mapreduce mode vs local mode?

Both MapReduce mode and local mode seem ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,957 views
–1 vote
1 answer

Unable to execute the jar file wordcount.

I see that the command that you ...READ MORE

Jan 21, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,953 views
0 votes
1 answer

How to choose number of Executors and Executor cores?

Refer to the below when you are ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Veer
3,939 views
0 votes
1 answer

How to restart failed Namenode?

You need to solve the issue which ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Ishan
3,938 views
0 votes
1 answer

Getting error in command hdfs dfs -mkdir

You are getting this error because the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,929 views
0 votes
1 answer

mkdir: cannot create directory `/var/run/hadoop': Permission denied.

Hi@akhtar, You need to set the path of ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,460 points
3,927 views
0 votes
1 answer

What was Hadoop written in?

The Hadoop framework is mostly written in ...READ MORE

Dec 9, 2021 in Big Data Hadoop by Kavya
• 700 points
3,925 views
0 votes
1 answer

How to load data from flat files into Hive?

Hey, You can load data from flat files ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,913 views
0 votes
1 answer

Sqoop import: import failed error

The problem which you are facing is ...READ MORE

Feb 12, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,876 views
–1 vote
1 answer

Namenode daemon not starting properly

Add this in your hdfs-site.xml <property> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,869 views
+1 vote
1 answer

Need help Installing Sqoop on Windows.

Download Sqoop from this link: http://www.apache.org/dyn/closer.lua/sqoop/1.4.7 This link is ...READ MORE

Feb 25, 2019 in Big Data Hadoop by Chandu
3,868 views
0 votes
1 answer

Copy files to all Hadoop DFS directories

Hi @Bhavish. There is no Hadoop command ...READ MORE

Feb 24, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,861 views
0 votes
1 answer

Sqoop transfer file from MySql to HBase

Sqoop doesn’t permit you to import, all ...READ MORE

Feb 12, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,851 views
0 votes
1 answer

Hadoop: java.io.IOException: File could only be replicated to 0 nodes instead of minReplication (=1)

Try this, first stop all the daemons, ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,848 views
0 votes
1 answer

Error creating External Tables in Hive

The path which you have given for ...READ MORE

Feb 9, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,845 views
+1 vote
1 answer

What is difference between Hadoop Namenode HA and HDFS federation?

The main difference between HDFS High Availability ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,835 views
0 votes
1 answer

How to fix corrupt HDFS FIles?

You can use hdfs fsck / to ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,830 views
0 votes
1 answer

How does Hive job execution flow works?

Hey, Hive query is received from UI or ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,828 views
0 votes
1 answer

Copy a directory from one node in the cluster to another in HDFS.

Hi@akhtar, You can copy a directory from one ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,460 points
3,825 views
0 votes
1 answer

java.lang.NoSuchMethodError: org.apache.hadoop.fs.FSOutputSummer

Seems like you have not set the ...READ MORE

Jan 29, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,825 views
0 votes
1 answer

Error: input path does not exist

Hey, This error looks like your job History ...READ MORE

Apr 30, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,821 views
0 votes
1 answer

How to install Hadoop on Windows system?

First you need to download Hadoop files. ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,805 views
0 votes
1 answer

How to see the report of Hadoop Cluster from command line?

Hi@akhtar, You can see the report of Hadoop Cluster ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,460 points
3,782 views
0 votes
1 answer

Not able to insert data into hive table

Seems like a hive version problem.​ insert operation is ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,754 views
+1 vote
1 answer
0 votes
1 answer

Hive: "SET LOCATION" command not changing the location of the database

The SET LOCATION command does not change ...READ MORE

May 20, 2019 in Big Data Hadoop by Yash
3,742 views
0 votes
1 answer

Hadoop fs mkdir and testing existence FileSystem.exists

FileSystem.get(conf) may return the local file system where ...READ MORE

Sep 18, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,734 views
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,732 views
0 votes
1 answer

Help me solve this error "Unable to load Hadoop Native library for your platform"

I hope I understood your query properly I ...READ MORE

Jun 20, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
3,727 views
0 votes
1 answer

Sqoop: Dsqoop.export.records.per.statement option

Dsqoop.export.records.per.statement=1 is as the name suggests how many ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Krish
3,712 views
0 votes
1 answer

ERROR tool.BaseSqoopTool: Got error creating database manager: java.io.IOException: No manager for connect string

Hi@akhtar, I think your jdbc jars are not ...READ MORE

Apr 24, 2020 in Big Data Hadoop by MD
• 95,460 points
3,711 views
0 votes
1 answer

Hive: How to know the path of a created table?

You can use the DESCRIBE command to ...READ MORE

Nov 28, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,702 views
0 votes
1 answer

Sqoop could not load db driver class

Hello, Have you tried to put the both ...READ MORE

Dec 13, 2019 in Big Data Hadoop by Alexandru
• 510 points
3,690 views
0 votes
1 answer

How to update the existing record in HDFS?

Hi@akhtar, HDFS follows Write Once Read Many times ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,460 points
3,670 views