Most viewed questions in Big Data Hadoop

0 votes
2 answers

How to convert .txt file to Hadoop's sequence file format

import java.io.IOException; import java.net.URI; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.FileSystem; import org.apache.hadoop.fs.Path; import org.apache.hadoop.io.IOUtils; import ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Sanjay
3,108 views
0 votes
1 answer

How to copy file to multiple hdfs directory?

You can use loop to copy the ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,099 views
0 votes
1 answer

How to load data from flat files into Hive?

Hey, You can load data from flat files ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,910 points
3,039 views
0 votes
1 answer

what does velocity in big data mean

Velocity in big data refers to the ...READ MORE

Feb 3, 2022 in Big Data Hadoop by CoolCoder
• 4,400 points
3,021 views
0 votes
1 answer

How to find the port on which hdfs is running?

If you are using hadoop 2.7 or ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,008 views
0 votes
1 answer

Error creating External Tables in Hive

The path which you have given for ...READ MORE

Feb 9, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,997 views
0 votes
1 answer

Hadoop: namenode -format error "java.io.IOException"

Run the command as sudo or add the ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,994 views
0 votes
1 answer

Hadoop fs mkdir and testing existence FileSystem.exists

FileSystem.get(conf) may return the local file system where ...READ MORE

Sep 18, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,993 views
+1 vote
1 answer

What is difference between Hadoop Namenode HA and HDFS federation?

The main difference between HDFS High Availability ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,989 views
0 votes
1 answer

Sqoop transfer file from MySql to HBase

Sqoop doesn’t permit you to import, all ...READ MORE

Feb 12, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,976 views
0 votes
1 answer

java.lang.NoSuchMethodError: org.apache.hadoop.fs.FSOutputSummer

Seems like you have not set the ...READ MORE

Jan 29, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,976 views
+1 vote
1 answer

Need help Installing Sqoop on Windows.

Download Sqoop from this link: http://www.apache.org/dyn/closer.lua/sqoop/1.4.7 This link is ...READ MORE

Feb 25, 2019 in Big Data Hadoop by Chandu
2,974 views
–1 vote
1 answer

Namenode daemon not starting properly

Add this in your hdfs-site.xml <property> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,969 views
+1 vote
1 answer
0 votes
1 answer

How to install Hadoop on Windows system?

First you need to download Hadoop files. ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,925 views
0 votes
1 answer

Value for HADOOP_CONF_DIR from Cluster

Install Hadoop as well. In my case ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Frankie
• 9,830 points
2,920 views
0 votes
1 answer

How to subtract month from Impala time stamp?

You don't need another method, you can ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Tina
2,918 views
0 votes
1 answer

Copy files to all Hadoop DFS directories

Hi @Bhavish. There is no Hadoop command ...READ MORE

Feb 24, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,918 views
0 votes
1 answer

How to increase reducers in Hive?

By default, only one reducer is assigned ...READ MORE

May 21, 2019 in Big Data Hadoop by Lohit
2,905 views
0 votes
1 answer

How to Modify the Maximum Number of Versions for a Column Family in Hbase?

Hey, The example uses HBase Shell to keep ...READ MORE

May 31, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,904 views
0 votes
1 answer

How can we retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Lohit
2,892 views
0 votes
1 answer

Not able to insert in hive partition table

You have to add the partition before ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,892 views
0 votes
1 answer

Error: input path does not exist

Hey, This error looks like your job History ...READ MORE

Apr 30, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,868 views
0 votes
1 answer

getting error: -bash: syntax error near unexpected token `('

hi, you should give space between PigStorage and ...READ MORE

May 9, 2020 in Big Data Hadoop by anonymous
• 140 points
2,861 views
0 votes
1 answer

Not able to run hdfs commands

Because you said it ran yesterday and ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,858 views
0 votes
1 answer

Help me solve this error "Unable to load Hadoop Native library for your platform"

I hope I understood your query properly I ...READ MORE

Jun 20, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,837 views
0 votes
1 answer

What is Metastore in Hive?

It stores metadata for Hive tables (like their schema ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,833 views
0 votes
3 answers

JDBC connection string for Netezza

HI.. Netezza is one of the widely used ...READ MORE

Oct 30, 2020 in Big Data Hadoop by SRI
2,814 views
0 votes
1 answer

Difference between a failed task attempt and a killed task attempt

Let me explain you the difference between ...READ MORE

Jul 24, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,813 views
0 votes
1 answer

Issue with Python Read file as stream from HDFS.

The easiest way is using the following ...READ MORE

Jun 26, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,792 views
0 votes
1 answer

Getting error while loading data into hive table

In the command you have used, the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,789 views
0 votes
1 answer

Differences between Hadoop-common, Hadoop-core and Hadoop-client?

To help provide some additional details regarding ...READ MORE

Mar 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,776 views
0 votes
1 answer

How to load data from HDFS into pig relation?

Hey, To load data from HDFS to pig ...READ MORE

May 7, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,767 views
0 votes
1 answer

How to delete a directory from Hadoop cluster which is having comma(,) in its name?

Just try the following command: hadoop fs -rm ...READ MORE

May 7, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,746 views
0 votes
1 answer

Getting error in command hdfs dfs -mkdir

You are getting this error because the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,745 views
0 votes
1 answer

What is difference between Oozie workflow, coordinator and bundle ?

Workflow does not have time specifications to ...READ MORE

Mar 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,744 views
0 votes
1 answer

Copy a directory from one node in the cluster to another in HDFS.

Hi@akhtar, You can copy a directory from one ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,440 points
2,743 views
0 votes
1 answer

Install PostgreSQL JDBC driver for Sqoop

All you have to do to install ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Quill
2,743 views
0 votes
1 answer

What are the modes of Hive metastore?

Hey, The metastore stores the schema and partition ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,743 views
0 votes
1 answer

Hive: org.apache.hadoop.security.AccessControlException Permission denied: user

This error is generally thrown when the ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Waniku
2,737 views
0 votes
1 answer

Use of Group ALL in Pig

Suppose we have a data set as ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Roshan
2,735 views
0 votes
1 answer

How to fix corrupt HDFS FIles?

You can use hdfs fsck / to ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,735 views
0 votes
1 answer

mkdir: cannot create directory `/var/run/hadoop': Permission denied.

Hi@akhtar, You need to set the path of ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
2,722 views
0 votes
1 answer

Sqoop import: import failed error

The problem which you are facing is ...READ MORE

Feb 12, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,711 views
0 votes
0 answers
0 votes
1 answer

Start-dfs.sh daemons not starting. localhost: mkdir: cannot create directory `/user': Permission denied

Make the following changes to the hadoop-env.sh ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,703 views
0 votes
1 answer

How to check Cloudera Manager Service status?

There surely is a command to check ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,698 views
0 votes
1 answer

Hive: How to know the path of a created table?

You can use the DESCRIBE command to ...READ MORE

Nov 28, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,698 views
0 votes
1 answer

How to use Hbase shell in a bash script?

Hello, To write scripts with HBase shell it includes non-interactive mode, ...READ MORE

May 29, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,693 views
0 votes
1 answer

How to change the Hive table comment?

Yes, it is possible to change the ...READ MORE

May 20, 2019 in Big Data Hadoop by Tina
2,684 views