Most viewed questions in Big Data Hadoop

0 votes
1 answer

How to upload files in Hadoop Cluster?

Hi@akhtar, To upload a file in Hadoop Cluster, ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
 • 95,440 points • 1,839 views
0 votes
1 answer

Error: Could not create the Java Virtual Machine in Hadoop.

Hi@akhtar, You can list down all the files ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
 • 95,440 points • 1,837 views
0 votes
1 answer

What are some of the famous visualization tools which can be integrated with Hadoop & Hive?

I have personally used two visualization tools ...READ MORE

May 1, 2018 in Big Data Hadoop by coldcode
 • 2,080 points • 1,836 views
0 votes
1 answer

Hello all! I try to install hadoop but I have a problem when trying to format data folder with command "hdfs namenode -format". Error: Could not find or load main class Username

Hi, @Kamaraj, It looks like a path issue, ...READ MORE

Aug 13, 2020 in Big Data Hadoop by Gitika
 • 65,910 points • 1,828 views
0 votes
1 answer

Cant access file from Hive. permission denied

There are two possible reasons for this: Wrong ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 1,828 views
0 votes
1 answer

How to find hadoop distribution and version?

Just Use the command Hadoop version ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points
edited Apr 6, 2018 by kurt_cobain • 1,828 views
0 votes
1 answer

Is there any hdfs dfs command to restrict number of files to be created in a directory ?

Not sure about the command but you ...READ MORE

May 6, 2019 in Big Data Hadoop by Shri
 • 1,827 views
0 votes
1 answer

Problem connecting Sqoop to MySql

Perhaps, you have slightly misunderstood the method ...READ MORE

May 15, 2019 in Big Data Hadoop by Ali
 • 1,825 views
0 votes
1 answer

Difference between root of hdfs and local machine

The command hdfs dfs -put command is used to ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Mahi
 • 1,820 views
0 votes
1 answer

How compression works in Hadoop?

It basically depends on the file type ...READ MORE

Jul 27, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,819 views
0 votes
1 answer

How can I write text in HDFS using CMD?

Hadoop put & appendToFile only reads standard ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,819 views
0 votes
1 answer

Set Table Lock manager for Hive

To enable Table Lock manager, you have ...READ MORE

May 31, 2019 in Big Data Hadoop by Vinod
 • 1,814 views
0 votes
1 answer

Sqoop import gives error: org.apache.hadoop.security.AccessControlException: Permission denied

Seems like you are not passing the ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 1,814 views
0 votes
1 answer

How to import Flat files in Hadoop using sqoop?

Sqoop is a tool which we use ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,805 views
0 votes
1 answer

Name node is in safe mode. Not able to leave

In order to forcefully let the namenode ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
 • 65,910 points • 1,804 views
0 votes
1 answer

Hadoop Hive: How to drop a table?

You cannot drop column directly from a ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 1,804 views
0 votes
1 answer

PIG Error while loading file: -bash: syntax error near unexpected token `('

Since your data is delimited with tabs ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Ritu
 • 1,793 views
0 votes
1 answer

How to get started with Hadoop and do some development using Eclipse IDE?

Alright, there are couple of things that ...READ MORE

Apr 4, 2018 in Big Data Hadoop by Ashish
 • 2,650 points • 1,793 views
0 votes
2 answers

Load data into the hive table

Hi, We can use a normal insert query ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
 • 95,440 points • 1,792 views
0 votes
1 answer

Sqoop import where clause problem

The syntax you are using is wrong. ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,230 points • 1,791 views
0 votes
1 answer

Pig: Remove header line in csv file

Refer to the below file det.txt: Name,Age,Location a,10,chennai b,20,bangalore We will ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Yogi
 • 1,790 views
0 votes
1 answer

Hadoop Spark: What is version to find SparkSession in library Spark?

you need both core and SQL artifacts <repositories> ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 1,789 views
0 votes
1 answer

Zookeeper server going down frequently.

Hi@B, There may be several reasons behind this. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
 • 95,440 points • 1,785 views
0 votes
1 answer

What are the components in Pig

Hi, Yes, this is absolutely correct that pig ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,781 views
0 votes
1 answer

Does Hadoop and Spark support iPv6 now?

It does not. As of today HADOOP-11890, which ...READ MORE

Oct 15, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,779 views
0 votes
1 answer

Connection String for MySQL database using Sqoop

The format for the connection string and ...READ MORE

Jun 6, 2019 in Big Data Hadoop by John
 • 1,778 views
0 votes
1 answer

What is the meaning of Write Ahead Log in Hadoop?

Write Ahead Log (WAL) is a file ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Sunil
 • 1,773 views
0 votes
1 answer

Hbase installation Issue. Cant start HRegionServer and HQuorumPeer

It seems hbase did not start properly ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 1,770 views
0 votes
1 answer

GUI for using Hadoop

Hue is open source and works well ...READ MORE

Apr 24, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 1,768 views
0 votes
1 answer

ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Cannot run program "hive": error=2, No such file or directory

The tables look fine. Follow these steps ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Kiran
 • 1,765 views
0 votes
1 answer

How to change file format using Sqoop?

For change in the file format, you ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 1,761 views
0 votes
1 answer

Multiple Output format in Hadoop

Each reducer uses an OutputFormat to write ...READ MORE

Jul 26, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,759 views
0 votes
1 answer

How to exit name node from safe mode?

In order to forcefully let the namenode ...READ MORE

Sep 26, 2018 in Big Data Hadoop by slayer
 • 29,350 points • 1,759 views
0 votes
0 answers

What are the pros and cons of parquet format compared to other formats?

Hi Team, I am new to Hadoop I ...READ MORE

Dec 21, 2020 in Big Data Hadoop by akhtar
 • 38,230 points • 1,751 views
0 votes
1 answer

What is the difference between MapRed and MapReduce?

Firstly, we must learn that these are ...READ MORE

Mar 6, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,750 views
–1 vote
1 answer

WARN util.NativeCodeLoader: Unable to load native-hadoop library

To remove this warning, you can use:  hdfs ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,230 points • 1,745 views
0 votes
1 answer

Hadoop Nodes for Multiple Disks

Datanodes can store blocks in multiple directories ...READ MORE

Jul 3, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 1,744 views
0 votes
1 answer

How to reduce shuffling cost in map reduce?

You can define a Combiner function, which does the ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,230 points • 1,742 views
0 votes
1 answer

Unable to execute HDFS commands on the terminal

Maybe because you have not started hadoop ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,230 points • 1,740 views
0 votes
1 answer

Access DFS through Java API

It is because, may be you are ...READ MORE

Mar 23, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,737 views
0 votes
1 answer

Hive: Revoke SELECT privilege from a Role

The following command can be used to ...READ MORE

May 31, 2019 in Big Data Hadoop by Shri
 • 1,735 views
0 votes
1 answer

What is the PostgreSQL connection string for Sqoop?

The format of the connection string is: jdbc:postgresql://<HOST>:<PORT>/<DATABASE_NAME> You ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Kamal
 • 1,729 views
0 votes
1 answer

Disable dynamic partition in hive

Dynamic partition is set to true by ...READ MORE

May 21, 2019 in Big Data Hadoop by Vishwa
 • 1,720 views
+1 vote
1 answer

What are all the Data quality checks we do in our real time Big Data projects.

You can use a checksum to compare ...READ MORE

Sep 4, 2019 in Big Data Hadoop by Tina
 • 1,706 views
0 votes
1 answer

Hadoop Command to merge edit logs with fsimage

You can use this command to save ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,706 views
0 votes
1 answer

what does velocity in big data mean?

Velocity refers to the speed at which ...READ MORE

Dec 14, 2021 in Big Data Hadoop by Edureka
 • 12,690 points • 1,702 views
0 votes
1 answer

How to tune Spark jobs & optimize the performance?

You need to know the cluster properly ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
 • 2,080 points • 1,698 views
0 votes
1 answer

How do I get connected to Hadoop and Geo Spatial connector?

There are a number of free and ...READ MORE

Aug 14, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,696 views
0 votes
1 answer

Hadoop: How to use Jps command with Sun JDK installed?

You can put JPS into your path ...READ MORE

Nov 9, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 1,693 views
0 votes
1 answer

Impala: Add months to current time

You can add the months using the add_months method ...READ MORE

Jun 6, 2019 in Big Data Hadoop by John
 • 1,690 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.