Most viewed questions in Big Data Hadoop

0 votes
1 answer

Unable to Locate WinUtils Library in Hadoop binary path.

If you are facing this problem while running a ...READ MORE

Jul 11, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,846 views
0 votes
1 answer

Error: Could not create the Java Virtual Machine in Hadoop.

Hi@akhtar, You can list down all the files ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,440 points
1,844 views
0 votes
1 answer

Problem connecting Sqoop to MySql

Perhaps, you have slightly misunderstood the method ...READ MORE

May 15, 2019 in Big Data Hadoop by Ali
1,840 views
0 votes
1 answer

What are some of the famous visualization tools which can be integrated with Hadoop & Hive?

I have personally used two visualization tools ...READ MORE

May 1, 2018 in Big Data Hadoop by coldcode
• 2,080 points
1,839 views
0 votes
1 answer

Is there any hdfs dfs command to restrict number of files to be created in a directory ?

Not sure about the command but you ...READ MORE

May 6, 2019 in Big Data Hadoop by Shri
1,834 views
0 votes
1 answer

How to find hadoop distribution and version?

Just Use the command Hadoop version ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points

edited Apr 6, 2018 by kurt_cobain 1,831 views
0 votes
1 answer

Cant access file from Hive. permission denied

There are two possible reasons for this: Wrong ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,830 views
0 votes
1 answer

How can I write text in HDFS using CMD?

Hadoop put & appendToFile only reads standard ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,830 views
0 votes
1 answer

How compression works in Hadoop?

It basically depends on the file type ...READ MORE

Jul 27, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,825 views
0 votes
1 answer

Difference between root of hdfs and local machine

The command hdfs dfs -put command is used to ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Mahi
1,821 views
0 votes
1 answer

Set Table Lock manager for Hive

To enable Table Lock manager, you have ...READ MORE

May 31, 2019 in Big Data Hadoop by Vinod
1,821 views
0 votes
1 answer

Sqoop import gives error: org.apache.hadoop.security.AccessControlException: Permission denied

Seems like you are not passing the ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,818 views
0 votes
1 answer

Name node is in safe mode. Not able to leave

In order to forcefully let the namenode ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,910 points
1,812 views
0 votes
1 answer

How to import Flat files in Hadoop using sqoop?

Sqoop is a tool which we use ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,810 views
0 votes
1 answer

Hadoop Hive: How to drop a table?

You cannot drop column directly from a ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,810 views
0 votes
1 answer

Hadoop Spark: What is version to find SparkSession in library Spark?

you need both core and SQL artifacts <repositories> ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,800 views
0 votes
1 answer

How to get started with Hadoop and do some development using Eclipse IDE?

Alright, there are couple of things that ...READ MORE

Apr 4, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,800 views
0 votes
2 answers

Load data into the hive table

Hi, We can use a normal insert query ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,440 points
1,798 views
0 votes
1 answer

PIG Error while loading file: -bash: syntax error near unexpected token `('

Since your data is delimited with tabs ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Ritu
1,797 views
0 votes
1 answer

Pig: Remove header line in csv file

Refer to the below file det.txt: Name,Age,Location a,10,chennai b,20,bangalore We will ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Yogi
1,797 views
0 votes
1 answer

Sqoop import where clause problem

The syntax you are using is wrong. ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,230 points
1,797 views
0 votes
1 answer

Zookeeper server going down frequently.

Hi@B, There may be several reasons behind this. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,440 points
1,791 views
0 votes
1 answer

What are the components in Pig

Hi, Yes, this is absolutely correct that pig ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,788 views
0 votes
1 answer

Does Hadoop and Spark support iPv6 now?

It does not. As of today HADOOP-11890, which ...READ MORE

Oct 15, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,787 views
0 votes
1 answer

Connection String for MySQL database using Sqoop

The format for the connection string and ...READ MORE

Jun 6, 2019 in Big Data Hadoop by John
1,782 views
0 votes
1 answer

What is the meaning of Write Ahead Log in Hadoop?

Write Ahead Log (WAL) is a file ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Sunil
1,778 views
0 votes
1 answer

GUI for using Hadoop

Hue is open source and works well ...READ MORE

Apr 24, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
1,773 views
0 votes
1 answer

Hbase installation Issue. Cant start HRegionServer and HQuorumPeer

It seems hbase did not start properly ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,772 views
0 votes
1 answer

How to exit name node from safe mode?

In order to forcefully let the namenode ...READ MORE

Sep 26, 2018 in Big Data Hadoop by slayer
• 29,350 points
1,765 views
0 votes
1 answer

How to change file format using Sqoop?

For change in the file format, you ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,764 views
0 votes
1 answer

Multiple Output format in Hadoop

Each reducer uses an OutputFormat to write ...READ MORE

Jul 26, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,760 views
0 votes
0 answers

What are the pros and cons of parquet format compared to other formats?

Hi Team, I am new to Hadoop I ...READ MORE

Dec 21, 2020 in Big Data Hadoop by akhtar
• 38,230 points
1,757 views
0 votes
1 answer

What is the difference between MapRed and MapReduce?

Firstly, we must learn that these are ...READ MORE

Mar 6, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,756 views
–1 vote
1 answer

WARN util.NativeCodeLoader: Unable to load native-hadoop library

To remove this warning, you can use:  hdfs ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,230 points
1,752 views
0 votes
1 answer

How to reduce shuffling cost in map reduce?

You can define a Combiner function, which does the ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,230 points
1,751 views
0 votes
1 answer

Hadoop Nodes for Multiple Disks

Datanodes can store blocks in multiple directories ...READ MORE

Jul 3, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
1,751 views
0 votes
1 answer

Hive: Revoke SELECT privilege from a Role

The following command can be used to ...READ MORE

May 31, 2019 in Big Data Hadoop by Shri
1,747 views
0 votes
1 answer

Unable to execute HDFS commands on the terminal

Maybe because you have not started hadoop ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,230 points
1,745 views
0 votes
1 answer

Access DFS through Java API

It is because, may be you are ...READ MORE

Mar 23, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,738 views
0 votes
1 answer

What is the PostgreSQL connection string for Sqoop?

The format of the connection string is: jdbc:postgresql://<HOST>:<PORT>/<DATABASE_NAME> You ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Kamal
1,735 views
0 votes
1 answer

Disable dynamic partition in hive

Dynamic partition is set to true by ...READ MORE

May 21, 2019 in Big Data Hadoop by Vishwa
1,729 views
0 votes
1 answer

what does velocity in big data mean?

Velocity refers to the speed at which ...READ MORE

Dec 14, 2021 in Big Data Hadoop by Edureka
• 12,690 points
1,710 views
+1 vote
1 answer

What are all the Data quality checks we do in our real time Big Data projects.

You can use a checksum to compare ...READ MORE

Sep 4, 2019 in Big Data Hadoop by Tina
1,710 views
0 votes
1 answer

Hadoop Command to merge edit logs with fsimage

You can use this command to save ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,710 views
0 votes
1 answer

How do I get connected to Hadoop and Geo Spatial connector?

There are a number of free and ...READ MORE

Aug 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,703 views
0 votes
1 answer

How to tune Spark jobs & optimize the performance?

You need to know the cluster properly ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
• 2,080 points
1,703 views
0 votes
1 answer

Setting Hive/Hadoop property using Hive Query

You can set Hadoop & Hive conf ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,699 views
0 votes
1 answer

Impala: Add months to current time

You can add the months using the add_months method ...READ MORE

Jun 6, 2019 in Big Data Hadoop by John
1,697 views