Most viewed questions in Big Data Hadoop

0 votes
0 answers

What are the pros and cons of parquet format compared to other formats?

Hi Team, I am new to Hadoop I ...READ MORE

Dec 21, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 2,309 views
0 votes
1 answer

Load data into teradata using sqoop

The general syntax to do this as ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Ritu
 • 2,309 views
0 votes
1 answer

JDBC to HiveServer2 connection in HTTPS mode with SSL enabled

To connect to HiveServer2 in HTTPS mode ...READ MORE

Jun 4, 2019 in Big Data Hadoop by Firoz
 • 2,309 views
0 votes
1 answer

What are the services running in Hadoop

Below are the services Running in Hadoop Hdfs  yarn mapreduce ozzie zookeeper hive hue hbase impala flume sqoop spark Depending ...READ MORE

Jun 24, 2019 in Big Data Hadoop by deepak
 • 2,305 views
0 votes
1 answer

Sqoop import gives error: org.apache.hadoop.security.AccessControlException: Permission denied

Seems like you are not passing the ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,280 views
0 votes
1 answer

Can you please help with Hive Query to get FirstName, MiddleName, LastName and Suffix from FullName in Hive. Thank you

Hey, You can get first name, middle name, ...READ MORE

May 15, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited May 15, 2019 by Gitika • 2,279 views
0 votes
1 answer

How do we authenticate user from http.signature.secret file?

hadoop.http.authentication.signature.secret.file: The signature secret file for signing ...READ MORE

Apr 24, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,277 views
0 votes
1 answer

ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Cannot run program "hive": error=2, No such file or directory

The tables look fine. Follow these steps ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Kiran
 • 2,273 views
0 votes
1 answer

How to upload files in Hadoop Cluster?

Hi@akhtar, To upload a file in Hadoop Cluster, ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
 • 95,460 points • 2,269 views
+1 vote
1 answer

Unable to load data in Hbase table from dataset

Try these steps (make necessary changes): First upload ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,269 views
0 votes
1 answer

How to reduce shuffling cost in map reduce?

You can define a Combiner function, which does the ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,268 views
0 votes
1 answer

What is the meaning of Write Ahead Log in Hadoop?

Write Ahead Log (WAL) is a file ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Sunil
 • 2,268 views
0 votes
1 answer

Getting error message on execution of sqoop command to list database

Please use the sqoop list database syntax ...READ MORE

May 23, 2019 in Big Data Hadoop by Rashmi
 • 2,267 views
0 votes
1 answer

Sqoop import where clause problem

The syntax you are using is wrong. ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,263 views
0 votes
1 answer

Namenode not getting started

You need to delete the contents of the ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 2,262 views
0 votes
1 answer

Iterate twice on values (MapReduce)

We have to cache the values from ...READ MORE

Oct 1, 2018 in Big Data Hadoop by digger
 • 26,740 points • 2,261 views
0 votes
1 answer

Hbase installation Issue. Cant start HRegionServer and HQuorumPeer

It seems hbase did not start properly ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,256 views
0 votes
1 answer

How to change file format using Sqoop?

For change in the file format, you ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,252 views
+2 votes
1 answer

Is Kafka and Zookeeper are required in a Big Data Cluster?

Apache Kafka is one of the components ...READ MORE

Mar 23, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,248 views
0 votes
1 answer

Distcp From Local to HDFS giving error file not found

Hey, @Amey, This is probably because of a ...READ MORE

Apr 29, 2020 in Big Data Hadoop by Gitika
 • 65,770 points • 2,245 views
0 votes
1 answer

How to load multiple tables in Sqoop?

U can use " import-all-tables " option ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,243 views
0 votes
1 answer

How to delete hdfs folder from java app?

Try this: Configuration conf = new Configuration(); ...READ MORE

Oct 30, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,242 views
0 votes
1 answer

Cant access file from Hive. permission denied

There are two possible reasons for this: Wrong ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,241 views
0 votes
1 answer

Hadoop sqoop import not working. Error: ERROR manager.SqlManager: Error reading from database

In the command, try mentioning the driver ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,241 views
0 votes
1 answer

How can we send data from MongoDB to Hadoop?

The MongoDB Connector for Hadoop reads data ...READ MORE

Mar 27, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,235 views
0 votes
1 answer

How to add a column in Hive table?

Hi@akhtar, You can use the alter table command ...READ MORE

Oct 19, 2020 in Big Data Hadoop by MD
 • 95,460 points • 2,232 views
0 votes
1 answer

How do I join 2 tables in PIG using 2 fields?

Here, we have two tables: Tab1 having columns ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,231 views
0 votes
1 answer

Impala: Add months to current time

You can add the months using the add_months method ...READ MORE

Jun 6, 2019 in Big Data Hadoop by John
 • 2,229 views
0 votes
1 answer

Disable dynamic partition in hive

Dynamic partition is set to true by ...READ MORE

May 21, 2019 in Big Data Hadoop by Vishwa
 • 2,228 views
0 votes
1 answer

Unable to Locate WinUtils Library in Hadoop binary path.

If you are facing this problem while running a ...READ MORE

Jul 11, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 2,227 views
0 votes
1 answer

Connection String for MySQL database using Sqoop

The format for the connection string and ...READ MORE

Jun 6, 2019 in Big Data Hadoop by John
 • 2,214 views
0 votes
1 answer

Difference between root of hdfs and local machine

The command hdfs dfs -put command is used to ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Mahi
 • 2,211 views
0 votes
1 answer

Setting Hive/Hadoop property using Hive Query

You can set Hadoop & Hive conf ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,207 views
0 votes
1 answer

How do I connect my Spark based HDInsight cluster to my blob storage?

Go through this blog: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-use-blob-storage#access-blobs I went through this ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,200 views
0 votes
1 answer

What happens in a MapReduce job when you set the number of reducers to one?

If you set number of reducers as ...READ MORE

Jul 31, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,198 views
0 votes
1 answer

Hadoop Command to merge edit logs with fsimage

You can use this command to save ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,192 views
0 votes
1 answer

How data distribution is done in Hadoop?

To understand how or what are the process ...READ MORE

Apr 4, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 2,187 views
0 votes
1 answer

What is the PostgreSQL connection string for Sqoop?

The format of the connection string is: jdbc:postgresql://<HOST>:<PORT>/<DATABASE_NAME> You ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Kamal
 • 2,178 views
0 votes
1 answer

Getting error in MapReduce job.setInputFormatClass

In old Hadoop API(i.e. below Hadoop 0.20.0), ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,178 views
+1 vote
1 answer

When I try to execute any Hadoop commands error pops up saying unable to find or load main class M

The error might be due to the ...READ MORE

Jul 17, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,175 views
0 votes
1 answer

Does Hadoop and Spark support iPv6 now?

It does not. As of today HADOOP-11890, which ...READ MORE

Oct 15, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,172 views
0 votes
1 answer

Pig: Remove header line in csv file

Refer to the below file det.txt: Name,Age,Location a,10,chennai b,20,bangalore We will ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Yogi
 • 2,171 views
0 votes
1 answer

What are the components in Pig

Hi, Yes, this is absolutely correct that pig ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 2,167 views
0 votes
1 answer

Hive: Revoke SELECT privilege from a Role

The following command can be used to ...READ MORE

May 31, 2019 in Big Data Hadoop by Shri
 • 2,163 views
0 votes
1 answer

Hadoop vs Data Lake

A data lake is a storage repository that holds ...READ MORE

Mar 26, 2018 in Big Data Hadoop by Ashish
 • 2,650 points • 2,160 views
0 votes
1 answer

Is there any way to get the column name along with the output while execute any query in Hive?

If we want to see the column ...READ MORE

Dec 8, 2020 in Big Data Hadoop by Gitika
 • 65,770 points • 2,158 views
0 votes
1 answer

How to exit name node from safe mode?

In order to forcefully let the namenode ...READ MORE

Sep 26, 2018 in Big Data Hadoop by slayer
 • 29,370 points • 2,156 views
0 votes
1 answer

How to find hadoop distribution and version?

Just Use the command Hadoop version ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points
edited Apr 6, 2018 by kurt_cobain • 2,155 views
0 votes
1 answer

I have installed Hadoop on Ubuntu but name node is not running.

If you are using Hadoop version-2.7.7, then ...READ MORE

Apr 30, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 2,153 views
0 votes
1 answer

Which of the following is not a hadoop output format?

The Hadoop Output Format checks the Output ...READ MORE

Dec 20, 2021 in Big Data Hadoop by Kavya
 • 700 points • 2,152 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.