Most viewed questions in Big Data Hadoop

0 votes
1 answer

What is the command to find the free space in HDFS?

You can use dfsadmin which runs a ...READ MORE

Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,454 views
0 votes
1 answer

How to perform a word count on a dataframe column?

You can use the below code to ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,453 views
0 votes
1 answer

Zookeeper Quorum value: zookeeper.ClientCnxn: Client session timed out

Enter the below command on the Web ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,443 views
0 votes
1 answer

Does setup & clean methods in Hadoop MapReduce is executed after each task?

Setup & cleanup methods are executed after ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,441 views
0 votes
1 answer

Sqoop error while importing data from MySql

As the error states, the target directory ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,440 views
0 votes
1 answer

What are the five v's of big data

Big data is a collection of data ...READ MORE

Feb 4, 2022 in Big Data Hadoop by surbhi
• 3,820 points
2,435 views
0 votes
1 answer

How to use mountable HDFS on Centos?

Hey. You can use the following commands ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,434 views
0 votes
1 answer

NameNode Status Check

There's one more way of checking the ...READ MORE

Jun 18, 2018 in Big Data Hadoop by shams
• 3,670 points
2,427 views
0 votes
1 answer

Error: Could not create the Java Virtual Machine in Hadoop.

Hi@akhtar, You can list down all the files ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,460 points
2,423 views
0 votes
1 answer

Why CREATE EXTERNAL keyword is used in Hive?

Hey, The create external keyword is used to create a ...READ MORE

May 15, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,418 views
–1 vote
1 answer

Getting error while starting hdfs namenode -format

Check your /etc/hosts file, the format should be like ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,417 views
0 votes
0 answers

ava.sql.SQLException: Error while processing statement:

Hi everyone, I am facing one issue ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Hemanth
• 250 points

edited Aug 7, 2019 by Omkar 2,414 views
0 votes
1 answer

com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

Sqoop is not able to communicate with ...READ MORE

Jan 29, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,405 views
–1 vote
1 answer

How many FSimage files will be created in hard disk?

In Hdfs, data and metadata are decoupled. ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,404 views
0 votes
1 answer

Query regarding String and Varchar in Hive

Varchar datatype is also saved internally as ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,401 views
0 votes
1 answer

What is the best way to integrate SAS with Hadoop without losing the parallel processing capacity of Hadoop

One of the major pushes at SAS ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,399 views
0 votes
1 answer

How to get started with Hadoop and do some development using Eclipse IDE?

Alright, there are couple of things that ...READ MORE

Apr 4, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,390 views
–1 vote
1 answer

How to use multiple spark version?

You can use the  SPARK_MAJOR_VERSION for this. Suppose ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,384 views
0 votes
1 answer

Hive Execution Engine

The default execution engine for Hive is mr. To ...READ MORE

Jun 4, 2019 in Big Data Hadoop by Varun
2,383 views
0 votes
1 answer

Hadoop: error: Cannot lock storage /app/hadoop/tmp/dfs/name. The directory is already locked.

Hi, Check your dfs.name.dir and dfs.data.dir path in hdfs-site.xml. Or ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,381 views
+1 vote
1 answer

How to print data without brackets using PIG Dump?

Please refer to the below commands: student = ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,378 views
0 votes
1 answer

Name node is in safe mode. Not able to leave

In order to forcefully let the namenode ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,770 points
2,376 views
0 votes
1 answer

What Distributed Cache is actually used for in Hadoop?

Basically distributed cache allows you to cache ...READ MORE

Apr 3, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,376 views
0 votes
1 answer

How to create initial database without using Hive schema tool?

Hey, If for some reason you decide not ...READ MORE

May 29, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,370 views
+1 vote
1 answer

Information Unavailable:Running jps command in Hadoop

Hi, I think this is because the process ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
2,369 views
0 votes
1 answer

How to use data compression in sqoop import?

You can enable data compression from the ...READ MORE

May 15, 2019 in Big Data Hadoop by Rocky
2,368 views
+1 vote
1 answer

Hadoop: Using composite-key

You can use a Writable, something like ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,367 views
0 votes
1 answer

Getting error in JAVA_HOME variable.

First of all check the hadoop version ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,366 views
0 votes
1 answer

Which data type is used to store the data in HBase table column?

Hey, Byte Array,  Put p = new Put(Bytes.toBytes("John Smith")); All ...READ MORE

May 29, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,365 views
0 votes
1 answer

How to run Hadoop 2.1.0 in Windows System?

Same problem but with recent Hadoop v. ...READ MORE

Sep 11, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,358 views
0 votes
2 answers

Load data into the hive table

Hi, We can use a normal insert query ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,460 points
2,358 views
0 votes
1 answer

When is an identity mapper/reducer used?

1.One of the simplest example of Iterative ...READ MORE

Apr 3, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,356 views
0 votes
1 answer

IOException: All datanodes are bad.

Hi@akhtar, As we know HDFS works in a ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,460 points
2,355 views
0 votes
1 answer

Configuring JDBC Clients for LDAP Authentication with HiveServer2

JDBC client requires a connection URL as ...READ MORE

Jun 3, 2019 in Big Data Hadoop by Raman
2,352 views
0 votes
1 answer

Installing Spark on Windows

Follow the below steps to install Spark ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,351 views
0 votes
1 answer

Sqoop: Oracle Connection String

The format for connection string for Oracle ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Varun
2,349 views
0 votes
2 answers

How to set up Map and Reduce Tasks?

Hi, The number of map tasks for a ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Rashi
2,343 views
0 votes
1 answer

How do I get connected to Hadoop and Geo Spatial connector?

There are a number of free and ...READ MORE

Aug 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,339 views
0 votes
1 answer

Is there any way to include a python package with Hadoop streaming job?

See I don't know the answer to ...READ MORE

May 10, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,330 views
0 votes
1 answer

Unable to execute HDFS commands on the terminal

Maybe because you have not started hadoop ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,327 views
0 votes
1 answer

Not able to start namenode with ./start-all.sh

Try this: stop all the daemons: ./stop-all.sh format the namenode: cd ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,327 views
0 votes
1 answer

Datanode not running on Hadoop-2.7.3

Hey, I solved this problem by removing hadoop ...READ MORE

Jun 14, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,326 views
0 votes
1 answer

How should I connect Hadoop in C#?

The Uri should be your Cluster Name, ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Neha
• 6,300 points
2,325 views
0 votes
2 answers

E0901: Namenode [localhost:8020] not allowed, not in Oozies whitelist

You can add this below property in oozie-site.xml: <property> <name>oozie.service.HadoopAccessorService.jobTracker.whitelist</name> <value>myaddress:8020</value> </property> Hope ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Shiva
2,324 views
0 votes
1 answer

What is the difference between MapRed and MapReduce?

Firstly, we must learn that these are ...READ MORE

Mar 6, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,320 views
0 votes
1 answer

Hadoop Spark: What is version to find SparkSession in library Spark?

you need both core and SQL artifacts <repositories> ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,317 views
0 votes
1 answer

Enabling TLS/SSL on Hive

To enable TLS/SSL on hive, you have ...READ MORE

May 31, 2019 in Big Data Hadoop by Haran
2,314 views
0 votes
1 answer

Explain to me how to get Hadoop configuration in Java Util.

In order to get access to the File ...READ MORE

May 24, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,311 views
0 votes
1 answer

PIG Error while loading file: -bash: syntax error near unexpected token `('

Since your data is delimited with tabs ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Ritu
2,310 views
0 votes
0 answers

What are the pros and cons of parquet format compared to other formats?

Hi Team, I am new to Hadoop I ...READ MORE

Dec 21, 2020 in Big Data Hadoop by akhtar
• 38,260 points
2,309 views