Trending questions in Big Data Hadoop

+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

Mar 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 47,792 views
+1 vote
12 answers

How to check size of HDFS directory?

It is the same syntax. Use the ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Sowmya
 • 28,744 views
+11 votes
11 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

modify the glibc version.CentOS provides safe softwares ...READ MORE

Sep 10, 2018 in Big Data Hadoop by bug_seeker
 • 15,550 points • 36,298 views
+1 vote
3 answers

What is the best way to merge multi-part HDFS files into single file?

1. In order to merge two or ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Tina
 • 14,475 views
+1 vote
1 answer

ssh: connect to host localhost port 22: Connection refused in Hadoop.

Hi@akhtar, You need to uninstall SSH and reinstall ...READ MORE

Dec 18, 2020 in Big Data Hadoop by MD
 • 95,060 points • 538 views
0 votes
1 answer

What is the purpose of shuffling and sorting phase in the reducer in Map Reduce?

Hi@akhtar, Shuffle phase in Hadoop transfers the map output from ...READ MORE

Dec 20, 2020 in Big Data Hadoop by MD
 • 95,060 points • 214 views
0 votes
0 answers

What are the pros and cons of parquet format compared to other formats?

Hi Team, I am new to Hadoop I ...READ MORE

Dec 21, 2020 in Big Data Hadoop by akhtar
 • 38,170 points • 124 views
0 votes
0 answers

What is the difference between partitioning and bucketing a table in Hive ?

Hi Team, I am new to Hive. I ...READ MORE

Dec 20, 2020 in Big Data Hadoop by akhtar
 • 38,170 points • 126 views
0 votes
1 answer

How to show all partitions of a table in Hive?

Hi@akhtar, You can list down all the partitions ...READ MORE

Dec 18, 2020 in Big Data Hadoop by MD
 • 95,060 points • 89 views
0 votes
1 answer

How to use HDFStore to hold large datasets?

Hi@akhtar, You can store your datasets from pandas ...READ MORE

Dec 17, 2020 in Big Data Hadoop by MD
 • 95,060 points • 48 views
0 votes
0 answers

How to export all collections in MongoDB?

Hi Team, I have one database in MongoDB. ...READ MORE

Dec 17, 2020 in Big Data Hadoop by akhtar
 • 38,170 points • 31 views
0 votes
2 answers

How to delete and update a record in Hive?

Hi, Earlier, there was no operation supported for ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
 • 38,170 points • 82 views
0 votes
1 answer

I am getting this log4j:ERROR setFile(null,true) call failed. java.io.FileNotFoundException: /ozone.log (Read-only file system)

Hi@Raj, I think you need to provide permission ...READ MORE

Dec 4, 2020 in Big Data Hadoop by MD
 • 95,060 points • 297 views
0 votes
1 answer

Is there any way to get the column name along with the output while execute any query in Hive?

If we want to see the column ...READ MORE

Dec 8, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 75 views
0 votes
1 answer

Name node is in safe mode. Not able to leave

In order to forcefully let the namenode ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 83 views
0 votes
1 answer

Where does hive stores its table?

With an external table the data itself ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 70 views
0 votes
1 answer

How do I split a string on a delimiter in Bash?

You can set the internal field separator (IFS) variable, ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 59 views
0 votes
1 answer

How input splits are done when 2 blocks are spread across different nodes?

Hadoop doesn't copy the blocks to the ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 44 views
0 votes
1 answer

How does Hadoop process records split across block boundaries?

Interesting question, I spent some time looking ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 44 views
0 votes
2 answers

How to know Hive and Hadoop versions from command prompt?

Hi, Hadoop and hive have their individual commands. ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
 • 38,170 points • 89 views
0 votes
2 answers

How do I output the results of a HiveQL query to CSV?

Hi, The insert overwrite directory is running in ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
 • 38,170 points • 81 views
0 votes
1 answer

How can I import data from mysql to hive tables with incremental data?

Hi@dharmendra, It is common to perform one-time ingestion ...READ MORE

Nov 23, 2020 in Big Data Hadoop by MD
 • 95,060 points • 107 views
0 votes
1 answer

If i enable zookeeper secrete manager getting java file not found

Hey, @Shilpa, What did you set the ownership ...READ MORE

Nov 23, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 65 views
+1 vote
1 answer

When to use Hadoop, HBase, Hive and Pig?

MapReduce is just a computing framework. HBase has ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 103 views
0 votes
1 answer

How to set variables in HIVE scripts

You need to use the special hiveconf for variable ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 139 views
0 votes
1 answer

User:hdfs not allowed to do 'DECRYPT_EEK' on 'key'.

Hi@Shilpa, I don't think you have given permission ...READ MORE

Nov 20, 2020 in Big Data Hadoop by MD
 • 95,060 points • 131 views
0 votes
1 answer

error: value update is not a member of scala.collection.immutable.Map[String, Int]

Yes, If you try to update the value of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 188 views
0 votes
1 answer

Difference between Pig and Hive? Why have both? [closed]

The hive was designed to appeal to ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 55 views
0 votes
1 answer

copyFromLocal: `/home/SANDHYA/downloads/game.csv': No such file or directory

Hi@Namrata, I think you are using the wrong ...READ MORE

Nov 19, 2020 in Big Data Hadoop by MD
 • 95,060 points • 116 views
0 votes
1 answer

How to use scala map as mutable map?

By default, Scala uses an immutable Map. ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 97 views
0 votes
1 answer

How to use scala Map size() method?

The size() is utilized to find the number of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 63 views
0 votes
1 answer

How to create Scala Maps?

Maps can be created in different ways ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 33 views
0 votes
1 answer

How to execute scala programming?

We can execute a Scala program in ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 69 views
0 votes
1 answer

How to write a Scala program in script mode?

Open notepad and add the following code ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 65 views
0 votes
1 answer

How to declare a variable in Scala?

The following is an example program that ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 53 views
0 votes
1 answer

How to create an objects using a keyword new?

Example import java.io._ class Point(val xc: Int, val yc: ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 39 views
0 votes
1 answer

How to import scala packages?

Scala packages can be imported so that ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 40 views
0 votes
1 answer

How to start working with scala?

Scala can be installed on any UNIX ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
 • 65,870 points • 38 views
0 votes
1 answer

Sqoop practice in Edureka VM

Hi, It is the same for all the ...READ MORE

Nov 16, 2020 in Big Data Hadoop by MD
 • 95,060 points • 42 views
0 votes
2 answers

Unable to start YARN daemons. Error: Could not find or load main class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager

Hi@Akshitha, This seems like a path issue. you ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
 • 95,060 points • 205 views
0 votes
1 answer

Zookeeper server going down frequently.

Hi@B, There may be several reasons behind this. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
 • 95,060 points • 101 views
0 votes
1 answer

Moving historyserver to another instance using curl command

Hi@Shilpa, You have double quotes inside a single ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
 • 95,060 points • 84 views
0 votes
1 answer

HDP Upgrade Issue in 2.6.5.

Hi@B, There is a problem with the version. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
 • 95,060 points • 66 views
0 votes
1 answer

Validating HA for ranger KMS

Hi@Shilpa, It seems your user doesn't have the ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
 • 95,060 points • 74 views
0 votes
1 answer

Map reduce history moving instance using curl .

Hi@Shilpa, First thing, you will lose your metadata. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
 • 95,060 points • 65 views
+1 vote
1 answer

Not able to create kms key using ambari.

Hi@Shilpa, There may be a problem with your ...READ MORE

Nov 4, 2020 in Big Data Hadoop by MD
 • 95,060 points • 101 views
0 votes
1 answer

ERROR: Cannot set priority of datanode process

Hi@akhtar, You need to set JAVA_HOME and HADOOP_HOME ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
 • 95,060 points • 870 views
0 votes
1 answer

mkdir: cannot create directory `/var/run/hadoop': Permission denied.

Hi@akhtar, You need to set the path of ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
 • 95,060 points • 496 views
0 votes
1 answer

Ranger Kms having multiple instance enabled.

Hi@Shllpa, First, you need to check the network ...READ MORE

Oct 23, 2020 in Big Data Hadoop by MD
 • 95,060 points • 111 views
+1 vote
1 answer

How to copy file from Local file system to HDFS?

Hi@akhtar, You can copy files from your local ...READ MORE

Oct 19, 2020 in Big Data Hadoop by MD
 • 95,060 points • 205 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.