Trending questions in Big Data Hadoop

+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
53,170 views
+1 vote
12 answers

How to check size of HDFS directory?

It is the same syntax. Use the ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Sowmya
31,384 views
+11 votes
11 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

modify the glibc version.CentOS provides safe softwares ...READ MORE

Sep 10, 2018 in Big Data Hadoop by bug_seeker
• 15,550 points
39,565 views
+1 vote
3 answers

What is the best way to merge multi-part HDFS files into single file?

1. In order to merge two or ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Tina
16,483 views
+1 vote
1 answer

ssh: connect to host localhost port 22: Connection refused in Hadoop.

Hi@akhtar, You need to uninstall SSH and reinstall ...READ MORE

Dec 18, 2020 in Big Data Hadoop by MD
• 95,180 points
1,562 views
0 votes
1 answer

What is the purpose of shuffling and sorting phase in the reducer in Map Reduce?

Hi@akhtar, Shuffle phase in Hadoop transfers the map output from ...READ MORE

Dec 20, 2020 in Big Data Hadoop by MD
• 95,180 points
560 views
0 votes
0 answers

What are the pros and cons of parquet format compared to other formats?

Hi Team, I am new to Hadoop I ...READ MORE

Dec 21, 2020 in Big Data Hadoop by akhtar
• 38,170 points
378 views
0 votes
0 answers

What is the difference between partitioning and bucketing a table in Hive ?

Hi Team, I am new to Hive. I ...READ MORE

Dec 20, 2020 in Big Data Hadoop by akhtar
• 38,170 points
295 views
0 votes
1 answer

How to show all partitions of a table in Hive?

Hi@akhtar, You can list down all the partitions ...READ MORE

Dec 18, 2020 in Big Data Hadoop by MD
• 95,180 points
303 views
0 votes
1 answer

I am getting this log4j:ERROR setFile(null,true) call failed. java.io.FileNotFoundException: /ozone.log (Read-only file system)

Hi@Raj, I think you need to provide permission ...READ MORE

Dec 4, 2020 in Big Data Hadoop by MD
• 95,180 points
891 views
0 votes
5 answers

What is the HDFS command to list all the files in HDFS according to the timestamp?

You can try filter using value in ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Lenny
37,200 views
0 votes
1 answer

How to use HDFStore to hold large datasets?

Hi@akhtar, You can store your datasets from pandas ...READ MORE

Dec 17, 2020 in Big Data Hadoop by MD
• 95,180 points
87 views
0 votes
2 answers

How to delete and update a record in Hive?

Hi, Earlier, there was no operation supported for ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
• 38,170 points
206 views
0 votes
0 answers

How to export all collections in MongoDB?

Hi Team, I have one database in MongoDB. ...READ MORE

Dec 17, 2020 in Big Data Hadoop by akhtar
• 38,170 points
72 views
0 votes
1 answer

Name node is in safe mode. Not able to leave

In order to forcefully let the namenode ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,870 points
190 views
0 votes
1 answer

Is there any way to get the column name along with the output while execute any query in Hive?

If we want to see the column ...READ MORE

Dec 8, 2020 in Big Data Hadoop by Gitika
• 65,870 points
117 views
0 votes
1 answer

How input splits are done when 2 blocks are spread across different nodes?

Hadoop doesn't copy the blocks to the ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,870 points
148 views
0 votes
2 answers

How to know Hive and Hadoop versions from command prompt?

Hi, Hadoop and hive have their individual commands. ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
• 38,170 points
216 views
0 votes
2 answers

How do I output the results of a HiveQL query to CSV?

Hi, The insert overwrite directory is running in ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
• 38,170 points
206 views
+1 vote
1 answer

How does Hadoop process records split across block boundaries?

Interesting question, I spent some time looking ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,870 points
71 views
0 votes
1 answer

Where does hive stores its table?

With an external table the data itself ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,870 points
97 views
0 votes
1 answer

How do I split a string on a delimiter in Bash?

You can set the internal field separator (IFS) variable, ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,870 points
95 views
+1 vote
1 answer

FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

Hi@akhtar, This issue generally occurs when the memory ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,180 points
10,006 views
0 votes
1 answer

How to set variables in HIVE scripts

You need to use the special hiveconf for variable ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,870 points
351 views
0 votes
1 answer

error: value update is not a member of scala.collection.immutable.Map[String, Int]

Yes, If you try to update the value of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,870 points
454 views
0 votes
1 answer

How can I import data from mysql to hive tables with incremental data?

Hi@dharmendra, It is common to perform one-time ingestion ...READ MORE

Nov 23, 2020 in Big Data Hadoop by MD
• 95,180 points
178 views
0 votes
1 answer

User:hdfs not allowed to do 'DECRYPT_EEK' on 'key'.

Hi@Shilpa, I don't think you have given permission ...READ MORE

Nov 20, 2020 in Big Data Hadoop by MD
• 95,180 points
250 views
+1 vote
1 answer

When to use Hadoop, HBase, Hive and Pig?

MapReduce is just a computing framework. HBase has ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,870 points
154 views
0 votes
1 answer

ERROR: Cannot set priority of datanode process

Hi@akhtar, You need to set JAVA_HOME and HADOOP_HOME ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,180 points
1,746 views
0 votes
1 answer

If i enable zookeeper secrete manager getting java file not found

Hey, @Shilpa, What did you set the ownership ...READ MORE

Nov 23, 2020 in Big Data Hadoop by Gitika
• 65,870 points
93 views
0 votes
1 answer

copyFromLocal: `/home/SANDHYA/downloads/game.csv': No such file or directory

Hi@Namrata, I think you are using the wrong ...READ MORE

Nov 19, 2020 in Big Data Hadoop by MD
• 95,180 points
192 views
0 votes
1 answer

Difference between Pig and Hive? Why have both? [closed]

The hive was designed to appeal to ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,870 points
80 views
0 votes
1 answer

How to use scala map as mutable map?

By default, Scala uses an immutable Map. ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,870 points
119 views
0 votes
1 answer

How to use scala Map size() method?

The size() is utilized to find the number of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,870 points
82 views
0 votes
1 answer

How to write a Scala program in script mode?

Open notepad and add the following code ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,870 points
95 views
0 votes
1 answer

How to execute scala programming?

We can execute a Scala program in ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,870 points
95 views
0 votes
1 answer

How to create Scala Maps?

Maps can be created in different ways ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,870 points
50 views
0 votes
1 answer

How to declare a variable in Scala?

The following is an example program that ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,870 points
79 views
0 votes
1 answer

How to import scala packages?

Scala packages can be imported so that ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,870 points
58 views
0 votes
1 answer

How to start working with scala?

Scala can be installed on any UNIX ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,870 points
58 views
0 votes
1 answer

How to create an objects using a keyword new?

Example import java.io._ class Point(val xc: Int, val yc: ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,870 points
55 views
0 votes
1 answer

Sqoop practice in Edureka VM

Hi, It is the same for all the ...READ MORE

Nov 16, 2020 in Big Data Hadoop by MD
• 95,180 points
70 views
0 votes
2 answers

Unable to start YARN daemons. Error: Could not find or load main class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager

Hi@Akshitha, This seems like a path issue. you ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,180 points
340 views
0 votes
1 answer

Zookeeper server going down frequently.

Hi@B, There may be several reasons behind this. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,180 points
149 views
0 votes
11 answers

What is the default Namenode port of HDFS. Is it 8020 or 9000 or 50070?

8020/9000 hadoop namenode metadata port number. or ...READ MORE

Dec 31, 2018 in Big Data Hadoop by SM
35,047 views
0 votes
1 answer

Moving historyserver to another instance using curl command

Hi@Shilpa, You have double quotes inside a single ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,180 points
107 views
0 votes
1 answer

HDP Upgrade Issue in 2.6.5.

Hi@B, There is a problem with the version. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,180 points
90 views
0 votes
1 answer

Validating HA for ranger KMS

Hi@Shilpa, It seems your user doesn't have the ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,180 points
102 views
0 votes
1 answer

Map reduce history moving instance using curl .

Hi@Shilpa, First thing, you will lose your metadata. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,180 points
86 views
+1 vote
1 answer

Not able to create kms key using ambari.

Hi@Shilpa, There may be a problem with your ...READ MORE

Nov 4, 2020 in Big Data Hadoop by MD
• 95,180 points
139 views