Trending questions in Big Data Hadoop

+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
61,274 views
+1 vote
12 answers

How to check size of HDFS directory?

It is the same syntax. Use the ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Sowmya
34,104 views
+11 votes
11 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

modify the glibc version.CentOS provides safe softwares ...READ MORE

Sep 10, 2018 in Big Data Hadoop by bug_seeker
• 15,550 points
44,389 views
+1 vote
3 answers

What is the best way to merge multi-part HDFS files into single file?

1. In order to merge two or ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Tina
19,031 views
0 votes
5 answers

What is the HDFS command to list all the files in HDFS according to the timestamp?

You can try filter using value in ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Lenny
42,476 views
+1 vote
1 answer

ssh: connect to host localhost port 22: Connection refused in Hadoop.

Hi@akhtar, You need to uninstall SSH and reinstall ...READ MORE

Dec 18, 2020 in Big Data Hadoop by MD
• 95,300 points
2,882 views
+1 vote
1 answer

FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

Hi@akhtar, This issue generally occurs when the memory ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,300 points
13,441 views
0 votes
1 answer

ERROR 1142 (42000): SELECT command denied to user ''@'localhost' for table 'user'

Hey, This is a mysql command line error ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Gitika
• 65,950 points
26,048 views
0 votes
11 answers

What is the default Namenode port of HDFS. Is it 8020 or 9000 or 50070?

8020/9000 hadoop namenode metadata port number. or ...READ MORE

Dec 31, 2018 in Big Data Hadoop by SM
38,393 views
0 votes
1 answer

What is the purpose of shuffling and sorting phase in the reducer in Map Reduce?

Hi@akhtar, Shuffle phase in Hadoop transfers the map output from ...READ MORE

Dec 20, 2020 in Big Data Hadoop by MD
• 95,300 points
997 views
0 votes
1 answer

I am getting this log4j:ERROR setFile(null,true) call failed. java.io.FileNotFoundException: /ozone.log (Read-only file system)

Hi@Raj, I think you need to provide permission ...READ MORE

Dec 4, 2020 in Big Data Hadoop by MD
• 95,300 points
1,678 views
+1 vote
2 answers

How to delete and update a record in Hive?

Hi, Earlier, there was no operation supported for ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
• 38,210 points
931 views
0 votes
1 answer

How to show all partitions of a table in Hive?

Hi@akhtar, You can list down all the partitions ...READ MORE

Dec 18, 2020 in Big Data Hadoop by MD
• 95,300 points
770 views
0 votes
0 answers

What are the pros and cons of parquet format compared to other formats?

Hi Team, I am new to Hadoop I ...READ MORE

Dec 21, 2020 in Big Data Hadoop by akhtar
• 38,210 points
661 views
0 votes
0 answers

What is the difference between partitioning and bucketing a table in Hive ?

Hi Team, I am new to Hive. I ...READ MORE

Dec 20, 2020 in Big Data Hadoop by akhtar
• 38,210 points
560 views
0 votes
2 answers

How do I output the results of a HiveQL query to CSV?

Hi, The insert overwrite directory is running in ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
• 38,210 points
760 views
+1 vote
1 answer

How to use HDFStore to hold large datasets?

Hi@akhtar, You can store your datasets from pandas ...READ MORE

Dec 17, 2020 in Big Data Hadoop by MD
• 95,300 points
179 views
+1 vote
0 answers

How to export all collections in MongoDB?

Hi Team, I have one database in MongoDB. ...READ MORE

Dec 17, 2020 in Big Data Hadoop by akhtar
• 38,210 points
129 views
0 votes
1 answer

ERROR: Cannot set priority of datanode process

Hi@akhtar, You need to set JAVA_HOME and HADOOP_HOME ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,300 points
2,724 views
0 votes
2 answers

How to know Hive and Hadoop versions from command prompt?

Hi, Hadoop and hive have their individual commands. ...READ MORE

Dec 18, 2020 in Big Data Hadoop by akhtar
• 38,210 points
451 views
0 votes
1 answer

Name node is in safe mode. Not able to leave

In order to forcefully let the namenode ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,950 points
310 views
0 votes
1 answer

Is there any way to get the column name along with the output while execute any query in Hive?

If we want to see the column ...READ MORE

Dec 8, 2020 in Big Data Hadoop by Gitika
• 65,950 points
171 views
0 votes
1 answer

How to set variables in HIVE scripts

You need to use the special hiveconf for variable ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,950 points
925 views
0 votes
1 answer

How input splits are done when 2 blocks are spread across different nodes?

Hadoop doesn't copy the blocks to the ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,950 points
186 views
+1 vote
1 answer

How does Hadoop process records split across block boundaries?

Interesting question, I spent some time looking ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,950 points
107 views
0 votes
1 answer

Where does hive stores its table?

With an external table the data itself ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,950 points
134 views
0 votes
1 answer

How do I split a string on a delimiter in Bash?

You can set the internal field separator (IFS) variable, ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,950 points
132 views
0 votes
1 answer

error: value update is not a member of scala.collection.immutable.Map[String, Int]

Yes, If you try to update the value of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,950 points
948 views
0 votes
1 answer

User:hdfs not allowed to do 'DECRYPT_EEK' on 'key'.

Hi@Shilpa, I don't think you have given permission ...READ MORE

Nov 20, 2020 in Big Data Hadoop by MD
• 95,300 points
430 views
0 votes
1 answer

How can I import data from mysql to hive tables with incremental data?

Hi@dharmendra, It is common to perform one-time ingestion ...READ MORE

Nov 23, 2020 in Big Data Hadoop by MD
• 95,300 points
260 views
0 votes
1 answer

How to create an empty file in Hadoop?

Hi@akhtar, You can create an empty file in ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,300 points
1,944 views
+1 vote
1 answer

When to use Hadoop, HBase, Hive and Pig?

MapReduce is just a computing framework. HBase has ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,950 points
212 views
0 votes
1 answer

copyFromLocal: `/home/SANDHYA/downloads/game.csv': No such file or directory

Hi@Namrata, I think you are using the wrong ...READ MORE

Nov 19, 2020 in Big Data Hadoop by MD
• 95,300 points
281 views
0 votes
1 answer

If i enable zookeeper secrete manager getting java file not found

Hey, @Shilpa, What did you set the ownership ...READ MORE

Nov 23, 2020 in Big Data Hadoop by Gitika
• 65,950 points
126 views
0 votes
1 answer

Difference between Pig and Hive? Why have both? [closed]

The hive was designed to appeal to ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,950 points
103 views
0 votes
1 answer

How to use scala map as mutable map?

By default, Scala uses an immutable Map. ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,950 points
152 views
0 votes
2 answers

Unable to start YARN daemons. Error: Could not find or load main class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager

Hi@Akshitha, This seems like a path issue. you ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,300 points
513 views
0 votes
1 answer

How to write a Scala program in script mode?

Open notepad and add the following code ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,950 points
171 views
0 votes
1 answer

How to use scala Map size() method?

The size() is utilized to find the number of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,950 points
116 views
0 votes
1 answer

How to execute scala programming?

We can execute a Scala program in ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,950 points
134 views
0 votes
1 answer

How to create Scala Maps?

Maps can be created in different ways ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,950 points
75 views
0 votes
1 answer

How to declare a variable in Scala?

The following is an example program that ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,950 points
110 views
0 votes
1 answer

Sqoop practice in Edureka VM

Hi, It is the same for all the ...READ MORE

Nov 16, 2020 in Big Data Hadoop by MD
• 95,300 points
114 views
0 votes
1 answer

How to import scala packages?

Scala packages can be imported so that ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,950 points
95 views
0 votes
1 answer

How to start working with scala?

Scala can be installed on any UNIX ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,950 points
91 views
0 votes
1 answer

How to create an objects using a keyword new?

Example import java.io._ class Point(val xc: Int, val yc: ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,950 points
77 views
0 votes
1 answer

Zookeeper server going down frequently.

Hi@B, There may be several reasons behind this. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,300 points
239 views
0 votes
1 answer

Copy files in different folders in Hadoop.

Hi@akhtar, You can use the cp command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,300 points
1,843 views
0 votes
1 answer

Moving historyserver to another instance using curl command

Hi@Shilpa, You have double quotes inside a single ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,300 points
142 views