Trending questions in Big Data Hadoop

+1 vote
1 answer

How does Hadoop process records split across block boundaries?

Interesting question, I spent some time looking ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,910 points
455 views
0 votes
1 answer

mkdir: cannot create directory `/var/run/hadoop': Permission denied.

Hi@akhtar, You need to set the path of ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
2,816 views
0 votes
1 answer

How can I import data from mysql to hive tables with incremental data?

Hi@dharmendra, It is common to perform one-time ingestion ...READ MORE

Nov 23, 2020 in Big Data Hadoop by MD
• 95,440 points
1,044 views
+1 vote
1 answer

How to copy file from Local file system to HDFS?

Hi@akhtar, You can copy files from your local ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,440 points
2,443 views
0 votes
1 answer

copyFromLocal: `/home/SANDHYA/downloads/game.csv': No such file or directory

Hi@Namrata, I think you are using the wrong ...READ MORE

Nov 19, 2020 in Big Data Hadoop by MD
• 95,440 points
1,079 views
0 votes
1 answer

How to update the existing record in HDFS?

Hi@akhtar, HDFS follows Write Once Read Many times ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
2,488 views
+1 vote
1 answer

When to use Hadoop, HBase, Hive and Pig?

MapReduce is just a computing framework. HBase has ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,910 points
760 views
0 votes
1 answer

How to write a Scala program in script mode?

Open notepad and add the following code ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,910 points
853 views
0 votes
1 answer

org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:54310/user/hduser/input.

Hi@akhtar, It seems you are providing the wrong ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
2,200 views
0 votes
1 answer

How to use scala Map size() method?

The size() is utilized to find the number of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,910 points
673 views
0 votes
1 answer

If i enable zookeeper secrete manager getting java file not found

Hey, @Shilpa, What did you set the ownership ...READ MORE

Nov 23, 2020 in Big Data Hadoop by Gitika
• 65,910 points
432 views
0 votes
1 answer

How to use scala map as mutable map?

By default, Scala uses an immutable Map. ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,910 points
566 views
0 votes
1 answer

How to execute scala programming?

We can execute a Scala program in ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,910 points
601 views
0 votes
1 answer

Difference between Pig and Hive? Why have both? [closed]

The hive was designed to appeal to ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,910 points
411 views
0 votes
1 answer

Sqoop practice in Edureka VM

Hi, It is the same for all the ...READ MORE

Nov 16, 2020 in Big Data Hadoop by MD
• 95,440 points
516 views
0 votes
13 answers

What is the difference between Hadoop/HDFS & HBase?

HDFS is a distributed file system whereas ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Arihar
• 160 points
32,331 views
0 votes
1 answer

How to import scala packages?

Scala packages can be imported so that ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,910 points
485 views
0 votes
1 answer

How to see the report of Hadoop Cluster from command line?

Hi@akhtar, You can see the report of Hadoop Cluster ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
2,762 views
0 votes
1 answer

How to find the number of blocks for a file in Hadoop?

Hi@akhtar, You can use Hadoop file system command to ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
1,943 views
0 votes
1 answer

How to check the name of the hadoop server?

Hi@akhtar, If you're running a pseudo-distributed setup, you ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
1,925 views
0 votes
1 answer

How to declare a variable in Scala?

The following is an example program that ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,910 points
452 views
0 votes
1 answer

Error: Could not create the Java Virtual Machine in Hadoop.

Hi@akhtar, You can list down all the files ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,440 points
1,804 views
0 votes
1 answer

IOException: All datanodes are bad.

Hi@akhtar, As we know HDFS works in a ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
1,806 views
0 votes
1 answer

How to create Scala Maps?

Maps can be created in different ways ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,910 points
379 views
0 votes
1 answer

How to create an objects using a keyword new?

Example import java.io._ class Point(val xc: Int, val yc: ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,910 points
393 views
0 votes
1 answer

How to start working with scala?

Scala can be installed on any UNIX ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,910 points
359 views
0 votes
1 answer

How to add a column in Hive table?

Hi@akhtar, You can use the alter table command ...READ MORE

Oct 19, 2020 in Big Data Hadoop by MD
• 95,440 points
1,574 views
0 votes
1 answer

Validating HA for ranger KMS

Hi@Shilpa, It seems your user doesn't have the ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,440 points
670 views
0 votes
1 answer

HDP Upgrade Issue in 2.6.5.

Hi@B, There is a problem with the version. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,440 points
647 views
0 votes
1 answer

How to change block size in Hadoop dynamically?

Hi@akhtar, By default, the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by akhtar
• 38,230 points
2,526 views
0 votes
1 answer

Moving historyserver to another instance using curl command

Hi@Shilpa, You have double quotes inside a single ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,440 points
562 views
0 votes
1 answer

Map reduce history moving instance using curl .

Hi@Shilpa, First thing, you will lose your metadata. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,440 points
569 views
+1 vote
1 answer

Not able to create kms key using ambari.

Hi@Shilpa, There may be a problem with your ...READ MORE

Nov 4, 2020 in Big Data Hadoop by MD
• 95,440 points
659 views
0 votes
1 answer

How to download hadoop jar files for adding eclipse

Hi@Manl, To import jar file in your Eclipse ...READ MORE

Jul 20, 2020 in Big Data Hadoop by MD
• 95,440 points
5,285 views
0 votes
1 answer

Change permissions of a file in HDFS.

Hi@akhtar, You can use the Chmod command to ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
2,051 views
0 votes
1 answer

How to store datasets from Pig to HDFS?

Hi Guys, You can store the loaded data ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
1,479 views
0 votes
1 answer

How to change default block size in Hadoop Cluster?

Hi@akhtar, You can change the default block size ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,440 points
1,975 views
0 votes
1 answer

How to configure Hadoop Client?

Hi@akhtar, To configure the Hadoop Client, you need ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
2,283 views
0 votes
1 answer

Checksum verification in Hadoop.

Hi@akhtar, Hadoop filesystem has Command to check the checksum ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
1,411 views
0 votes
1 answer

Ranger Kms having multiple instance enabled.

Hi@Shllpa, First, you need to check the network ...READ MORE

Oct 23, 2020 in Big Data Hadoop by MD
• 95,440 points
974 views
0 votes
1 answer

Drop an index from a Hive table.

Hi@akhtar, You can drop an index from the ...READ MORE

Oct 19, 2020 in Big Data Hadoop by MD
• 95,440 points
1,113 views
0 votes
1 answer

How to display the Access Control Lists (ACLs) of files and directories in HDFS?

Hi@akhtar, You can see the Access Control Lists (ACLs) ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,440 points
1,066 views
0 votes
1 answer

How to create an index on Hive table?

Hi@akhtar, An Index is nothing but a pointer ...READ MORE

Oct 19, 2020 in Big Data Hadoop by MD
• 95,440 points
1,017 views
0 votes
1 answer

How to get resource utilized(memory and CPU) by each hive query which is running under single application Id?

Hi@sivachandran, You can monitor the metrics of your ...READ MORE

Sep 18, 2020 in Big Data Hadoop by MD
• 95,440 points
2,332 views
0 votes
1 answer

Ranger kms is not coming up

Hi@Shilpa, There may be lots of reasons behind ...READ MORE

Oct 19, 2020 in Big Data Hadoop by MD
• 95,440 points
915 views
0 votes
1 answer

Setting up Hadoop Multi-node cluster on windows 10 systems

Hi@Hassan, You can do it windows system as ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
1,671 views
0 votes
1 answer

Ranger kms create key failed

Hi@shllpa, I have checked your file. All seems ...READ MORE

Oct 6, 2020 in Big Data Hadoop by MD
• 95,440 points
1,428 views
0 votes
1 answer

How to upload files in Hadoop Cluster?

Hi@akhtar, To upload a file in Hadoop Cluster, ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
1,824 views
0 votes
1 answer

How to change the default replication factor in Hadoop?

Hi@akhtar, You can change the default replication factor from the ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,440 points
1,486 views