Trending questions in Big Data Hadoop

+1 vote
1 answer

How does Hadoop process records split across block boundaries?

Interesting question, I spent some time looking ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,910 points
459 views
0 votes
1 answer

mkdir: cannot create directory `/var/run/hadoop': Permission denied.

Hi@akhtar, You need to set the path of ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
2,825 views
0 votes
1 answer

How can I import data from mysql to hive tables with incremental data?

Hi@dharmendra, It is common to perform one-time ingestion ...READ MORE

Nov 23, 2020 in Big Data Hadoop by MD
• 95,440 points
1,050 views
+1 vote
1 answer

How to copy file from Local file system to HDFS?

Hi@akhtar, You can copy files from your local ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,440 points
2,455 views
0 votes
1 answer

copyFromLocal: `/home/SANDHYA/downloads/game.csv': No such file or directory

Hi@Namrata, I think you are using the wrong ...READ MORE

Nov 19, 2020 in Big Data Hadoop by MD
• 95,440 points
1,085 views
0 votes
1 answer

How to update the existing record in HDFS?

Hi@akhtar, HDFS follows Write Once Read Many times ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
2,503 views
+1 vote
1 answer

When to use Hadoop, HBase, Hive and Pig?

MapReduce is just a computing framework. HBase has ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,910 points
766 views
0 votes
1 answer

How to write a Scala program in script mode?

Open notepad and add the following code ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,910 points
861 views
0 votes
1 answer

org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:54310/user/hduser/input.

Hi@akhtar, It seems you are providing the wrong ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
2,207 views
0 votes
1 answer

How to use scala Map size() method?

The size() is utilized to find the number of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,910 points
685 views
0 votes
1 answer

If i enable zookeeper secrete manager getting java file not found

Hey, @Shilpa, What did you set the ownership ...READ MORE

Nov 23, 2020 in Big Data Hadoop by Gitika
• 65,910 points
441 views
0 votes
1 answer

How to use scala map as mutable map?

By default, Scala uses an immutable Map. ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,910 points
573 views
0 votes
1 answer

How to execute scala programming?

We can execute a Scala program in ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,910 points
605 views
0 votes
1 answer

Difference between Pig and Hive? Why have both? [closed]

The hive was designed to appeal to ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,910 points
416 views
0 votes
13 answers

What is the difference between Hadoop/HDFS & HBase?

HDFS is a distributed file system whereas ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Arihar
• 160 points
32,382 views
0 votes
1 answer

Sqoop practice in Edureka VM

Hi, It is the same for all the ...READ MORE

Nov 16, 2020 in Big Data Hadoop by MD
• 95,440 points
519 views
0 votes
1 answer

How to see the report of Hadoop Cluster from command line?

Hi@akhtar, You can see the report of Hadoop Cluster ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
2,781 views
0 votes
1 answer

How to import scala packages?

Scala packages can be imported so that ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,910 points
490 views
0 votes
1 answer

How to find the number of blocks for a file in Hadoop?

Hi@akhtar, You can use Hadoop file system command to ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
1,957 views
0 votes
1 answer

How to check the name of the hadoop server?

Hi@akhtar, If you're running a pseudo-distributed setup, you ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
1,938 views
0 votes
1 answer

How to declare a variable in Scala?

The following is an example program that ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,910 points
455 views
0 votes
1 answer

Error: Could not create the Java Virtual Machine in Hadoop.

Hi@akhtar, You can list down all the files ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,440 points
1,815 views
0 votes
1 answer

IOException: All datanodes are bad.

Hi@akhtar, As we know HDFS works in a ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
1,818 views
0 votes
1 answer

How to create Scala Maps?

Maps can be created in different ways ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,910 points
383 views
0 votes
1 answer

How to create an objects using a keyword new?

Example import java.io._ class Point(val xc: Int, val yc: ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,910 points
397 views
0 votes
1 answer

How to start working with scala?

Scala can be installed on any UNIX ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,910 points
363 views
0 votes
1 answer

How to add a column in Hive table?

Hi@akhtar, You can use the alter table command ...READ MORE

Oct 19, 2020 in Big Data Hadoop by MD
• 95,440 points
1,585 views
0 votes
1 answer

Validating HA for ranger KMS

Hi@Shilpa, It seems your user doesn't have the ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,440 points
674 views
0 votes
1 answer

HDP Upgrade Issue in 2.6.5.

Hi@B, There is a problem with the version. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,440 points
651 views
0 votes
1 answer

How to change block size in Hadoop dynamically?

Hi@akhtar, By default, the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by akhtar
• 38,230 points
2,544 views
0 votes
1 answer

Moving historyserver to another instance using curl command

Hi@Shilpa, You have double quotes inside a single ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,440 points
574 views
0 votes
1 answer

Map reduce history moving instance using curl .

Hi@Shilpa, First thing, you will lose your metadata. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,440 points
577 views
+1 vote
1 answer

Not able to create kms key using ambari.

Hi@Shilpa, There may be a problem with your ...READ MORE

Nov 4, 2020 in Big Data Hadoop by MD
• 95,440 points
662 views
0 votes
1 answer

How to download hadoop jar files for adding eclipse

Hi@Manl, To import jar file in your Eclipse ...READ MORE

Jul 20, 2020 in Big Data Hadoop by MD
• 95,440 points
5,301 views
0 votes
1 answer

Change permissions of a file in HDFS.

Hi@akhtar, You can use the Chmod command to ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
2,064 views
0 votes
1 answer

How to store datasets from Pig to HDFS?

Hi Guys, You can store the loaded data ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
1,488 views
0 votes
1 answer

How to change default block size in Hadoop Cluster?

Hi@akhtar, You can change the default block size ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,440 points
1,994 views
0 votes
1 answer

How to configure Hadoop Client?

Hi@akhtar, To configure the Hadoop Client, you need ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
2,294 views
0 votes
1 answer

Checksum verification in Hadoop.

Hi@akhtar, Hadoop filesystem has Command to check the checksum ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
1,416 views
0 votes
1 answer

Ranger Kms having multiple instance enabled.

Hi@Shllpa, First, you need to check the network ...READ MORE

Oct 23, 2020 in Big Data Hadoop by MD
• 95,440 points
988 views
0 votes
1 answer

How to display the Access Control Lists (ACLs) of files and directories in HDFS?

Hi@akhtar, You can see the Access Control Lists (ACLs) ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,440 points
1,082 views
0 votes
1 answer

Drop an index from a Hive table.

Hi@akhtar, You can drop an index from the ...READ MORE

Oct 19, 2020 in Big Data Hadoop by MD
• 95,440 points
1,122 views
0 votes
1 answer

How to create an index on Hive table?

Hi@akhtar, An Index is nothing but a pointer ...READ MORE

Oct 19, 2020 in Big Data Hadoop by MD
• 95,440 points
1,030 views
0 votes
1 answer

How to get resource utilized(memory and CPU) by each hive query which is running under single application Id?

Hi@sivachandran, You can monitor the metrics of your ...READ MORE

Sep 18, 2020 in Big Data Hadoop by MD
• 95,440 points
2,338 views
0 votes
1 answer

Ranger kms is not coming up

Hi@Shilpa, There may be lots of reasons behind ...READ MORE

Oct 19, 2020 in Big Data Hadoop by MD
• 95,440 points
922 views
0 votes
1 answer

Setting up Hadoop Multi-node cluster on windows 10 systems

Hi@Hassan, You can do it windows system as ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
1,678 views
0 votes
1 answer

Ranger kms create key failed

Hi@shllpa, I have checked your file. All seems ...READ MORE

Oct 6, 2020 in Big Data Hadoop by MD
• 95,440 points
1,438 views
0 votes
1 answer

How to upload files in Hadoop Cluster?

Hi@akhtar, To upload a file in Hadoop Cluster, ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
1,830 views
0 votes
1 answer

How to change the default replication factor in Hadoop?

Hi@akhtar, You can change the default replication factor from the ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,440 points
1,496 views