Latest questions in Big Data Hadoop

0 votes
1 answer

How to write mapper code for Hadoop in Python?

Hi@akhtar, Any job in Hadoop must have two ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,440 points
534 views
0 votes
1 answer

How to find the status of MapReduce Job?

Hi@akhtar, You can run the Hadoop Job command ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,440 points
643 views
0 votes
1 answer

Create hive table with location.

Hi@MD, We can also create a hive table ...READ MORE

Oct 16, 2020 in Big Data Hadoop by akhtar
• 38,230 points
413 views
0 votes
1 answer

How to create hive table without location?

Hi@akhtar, We can create a hive table for ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,440 points
879 views
0 votes
1 answer

Error: Could not create the Java Virtual Machine in Hadoop.

Hi@akhtar, You can list down all the files ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,440 points
1,804 views
0 votes
1 answer

How to update the existing record in HDFS?

Hi@akhtar, HDFS follows Write Once Read Many times ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
2,488 views
0 votes
1 answer

IOException: All datanodes are bad.

Hi@akhtar, As we know HDFS works in a ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
1,803 views
0 votes
1 answer

ERROR: Cannot set priority of datanode process

Hi@akhtar, You need to set JAVA_HOME and HADOOP_HOME ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
10,681 views
0 votes
1 answer

Checksum verification in Hadoop.

Hi@akhtar, Hadoop filesystem has Command to check the checksum ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
1,410 views
0 votes
1 answer

How to start Hadoop daemons?

Hi@MD, Before starting with the HDFS command, you have ...READ MORE

Oct 15, 2020 in Big Data Hadoop by akhtar
• 38,230 points

edited Oct 16, 2020 by akhtar 640 views
0 votes
1 answer

Enable HA for ranger KMS.

Hi, If you have installed Ranger through Ambari ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
525 views
0 votes
1 answer

HA ranger KMS ,

Hi@Shilpa, If you have installed Ranger through Ambari ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
582 views
0 votes
1 answer

How to store datasets from Pig to HDFS?

Hi Guys, You can store the loaded data ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
1,478 views
0 votes
1 answer

How to invoke the Grunt shell in MapReduce mode in Pig?

Hi@akhtar, You can invoke the Grunt shell in ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
506 views
0 votes
1 answer

How to load dataset in Pig?

Hi@akhtar, You can run the load command in ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
821 views
0 votes
1 answer

Execute the Pig script in Local mode.

Hi@akhtar, You can write an entire Pig Latin ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
327 views
0 votes
1 answer

How to start Grunt shell in Local mode in Pig?

Hi@akhtar, You can invoke the Grunt shell in ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
873 views
0 votes
1 answer

mkdir: cannot create directory `/var/run/hadoop': Permission denied.

Hi@akhtar, You need to set the path of ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
2,815 views
0 votes
1 answer

How to create an empty file in Hadoop?

Hi@akhtar, You can create an empty file in ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
12,385 views
0 votes
1 answer

How to remove the directory from HDFS?

Hi@akhtar, You can remove the directory using the ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
3,688 views
0 votes
1 answer

org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:54310/user/hduser/input.

Hi@akhtar, It seems you are providing the wrong ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
2,198 views
0 votes
1 answer

How to find the number of blocks for a file in Hadoop?

Hi@akhtar, You can use Hadoop file system command to ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
1,941 views
0 votes
1 answer

How to check the name of the hadoop server?

Hi@akhtar, If you're running a pseudo-distributed setup, you ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
1,922 views
0 votes
1 answer

Ranger kms create key failed

Hi@shllpa, I have checked your file. All seems ...READ MORE

Oct 6, 2020 in Big Data Hadoop by MD
• 95,440 points
1,425 views
0 votes
1 answer

How to view contents of file in hadoop hdfs?

Hi@akhtar, You can use the Hadoop filesystem command ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
7,485 views
0 votes
1 answer

How to find HDFS free space from command line?

Hi@akhtar, You can find the free space from ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
544 views
0 votes
1 answer

Where does Hive store files in HDFS?

Hi@akhtar, It depends on what you set in ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
688 views
+1 vote
1 answer

How to check a HDFS directory size?

Hi@akhtar, You can check the size of the ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
554 views
0 votes
1 answer

How to change the default replication factor in Hadoop?

Hi@akhtar, You can change the default replication factor from the ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,440 points
1,486 views
0 votes
1 answer

How to change default block size in Hadoop Cluster?

Hi@akhtar, You can change the default block size ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,440 points
1,973 views
0 votes
1 answer

Change the owner and group of a file in Hadoop.

Hi@akhtar, You can use the Chown command. This ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
7,616 views
0 votes
1 answer

Change permissions of a file in HDFS.

Hi@akhtar, You can use the Chmod command to ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
2,049 views
0 votes
1 answer

How to create a group in Hadoop?

Hi@akhtar, Generally, to create a group in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
922 views
0 votes
1 answer

How to append files from local system to HDFS?

Hi@akhtar, You can use appendToFile in your Hadoop ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
7,242 views
0 votes
1 answer

How to set replication factor in Hadoop?

Hi@akhtar, You can find setrep command in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
7,315 views
0 votes
1 answer

How to merge files in Hadoop?

Hi@akhtar, You can use getmerge command in Hadoop. ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
853 views
0 votes
1 answer

How to remove files from HDFS system?

Hi@akhtar, You will find rm command in your ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
22,295 views
0 votes
1 answer

Copy files in different folders in Hadoop.

Hi@akhtar, You can use the cp command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
31,591 views
0 votes
1 answer

How to copy files from HDFS to local system?

Hi@akhtar, You can use the put command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
3,884 views
0 votes
1 answer

Setting up Hadoop Multi-node cluster on windows 10 systems

Hi@Hassan, You can do it windows system as ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
1,670 views
0 votes
1 answer

Adding Ranger KMS server using ambari

Hi@Shllpa, It is asking for admin credentials. Did ...READ MORE

Sep 28, 2020 in Big Data Hadoop by MD
• 95,440 points
418 views
0 votes
1 answer

touchz: io.bytes.per.checksum(512) and blockSize(256) do not match. blockSize should be a multiple of io.bytes.per.checksum

Hi@akhtar, The default the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
671 views
0 votes
1 answer

touchz: java.io.IOException: java.lang.IllegalArgumentException: Unexpected value for the block size

Hi@akhtar, You are trying to create a block ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
698 views
0 votes
1 answer

How to change block size in Hadoop dynamically?

Hi@akhtar, By default, the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by akhtar
• 38,230 points
2,523 views
0 votes
1 answer

How to configure Hadoop Client?

Hi@akhtar, To configure the Hadoop Client, you need ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
2,282 views
0 votes
1 answer

How to upload files in Hadoop Cluster?

Hi@akhtar, To upload a file in Hadoop Cluster, ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
1,823 views
0 votes
1 answer

Usage: java FsShell [-put <localsrc> ... <dst>]

Hi@akhtar, You are trying to upload your file ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
581 views
0 votes
1 answer

How to connect Hadoop WebUI?

Hi@akhtar, You can connect your Hadoop Cluster with ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
564 views