Most answered questions in Big Data Hadoop

0 votes
1 answer

How to store datasets from Pig to HDFS?

Hi Guys, You can store the loaded data ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
1,499 views
0 votes
1 answer

How to invoke the Grunt shell in MapReduce mode in Pig?

Hi@akhtar, You can invoke the Grunt shell in ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
515 views
0 votes
1 answer

How to load dataset in Pig?

Hi@akhtar, You can run the load command in ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
832 views
0 votes
1 answer

Execute the Pig script in Local mode.

Hi@akhtar, You can write an entire Pig Latin ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
334 views
0 votes
1 answer

How to start Grunt shell in Local mode in Pig?

Hi@akhtar, You can invoke the Grunt shell in ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
887 views
0 votes
1 answer

mkdir: cannot create directory `/var/run/hadoop': Permission denied.

Hi@akhtar, You need to set the path of ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
2,841 views
0 votes
1 answer

How to create an empty file in Hadoop?

Hi@akhtar, You can create an empty file in ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
12,468 views
0 votes
1 answer

How to remove the directory from HDFS?

Hi@akhtar, You can remove the directory using the ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
3,731 views
0 votes
1 answer

org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:54310/user/hduser/input.

Hi@akhtar, It seems you are providing the wrong ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
2,212 views
0 votes
1 answer

How to find the number of blocks for a file in Hadoop?

Hi@akhtar, You can use Hadoop file system command to ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
1,964 views
0 votes
1 answer

How to check the name of the hadoop server?

Hi@akhtar, If you're running a pseudo-distributed setup, you ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
1,951 views
0 votes
1 answer

Ranger kms create key failed

Hi@shllpa, I have checked your file. All seems ...READ MORE

Oct 6, 2020 in Big Data Hadoop by MD
• 95,440 points
1,441 views
0 votes
1 answer

How to view contents of file in hadoop hdfs?

Hi@akhtar, You can use the Hadoop filesystem command ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
7,521 views
0 votes
1 answer

How to find HDFS free space from command line?

Hi@akhtar, You can find the free space from ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
554 views
0 votes
1 answer

Where does Hive store files in HDFS?

Hi@akhtar, It depends on what you set in ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
708 views
+1 vote
1 answer

How to check a HDFS directory size?

Hi@akhtar, You can check the size of the ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
568 views
0 votes
1 answer

How to change the default replication factor in Hadoop?

Hi@akhtar, You can change the default replication factor from the ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,440 points
1,502 views
0 votes
1 answer

How to change default block size in Hadoop Cluster?

Hi@akhtar, You can change the default block size ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,440 points
2,004 views
0 votes
1 answer

Change the owner and group of a file in Hadoop.

Hi@akhtar, You can use the Chown command. This ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
7,658 views
0 votes
1 answer

Change permissions of a file in HDFS.

Hi@akhtar, You can use the Chmod command to ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
2,070 views
0 votes
1 answer

How to create a group in Hadoop?

Hi@akhtar, Generally, to create a group in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
938 views
0 votes
1 answer

How to append files from local system to HDFS?

Hi@akhtar, You can use appendToFile in your Hadoop ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
7,294 views
0 votes
1 answer

How to set replication factor in Hadoop?

Hi@akhtar, You can find setrep command in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
7,347 views
0 votes
1 answer

How to merge files in Hadoop?

Hi@akhtar, You can use getmerge command in Hadoop. ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
874 views
0 votes
1 answer

How to remove files from HDFS system?

Hi@akhtar, You will find rm command in your ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
22,491 views
0 votes
1 answer

Copy files in different folders in Hadoop.

Hi@akhtar, You can use the cp command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
31,714 views
0 votes
1 answer

How to copy files from HDFS to local system?

Hi@akhtar, You can use the put command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
3,911 views
0 votes
1 answer

Setting up Hadoop Multi-node cluster on windows 10 systems

Hi@Hassan, You can do it windows system as ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
1,682 views
0 votes
1 answer

Adding Ranger KMS server using ambari

Hi@Shllpa, It is asking for admin credentials. Did ...READ MORE

Sep 28, 2020 in Big Data Hadoop by MD
• 95,440 points
431 views
0 votes
1 answer

touchz: io.bytes.per.checksum(512) and blockSize(256) do not match. blockSize should be a multiple of io.bytes.per.checksum

Hi@akhtar, The default the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
688 views
0 votes
1 answer

touchz: java.io.IOException: java.lang.IllegalArgumentException: Unexpected value for the block size

Hi@akhtar, You are trying to create a block ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
704 views
0 votes
1 answer

How to change block size in Hadoop dynamically?

Hi@akhtar, By default, the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by akhtar
• 38,230 points
2,558 views
0 votes
1 answer

How to configure Hadoop Client?

Hi@akhtar, To configure the Hadoop Client, you need ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
2,307 views
0 votes
1 answer

How to upload files in Hadoop Cluster?

Hi@akhtar, To upload a file in Hadoop Cluster, ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
1,834 views
0 votes
1 answer

Usage: java FsShell [-put <localsrc> ... <dst>]

Hi@akhtar, You are trying to upload your file ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
588 views
0 votes
1 answer

How to connect Hadoop WebUI?

Hi@akhtar, You can connect your Hadoop Cluster with ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
570 views
0 votes
1 answer

How to see the report of Hadoop Cluster from command line?

Hi@akhtar, You can see the report of Hadoop Cluster ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
2,801 views
0 votes
1 answer

How to format a Hadoop Master Node?

Hi@akhtar, To start the Hadoop NameNode, you need ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,440 points
522 views
0 votes
1 answer

How to start Hadoop namenode service?

Hi@akhtar, If you configured your Hadoop master successfully, ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,440 points
752 views
0 votes
1 answer

How to configure Hadoop namenode?

Hi@MD, To configure the Hadoop master node, you ...READ MORE

Sep 21, 2020 in Big Data Hadoop by akhtar
• 38,230 points
670 views
0 votes
1 answer

file /usr/bin from install of hadoop-1.2.1-1.x86_64 conflicts with file from package filesystem-3.8-2.el8.x86_64

Hi@akhtar, Your Hadoop rpm is conflicting with some ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,440 points
1,113 views
0 votes
1 answer

Urgently Want dataset

Hi, @Amit, Regarding your query on Datasets on (merchant ...READ MORE

Sep 21, 2020 in Big Data Hadoop by Gitika
• 65,910 points
568 views
0 votes
1 answer

How to merge two Spark DataFrames?

Hi@akhtar, You can perform join operation in spark. ...READ MORE

Sep 17, 2020 in Big Data Hadoop by MD
• 95,440 points
1,265 views
0 votes
1 answer

How to get resource utilized(memory and CPU) by each hive query which is running under single application Id?

Hi@sivachandran, You can monitor the metrics of your ...READ MORE

Sep 18, 2020 in Big Data Hadoop by MD
• 95,440 points
2,344 views
0 votes
1 answer

Can't Pass Java Agent in Hive

Hi@Som, You may forget to set the below ...READ MORE

Sep 15, 2020 in Big Data Hadoop by MD
• 95,440 points
628 views
0 votes
1 answer

I went to datadir/hdfs/nn/current but no folder called current

Hi@Wlssam, I am not able to understand your ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
• 95,440 points
394 views
0 votes
1 answer

Monitoring Hadoop with Prometheus JMX

Hi@Som, This error is not related to Prometheus ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
• 95,440 points
2,250 views
0 votes
1 answer

which version of sqoop should i use for hadoop 3.3.0?

Hi@shresht, This is just a warning. Did you ...READ MORE

Sep 7, 2020 in Big Data Hadoop by MD
• 95,440 points
1,868 views