Most answered questions in Big Data Hadoop

0 votes
1 answer

How to store datasets from Pig to HDFS?

Hi Guys, You can store the loaded data ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
1,602 views
0 votes
1 answer

How to invoke the Grunt shell in MapReduce mode in Pig?

Hi@akhtar, You can invoke the Grunt shell in ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
572 views
0 votes
1 answer

How to load dataset in Pig?

Hi@akhtar, You can run the load command in ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
886 views
0 votes
1 answer

Execute the Pig script in Local mode.

Hi@akhtar, You can write an entire Pig Latin ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
371 views
0 votes
1 answer

How to start Grunt shell in Local mode in Pig?

Hi@akhtar, You can invoke the Grunt shell in ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
965 views
0 votes
1 answer

mkdir: cannot create directory `/var/run/hadoop': Permission denied.

Hi@akhtar, You need to set the path of ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
3,018 views
0 votes
1 answer

How to create an empty file in Hadoop?

Hi@akhtar, You can create an empty file in ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
12,867 views
0 votes
1 answer

How to remove the directory from HDFS?

Hi@akhtar, You can remove the directory using the ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
4,019 views
0 votes
1 answer

org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:54310/user/hduser/input.

Hi@akhtar, It seems you are providing the wrong ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
2,347 views
0 votes
1 answer

How to find the number of blocks for a file in Hadoop?

Hi@akhtar, You can use Hadoop file system command to ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
2,081 views
0 votes
1 answer

How to check the name of the hadoop server?

Hi@akhtar, If you're running a pseudo-distributed setup, you ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
2,115 views
0 votes
1 answer

Ranger kms create key failed

Hi@shllpa, I have checked your file. All seems ...READ MORE

Oct 6, 2020 in Big Data Hadoop by MD
• 95,440 points
1,572 views
0 votes
1 answer

How to view contents of file in hadoop hdfs?

Hi@akhtar, You can use the Hadoop filesystem command ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
7,784 views
0 votes
1 answer

How to find HDFS free space from command line?

Hi@akhtar, You can find the free space from ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
628 views
0 votes
1 answer

Where does Hive store files in HDFS?

Hi@akhtar, It depends on what you set in ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
816 views
+1 vote
1 answer

How to check a HDFS directory size?

Hi@akhtar, You can check the size of the ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
666 views
0 votes
1 answer

How to change the default replication factor in Hadoop?

Hi@akhtar, You can change the default replication factor from the ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,440 points
1,598 views
0 votes
1 answer

How to change default block size in Hadoop Cluster?

Hi@akhtar, You can change the default block size ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,440 points
2,160 views
0 votes
1 answer

Change the owner and group of a file in Hadoop.

Hi@akhtar, You can use the Chown command. This ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
7,879 views
0 votes
1 answer

Change permissions of a file in HDFS.

Hi@akhtar, You can use the Chmod command to ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
2,192 views
0 votes
1 answer

How to create a group in Hadoop?

Hi@akhtar, Generally, to create a group in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
1,025 views
0 votes
1 answer

How to append files from local system to HDFS?

Hi@akhtar, You can use appendToFile in your Hadoop ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
7,633 views
0 votes
1 answer

How to set replication factor in Hadoop?

Hi@akhtar, You can find setrep command in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
7,600 views
0 votes
1 answer

How to merge files in Hadoop?

Hi@akhtar, You can use getmerge command in Hadoop. ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
963 views
0 votes
1 answer

How to remove files from HDFS system?

Hi@akhtar, You will find rm command in your ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
23,677 views
0 votes
1 answer

Copy files in different folders in Hadoop.

Hi@akhtar, You can use the cp command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
32,397 views
0 votes
1 answer

How to copy files from HDFS to local system?

Hi@akhtar, You can use the put command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
4,031 views
0 votes
1 answer

Setting up Hadoop Multi-node cluster on windows 10 systems

Hi@Hassan, You can do it windows system as ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
1,758 views
0 votes
1 answer

Adding Ranger KMS server using ambari

Hi@Shllpa, It is asking for admin credentials. Did ...READ MORE

Sep 28, 2020 in Big Data Hadoop by MD
• 95,440 points
490 views
0 votes
1 answer

touchz: io.bytes.per.checksum(512) and blockSize(256) do not match. blockSize should be a multiple of io.bytes.per.checksum

Hi@akhtar, The default the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
738 views
0 votes
1 answer

touchz: java.io.IOException: java.lang.IllegalArgumentException: Unexpected value for the block size

Hi@akhtar, You are trying to create a block ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
754 views
0 votes
1 answer

How to change block size in Hadoop dynamically?

Hi@akhtar, By default, the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by akhtar
• 38,240 points
2,742 views
0 votes
1 answer

How to configure Hadoop Client?

Hi@akhtar, To configure the Hadoop Client, you need ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
2,417 views
0 votes
1 answer

How to upload files in Hadoop Cluster?

Hi@akhtar, To upload a file in Hadoop Cluster, ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
1,926 views
0 votes
1 answer

Usage: java FsShell [-put <localsrc> ... <dst>]

Hi@akhtar, You are trying to upload your file ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
659 views
0 votes
1 answer

How to connect Hadoop WebUI?

Hi@akhtar, You can connect your Hadoop Cluster with ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
633 views
0 votes
1 answer

How to see the report of Hadoop Cluster from command line?

Hi@akhtar, You can see the report of Hadoop Cluster ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
2,977 views
0 votes
1 answer

How to format a Hadoop Master Node?

Hi@akhtar, To start the Hadoop NameNode, you need ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,440 points
584 views
0 votes
1 answer

How to start Hadoop namenode service?

Hi@akhtar, If you configured your Hadoop master successfully, ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,440 points
873 views
0 votes
1 answer

How to configure Hadoop namenode?

Hi@MD, To configure the Hadoop master node, you ...READ MORE

Sep 21, 2020 in Big Data Hadoop by akhtar
• 38,240 points
776 views
0 votes
1 answer

file /usr/bin from install of hadoop-1.2.1-1.x86_64 conflicts with file from package filesystem-3.8-2.el8.x86_64

Hi@akhtar, Your Hadoop rpm is conflicting with some ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,440 points
1,183 views
0 votes
1 answer

Urgently Want dataset

Hi, @Amit, Regarding your query on Datasets on (merchant ...READ MORE

Sep 21, 2020 in Big Data Hadoop by Gitika
• 65,910 points
650 views
0 votes
1 answer

How to merge two Spark DataFrames?

Hi@akhtar, You can perform join operation in spark. ...READ MORE

Sep 17, 2020 in Big Data Hadoop by MD
• 95,440 points
1,459 views
0 votes
1 answer

How to get resource utilized(memory and CPU) by each hive query which is running under single application Id?

Hi@sivachandran, You can monitor the metrics of your ...READ MORE

Sep 18, 2020 in Big Data Hadoop by MD
• 95,440 points
2,503 views
0 votes
1 answer

Can't Pass Java Agent in Hive

Hi@Som, You may forget to set the below ...READ MORE

Sep 15, 2020 in Big Data Hadoop by MD
• 95,440 points
688 views
0 votes
1 answer

I went to datadir/hdfs/nn/current but no folder called current

Hi@Wlssam, I am not able to understand your ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
• 95,440 points
442 views
0 votes
1 answer

Monitoring Hadoop with Prometheus JMX

Hi@Som, This error is not related to Prometheus ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
• 95,440 points
2,418 views
0 votes
1 answer

which version of sqoop should i use for hadoop 3.3.0?

Hi@shresht, This is just a warning. Did you ...READ MORE

Sep 7, 2020 in Big Data Hadoop by MD
• 95,440 points
2,040 views