Most answered questions in Big Data Hadoop

0 votes
1 answer

How to store datasets from Pig to HDFS?

Hi Guys, You can store the loaded data ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
1,448 views
0 votes
1 answer

How to invoke the Grunt shell in MapReduce mode in Pig?

Hi@akhtar, You can invoke the Grunt shell in ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
484 views
0 votes
1 answer

How to load dataset in Pig?

Hi@akhtar, You can run the load command in ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
797 views
0 votes
1 answer

Execute the Pig script in Local mode.

Hi@akhtar, You can write an entire Pig Latin ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
311 views
0 votes
1 answer

How to start Grunt shell in Local mode in Pig?

Hi@akhtar, You can invoke the Grunt shell in ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
838 views
0 votes
1 answer

mkdir: cannot create directory `/var/run/hadoop': Permission denied.

Hi@akhtar, You need to set the path of ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,440 points
2,768 views
0 votes
1 answer

How to create an empty file in Hadoop?

Hi@akhtar, You can create an empty file in ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
12,206 views
0 votes
1 answer

How to remove the directory from HDFS?

Hi@akhtar, You can remove the directory using the ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
3,613 views
0 votes
1 answer

org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:54310/user/hduser/input.

Hi@akhtar, It seems you are providing the wrong ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
2,155 views
0 votes
1 answer

How to find the number of blocks for a file in Hadoop?

Hi@akhtar, You can use Hadoop file system command to ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
1,915 views
0 votes
1 answer

How to check the name of the hadoop server?

Hi@akhtar, If you're running a pseudo-distributed setup, you ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,440 points
1,870 views
0 votes
1 answer

Ranger kms create key failed

Hi@shllpa, I have checked your file. All seems ...READ MORE

Oct 6, 2020 in Big Data Hadoop by MD
• 95,440 points
1,386 views
0 votes
1 answer

How to view contents of file in hadoop hdfs?

Hi@akhtar, You can use the Hadoop filesystem command ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
7,395 views
0 votes
1 answer

How to find HDFS free space from command line?

Hi@akhtar, You can find the free space from ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
530 views
0 votes
1 answer

Where does Hive store files in HDFS?

Hi@akhtar, It depends on what you set in ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
671 views
+1 vote
1 answer

How to check a HDFS directory size?

Hi@akhtar, You can check the size of the ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
538 views
0 votes
1 answer

How to change the default replication factor in Hadoop?

Hi@akhtar, You can change the default replication factor from the ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,440 points
1,464 views
0 votes
1 answer

How to change default block size in Hadoop Cluster?

Hi@akhtar, You can change the default block size ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,440 points
1,915 views
0 votes
1 answer

Change the owner and group of a file in Hadoop.

Hi@akhtar, You can use the Chown command. This ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
7,535 views
0 votes
1 answer

Change permissions of a file in HDFS.

Hi@akhtar, You can use the Chmod command to ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
2,016 views
0 votes
1 answer

How to create a group in Hadoop?

Hi@akhtar, Generally, to create a group in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
886 views
0 votes
1 answer

How to append files from local system to HDFS?

Hi@akhtar, You can use appendToFile in your Hadoop ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
7,126 views
0 votes
1 answer

How to set replication factor in Hadoop?

Hi@akhtar, You can find setrep command in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
7,243 views
0 votes
1 answer

How to merge files in Hadoop?

Hi@akhtar, You can use getmerge command in Hadoop. ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
815 views
0 votes
1 answer

How to remove files from HDFS system?

Hi@akhtar, You will find rm command in your ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
21,957 views
0 votes
1 answer

Copy files in different folders in Hadoop.

Hi@akhtar, You can use the cp command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
31,326 views
0 votes
1 answer

How to copy files from HDFS to local system?

Hi@akhtar, You can use the put command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
3,838 views
0 votes
1 answer

Setting up Hadoop Multi-node cluster on windows 10 systems

Hi@Hassan, You can do it windows system as ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
1,651 views
0 votes
1 answer

Adding Ranger KMS server using ambari

Hi@Shllpa, It is asking for admin credentials. Did ...READ MORE

Sep 28, 2020 in Big Data Hadoop by MD
• 95,440 points
396 views
0 votes
1 answer

touchz: io.bytes.per.checksum(512) and blockSize(256) do not match. blockSize should be a multiple of io.bytes.per.checksum

Hi@akhtar, The default the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
635 views
0 votes
1 answer

touchz: java.io.IOException: java.lang.IllegalArgumentException: Unexpected value for the block size

Hi@akhtar, You are trying to create a block ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
681 views
0 votes
1 answer

How to change block size in Hadoop dynamically?

Hi@akhtar, By default, the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by akhtar
• 38,230 points
2,454 views
0 votes
1 answer

How to configure Hadoop Client?

Hi@akhtar, To configure the Hadoop Client, you need ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
2,240 views
0 votes
1 answer

How to upload files in Hadoop Cluster?

Hi@akhtar, To upload a file in Hadoop Cluster, ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
1,794 views
0 votes
1 answer

Usage: java FsShell [-put <localsrc> ... <dst>]

Hi@akhtar, You are trying to upload your file ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
566 views
0 votes
1 answer

How to connect Hadoop WebUI?

Hi@akhtar, You can connect your Hadoop Cluster with ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
551 views
0 votes
1 answer

How to see the report of Hadoop Cluster from command line?

Hi@akhtar, You can see the report of Hadoop Cluster ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
2,685 views
0 votes
1 answer

How to format a Hadoop Master Node?

Hi@akhtar, To start the Hadoop NameNode, you need ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,440 points
498 views
0 votes
1 answer

How to start Hadoop namenode service?

Hi@akhtar, If you configured your Hadoop master successfully, ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,440 points
705 views
0 votes
1 answer

How to configure Hadoop namenode?

Hi@MD, To configure the Hadoop master node, you ...READ MORE

Sep 21, 2020 in Big Data Hadoop by akhtar
• 38,230 points
620 views
0 votes
1 answer

file /usr/bin from install of hadoop-1.2.1-1.x86_64 conflicts with file from package filesystem-3.8-2.el8.x86_64

Hi@akhtar, Your Hadoop rpm is conflicting with some ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,440 points
1,087 views
0 votes
1 answer

Urgently Want dataset

Hi, @Amit, Regarding your query on Datasets on (merchant ...READ MORE

Sep 21, 2020 in Big Data Hadoop by Gitika
• 65,910 points
534 views
0 votes
1 answer

How to merge two Spark DataFrames?

Hi@akhtar, You can perform join operation in spark. ...READ MORE

Sep 17, 2020 in Big Data Hadoop by MD
• 95,440 points
1,173 views
0 votes
1 answer

How to get resource utilized(memory and CPU) by each hive query which is running under single application Id?

Hi@sivachandran, You can monitor the metrics of your ...READ MORE

Sep 18, 2020 in Big Data Hadoop by MD
• 95,440 points
2,305 views
0 votes
1 answer

Can't Pass Java Agent in Hive

Hi@Som, You may forget to set the below ...READ MORE

Sep 15, 2020 in Big Data Hadoop by MD
• 95,440 points
604 views
0 votes
1 answer

I went to datadir/hdfs/nn/current but no folder called current

Hi@Wlssam, I am not able to understand your ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
• 95,440 points
355 views
0 votes
1 answer

Monitoring Hadoop with Prometheus JMX

Hi@Som, This error is not related to Prometheus ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
• 95,440 points
2,166 views
0 votes
1 answer

which version of sqoop should i use for hadoop 3.3.0?

Hi@shresht, This is just a warning. Did you ...READ MORE

Sep 7, 2020 in Big Data Hadoop by MD
• 95,440 points
1,806 views