Trending questions in Big Data Hadoop

0 votes
1 answer

Execute the Pig script in Local mode.

Hi@akhtar, You can write an entire Pig Latin ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,360 points
124 views
0 votes
1 answer

How to change block size in Hadoop dynamically?

Hi@akhtar, By default, the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by akhtar
• 38,230 points
901 views
0 votes
1 answer

How to get resource utilized(memory and CPU) by each hive query which is running under single application Id?

Hi@sivachandran, You can monitor the metrics of your ...READ MORE

Sep 18, 2020 in Big Data Hadoop by MD
• 95,360 points
1,222 views
0 votes
1 answer

How to change the default replication factor in Hadoop?

Hi@akhtar, You can change the default replication factor from the ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,360 points
511 views
0 votes
1 answer

How to change default block size in Hadoop Cluster?

Hi@akhtar, You can change the default block size ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,360 points
480 views
0 votes
1 answer

How to see the report of Hadoop Cluster from command line?

Hi@akhtar, You can see the report of Hadoop Cluster ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,360 points
799 views
+1 vote
1 answer

How to check a HDFS directory size?

Hi@akhtar, You can check the size of the ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,360 points
204 views
0 votes
1 answer

Where does Hive store files in HDFS?

Hi@akhtar, It depends on what you set in ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,360 points
217 views
0 votes
1 answer

How to find HDFS free space from command line?

Hi@akhtar, You can find the free space from ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,360 points
197 views
0 votes
1 answer

Monitoring Hadoop with Prometheus JMX

Hi@Som, This error is not related to Prometheus ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
• 95,360 points
1,158 views
0 votes
1 answer

How to merge files in Hadoop?

Hi@akhtar, You can use getmerge command in Hadoop. ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,360 points
293 views
0 votes
1 answer

How to create a group in Hadoop?

Hi@akhtar, Generally, to create a group in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,360 points
240 views
0 votes
1 answer

file /usr/bin from install of hadoop-1.2.1-1.x86_64 conflicts with file from package filesystem-3.8-2.el8.x86_64

Hi@akhtar, Your Hadoop rpm is conflicting with some ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,360 points
649 views
0 votes
1 answer

Multiple rows to columns in hive

Hi, You need to create your own customize ...READ MORE

Sep 4, 2020 in Big Data Hadoop by MD
• 95,360 points
1,267 views
0 votes
1 answer

Adding Ranger KMS server using ambari

Hi@Shllpa, It is asking for admin credentials. Did ...READ MORE

Sep 28, 2020 in Big Data Hadoop by MD
• 95,360 points
175 views
0 votes
1 answer

touchz: io.bytes.per.checksum(512) and blockSize(256) do not match. blockSize should be a multiple of io.bytes.per.checksum

Hi@akhtar, The default the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,360 points
259 views
0 votes
1 answer

Usage: java FsShell [-put <localsrc> ... <dst>]

Hi@akhtar, You are trying to upload your file ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,360 points
240 views
0 votes
1 answer

touchz: java.io.IOException: java.lang.IllegalArgumentException: Unexpected value for the block size

Hi@akhtar, You are trying to create a block ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,360 points
234 views
0 votes
1 answer

How to connect Hadoop WebUI?

Hi@akhtar, You can connect your Hadoop Cluster with ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,360 points
215 views
0 votes
0 answers

Enable HA for mapreduce jobhistory server

Hi Team, From past few days I am ...READ MORE

Sep 23, 2020 in Big Data Hadoop by Shilpa S
• 450 points
308 views
0 votes
1 answer

How to download hadoop jar files for adding eclipse

Hi@Manl, To import jar file in your Eclipse ...READ MORE

Jul 20, 2020 in Big Data Hadoop by MD
• 95,360 points
3,078 views
0 votes
1 answer

which version of sqoop should i use for hadoop 3.3.0?

Hi@shresht, This is just a warning. Did you ...READ MORE

Sep 7, 2020 in Big Data Hadoop by MD
• 95,360 points
874 views
0 votes
1 answer

How to start Hadoop namenode service?

Hi@akhtar, If you configured your Hadoop master successfully, ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,360 points
253 views
0 votes
1 answer

How to format a Hadoop Master Node?

Hi@akhtar, To start the Hadoop NameNode, you need ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,360 points
171 views
0 votes
1 answer

How to configure Hadoop namenode?

Hi@MD, To configure the Hadoop master node, you ...READ MORE

Sep 21, 2020 in Big Data Hadoop by akhtar
• 38,230 points
126 views
0 votes
1 answer

How to merge two Spark DataFrames?

Hi@akhtar, You can perform join operation in spark. ...READ MORE

Sep 17, 2020 in Big Data Hadoop by MD
• 95,360 points
250 views
0 votes
1 answer

Urgently Want dataset

Hi, @Amit, Regarding your query on Datasets on (merchant ...READ MORE

Sep 21, 2020 in Big Data Hadoop by Gitika
• 65,850 points
152 views
0 votes
1 answer

Can't Pass Java Agent in Hive

Hi@Som, You may forget to set the below ...READ MORE

Sep 15, 2020 in Big Data Hadoop by MD
• 95,360 points
257 views
0 votes
0 answers

which version of sqoop should i use with hadoop 3.3.0 ? [closed]

I am trying to install sqoop 1.4.7 ...READ MORE

Sep 6, 2020 in Big Data Hadoop by shresht
• 140 points

closed Sep 7, 2020 by Gitika 609 views
0 votes
0 answers

How I can kill the jobs using jobID running in local mode with Hadoop

I am Running hadoop jobs in local ...READ MORE

Aug 26, 2020 in Big Data Hadoop by kamboj
• 140 points
1,008 views
0 votes
1 answer

I went to datadir/hdfs/nn/current but no folder called current

Hi@Wlssam, I am not able to understand your ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
• 95,360 points
122 views
0 votes
1 answer

SQOOP Import error - Invalid argurments

Hi@Vikramraj, You have passed wrong arguments in your ...READ MORE

Sep 1, 2020 in Big Data Hadoop by MD
• 95,360 points
331 views
0 votes
1 answer

ERROR 1227 (42000): Access denied; you need (at least one of) the CREATE USER privilege(s) for this operation.

Hi, You can follow some steps to remove ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Gitika
• 65,850 points
19,275 views
0 votes
1 answer

Parquet File and ORC Table

Hi. @Vikramraj, Regarding your query, I would suggest ...READ MORE

Sep 1, 2020 in Big Data Hadoop by Gitika
• 65,850 points
247 views
0 votes
2 answers
0 votes
1 answer
0 votes
1 answer

Hadoop Small File

Hi@himanshu, To monitor your Namenode, you can create ...READ MORE

Aug 24, 2020 in Big Data Hadoop by MD
• 95,360 points
158 views
0 votes
1 answer

Replace Column names and datatype in Hive

You can replace the column name and ...READ MORE

May 21, 2019 in Big Data Hadoop by John
19,681 views
0 votes
1 answer

Is there any alternative for edureka vm ?

you can use Hortonworks ! READ MORE

Nov 9, 2020 in Big Data Hadoop by Reza
356 views
0 votes
1 answer

Error while starting the daemon process in windows 10

Hi@Arun, By default, the parameter "dfs.datanode.failed.volumes.tolerated" is set ...READ MORE

Apr 20, 2020 in Big Data Hadoop by MD
• 95,360 points
5,186 views
0 votes
1 answer

Installing Zookeeper on Windows

Follow the below-mentioned steps to install Zookeeper ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
23,115 views
0 votes
1 answer

How can you change a column data type in Hive?

Hi, By using this command below one can ...READ MORE

Jun 24, 2019 in Big Data Hadoop by Gitika
• 65,850 points
17,493 views
0 votes
1 answer

In my hadoop namenode is not starting

Hi@Aman, There may be many reasons behind this. ...READ MORE

Jul 22, 2020 in Big Data Hadoop by MD
• 95,360 points
340 views
0 votes
13 answers

What is the difference between Hadoop/HDFS & HBase?

HDFS is a distributed file system whereas ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Arihar
• 160 points
26,933 views
0 votes
1 answer

input split and block size with examples

Hi@siva, Hadoop HDFS split large files into small ...READ MORE

Jul 13, 2020 in Big Data Hadoop by MD
• 95,360 points
391 views
0 votes
1 answer

I have to ingest in hadoop cluster large number of files for testing , what is the best way to do it?

Hi@sonali, It depends on what kind of testing ...READ MORE

Jul 8, 2020 in Big Data Hadoop by MD
• 95,360 points
516 views
0 votes
1 answer
+2 votes
1 answer

FileStreamSink: Error while looking for metadata directory. java.lang.IllegalArgumentException: java.net.UnknownHostException: hive

Hi@akhtar, You tried to read file from your ...READ MORE

Feb 13, 2020 in Big Data Hadoop by MD
• 95,360 points
6,442 views