Latest questions in Big Data Hadoop

0 votes
1 answer

How to see the report of Hadoop Cluster from command line?

Hi@akhtar, You can see the report of Hadoop Cluster ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
2,685 views
0 votes
0 answers

Enable HA for mapreduce jobhistory server

Hi Team, From past few days I am ...READ MORE

Sep 23, 2020 in Big Data Hadoop by Shilpa S
• 450 points
1,009 views
0 votes
1 answer

How to format a Hadoop Master Node?

Hi@akhtar, To start the Hadoop NameNode, you need ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,440 points
498 views
0 votes
1 answer

How to start Hadoop namenode service?

Hi@akhtar, If you configured your Hadoop master successfully, ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,440 points
705 views
0 votes
1 answer

How to configure Hadoop namenode?

Hi@MD, To configure the Hadoop master node, you ...READ MORE

Sep 21, 2020 in Big Data Hadoop by akhtar
• 38,230 points
620 views
0 votes
1 answer

file /usr/bin from install of hadoop-1.2.1-1.x86_64 conflicts with file from package filesystem-3.8-2.el8.x86_64

Hi@akhtar, Your Hadoop rpm is conflicting with some ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,440 points
1,088 views
0 votes
1 answer

Urgently Want dataset

Hi, @Amit, Regarding your query on Datasets on (merchant ...READ MORE

Sep 21, 2020 in Big Data Hadoop by Gitika
• 65,910 points
535 views
0 votes
1 answer

How to merge two Spark DataFrames?

Hi@akhtar, You can perform join operation in spark. ...READ MORE

Sep 17, 2020 in Big Data Hadoop by MD
• 95,440 points
1,173 views
0 votes
1 answer

How to get resource utilized(memory and CPU) by each hive query which is running under single application Id?

Hi@sivachandran, You can monitor the metrics of your ...READ MORE

Sep 18, 2020 in Big Data Hadoop by MD
• 95,440 points
2,305 views
0 votes
1 answer

Can't Pass Java Agent in Hive

Hi@Som, You may forget to set the below ...READ MORE

Sep 15, 2020 in Big Data Hadoop by MD
• 95,440 points
604 views
0 votes
1 answer

I went to datadir/hdfs/nn/current but no folder called current

Hi@Wlssam, I am not able to understand your ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
• 95,440 points
355 views
0 votes
1 answer

Monitoring Hadoop with Prometheus JMX

Hi@Som, This error is not related to Prometheus ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
• 95,440 points
2,166 views
0 votes
1 answer

which version of sqoop should i use for hadoop 3.3.0?

Hi@shresht, This is just a warning. Did you ...READ MORE

Sep 7, 2020 in Big Data Hadoop by MD
• 95,440 points
1,806 views
0 votes
0 answers

which version of sqoop should i use with hadoop 3.3.0 ? [closed]

I am trying to install sqoop 1.4.7 ...READ MORE

Sep 6, 2020 in Big Data Hadoop by shresht
• 140 points

closed Sep 7, 2020 by Gitika 989 views
0 votes
1 answer

Multiple rows to columns in hive

Hi, You need to create your own customize ...READ MORE

Sep 4, 2020 in Big Data Hadoop by MD
• 95,440 points
2,334 views
0 votes
1 answer

SQOOP Import error - Invalid argurments

Hi@Vikramraj, You have passed wrong arguments in your ...READ MORE

Sep 1, 2020 in Big Data Hadoop by MD
• 95,440 points
762 views
0 votes
1 answer

Parquet File and ORC Table

Hi. @Vikramraj, Regarding your query, I would suggest ...READ MORE

Sep 1, 2020 in Big Data Hadoop by Gitika
• 65,910 points
603 views
0 votes
0 answers

How I can kill the jobs using jobID running in local mode with Hadoop

I am Running hadoop jobs in local ...READ MORE

Aug 26, 2020 in Big Data Hadoop by kamboj
• 140 points
1,950 views
0 votes
1 answer

Hadoop Small File

Hi@himanshu, To monitor your Namenode, you can create ...READ MORE

Aug 24, 2020 in Big Data Hadoop by MD
• 95,440 points
351 views
0 votes
2 answers
0 votes
1 answer

In my hadoop namenode is not starting

Hi@Aman, There may be many reasons behind this. ...READ MORE

Jul 22, 2020 in Big Data Hadoop by MD
• 95,440 points
943 views
0 votes
1 answer

How to download hadoop jar files for adding eclipse

Hi@Manl, To import jar file in your Eclipse ...READ MORE

Jul 20, 2020 in Big Data Hadoop by MD
• 95,440 points
5,231 views
0 votes
1 answer

input split and block size with examples

Hi@siva, Hadoop HDFS split large files into small ...READ MORE

Jul 13, 2020 in Big Data Hadoop by MD
• 95,440 points
1,223 views
0 votes
1 answer

I have to ingest in hadoop cluster large number of files for testing , what is the best way to do it?

Hi@sonali, It depends on what kind of testing ...READ MORE

Jul 8, 2020 in Big Data Hadoop by MD
• 95,440 points
938 views
0 votes
0 answers

Data import using sqoop to Hive

Hello Everyone, I am trying to import data ...READ MORE

Jul 3, 2020 in Big Data Hadoop by anonymous
• 120 points
867 views
0 votes
1 answer

How to get the column name printed in a file along with the output in Hive?

Hi @Neethu, Regarding your query, I would suggest ...READ MORE

Jul 2, 2020 in Big Data Hadoop by Gitika
• 65,910 points
787 views
0 votes
1 answer

Format HDFS Namenode Error: Could not find or load main class ”-Djava.library.path=.home.hadoop.hadoop-3.2.1.lib.native”

Hi@fwood, According to your configuration, you didn't set ...READ MORE

Jun 12, 2020 in Big Data Hadoop by MD
• 95,440 points
10,087 views
0 votes
0 answers
+1 vote
1 answer

How to change columname in a dataframe

Hi@shanmugam, You can change your column by using ...READ MORE

May 21, 2020 in Big Data Hadoop by MD
• 95,440 points
601 views
+1 vote
1 answer

starting hive gave me exception

Hi@Hans, You may got this error, if you ...READ MORE

May 20, 2020 in Big Data Hadoop by MD
• 95,440 points
2,037 views
0 votes
1 answer

What are good big data courses for freshers?

Hi@akhtar, There are lots of Big Data courses ...READ MORE

May 15, 2020 in Big Data Hadoop by MD
• 95,440 points
823 views
0 votes
1 answer

What skills are required to be a Hadoop developer?

Hi@akhtar, To become a Hadoop developer, you should ...READ MORE

May 15, 2020 in Big Data Hadoop by MD
• 95,440 points
598 views
0 votes
1 answer

Which is the best online Big Data Hadoop course?

Hi@akhtar, As you are a beginner, you should ...READ MORE

May 15, 2020 in Big Data Hadoop by MD
• 95,440 points
643 views
0 votes
1 answer

Is there any alternative for edureka vm ?

you can use Hortonworks ! READ MORE

Nov 9, 2020 in Big Data Hadoop by Reza
703 views
0 votes
1 answer

getting error: -bash: syntax error near unexpected token `('

hi, you should give space between PigStorage and ...READ MORE

May 9, 2020 in Big Data Hadoop by anonymous
• 140 points
2,899 views
0 votes
1 answer

can we add hadoop in docker or online server or cloud

Hi@Rajan, If you are asking, can we configure hadoop ...READ MORE

May 1, 2020 in Big Data Hadoop by MD
• 95,440 points
607 views
0 votes
1 answer

Error: Couldn't properly initialize access to HDFS internals. Please update your WAL Provider to not make use of the 'asyncfs' provider.

Hi@akhtar, I think you are trying to use AsyncFSWAL for HBase-2.x as ...READ MORE

Apr 30, 2020 in Big Data Hadoop by MD
• 95,440 points
1,293 views
0 votes
1 answer

java.lang.NoSuchMethodError: java.util.concurrent.ConcurrentHashMap.keySet()Ljava/util/concurrent/ConcurrentHashMap$KeySetView

Hi@akhtar, I think there is a problem in ...READ MORE

Apr 30, 2020 in Big Data Hadoop by MD
• 95,440 points
1,494 views
0 votes
1 answer

kernel: java: page allocation failure. order:4, mode:0x20

Hi@akhtar, You may got this error because of ...READ MORE

Apr 30, 2020 in Big Data Hadoop by MD
• 95,440 points
937 views
0 votes
0 answers

Real time access to data in hadoop

We need to store customer billing data ...READ MORE

Apr 30, 2020 in Big Data Hadoop by anonymous
• 120 points
805 views
0 votes
1 answer

How to create one job in Sqoop?

Hi@akhtar, You can create one job for future ...READ MORE

Apr 29, 2020 in Big Data Hadoop by MD
• 95,440 points
702 views
0 votes
1 answer

Distcp From Local to HDFS giving error file not found

Hey, @Amey, This is probably because of a ...READ MORE

Apr 29, 2020 in Big Data Hadoop by Gitika
• 65,910 points
1,763 views
0 votes
1 answer

ERROR tool.BaseSqoopTool: Got error creating database manager: java.io.IOException: No manager for connect string

Hi@akhtar, I think your jdbc jars are not ...READ MORE

Apr 24, 2020 in Big Data Hadoop by MD
• 95,440 points
2,539 views
0 votes
1 answer

error:org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:456)] HDFS IO error java.io.IOException

Hi@akhtar, There may be problem in firewall, so ...READ MORE

Apr 23, 2020 in Big Data Hadoop by MD
• 95,440 points
1,479 views
0 votes
1 answer
0 votes
0 answers

Hi. I keep on encountering the follow error when running conf in flume via flume-ng at line 189. Any possible solutions?

Running FLUME agent :     class: org.apache.flume.node.Application     arguments: -n agent1 ...READ MORE

Apr 23, 2020 in Big Data Hadoop by anonymous
• 120 points
1,064 views
0 votes
1 answer

Error while starting the daemon process in windows 10

Hi@Arun, By default, the parameter "dfs.datanode.failed.volumes.tolerated" is set ...READ MORE

Apr 20, 2020 in Big Data Hadoop by MD
• 95,440 points
7,835 views