Most voted questions in Big Data Hadoop

0 votes
1 answer

How to start Hadoop namenode service?

Hi@akhtar, If you configured your Hadoop master successfully, ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,460 points
1,162 views
0 votes
1 answer

How to configure Hadoop namenode?

Hi@MD, To configure the Hadoop master node, you ...READ MORE

Sep 21, 2020 in Big Data Hadoop by akhtar
• 38,260 points
1,122 views
0 votes
1 answer

file /usr/bin from install of hadoop-1.2.1-1.x86_64 conflicts with file from package filesystem-3.8-2.el8.x86_64

Hi@akhtar, Your Hadoop rpm is conflicting with some ...READ MORE

Sep 21, 2020 in Big Data Hadoop by MD
• 95,460 points
1,530 views
0 votes
1 answer

Urgently Want dataset

Hi, @Amit, Regarding your query on Datasets on (merchant ...READ MORE

Sep 21, 2020 in Big Data Hadoop by Gitika
• 65,770 points
928 views
0 votes
1 answer

How to merge two Spark DataFrames?

Hi@akhtar, You can perform join operation in spark. ...READ MORE

Sep 17, 2020 in Big Data Hadoop by MD
• 95,460 points
1,982 views
0 votes
1 answer

How to get resource utilized(memory and CPU) by each hive query which is running under single application Id?

Hi@sivachandran, You can monitor the metrics of your ...READ MORE

Sep 18, 2020 in Big Data Hadoop by MD
• 95,460 points
2,810 views
0 votes
1 answer

Can't Pass Java Agent in Hive

Hi@Som, You may forget to set the below ...READ MORE

Sep 15, 2020 in Big Data Hadoop by MD
• 95,460 points
946 views
0 votes
1 answer

I went to datadir/hdfs/nn/current but no folder called current

Hi@Wlssam, I am not able to understand your ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
• 95,460 points
688 views
0 votes
1 answer

Monitoring Hadoop with Prometheus JMX

Hi@Som, This error is not related to Prometheus ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
• 95,460 points
3,001 views
0 votes
1 answer

which version of sqoop should i use for hadoop 3.3.0?

Hi@shresht, This is just a warning. Did you ...READ MORE

Sep 7, 2020 in Big Data Hadoop by MD
• 95,460 points
2,561 views
0 votes
0 answers

which version of sqoop should i use with hadoop 3.3.0 ? [closed]

I am trying to install sqoop 1.4.7 ...READ MORE

Sep 6, 2020 in Big Data Hadoop by shresht
• 140 points

closed Sep 7, 2020 by Gitika 1,270 views
0 votes
1 answer

Multiple rows to columns in hive

Hi, You need to create your own customize ...READ MORE

Sep 4, 2020 in Big Data Hadoop by MD
• 95,460 points
3,151 views
0 votes
1 answer

SQOOP Import error - Invalid argurments

Hi@Vikramraj, You have passed wrong arguments in your ...READ MORE

Sep 1, 2020 in Big Data Hadoop by MD
• 95,460 points
1,311 views
0 votes
1 answer

Parquet File and ORC Table

Hi. @Vikramraj, Regarding your query, I would suggest ...READ MORE

Sep 1, 2020 in Big Data Hadoop by Gitika
• 65,770 points
916 views
0 votes
0 answers

How I can kill the jobs using jobID running in local mode with Hadoop

I am Running hadoop jobs in local ...READ MORE

Aug 26, 2020 in Big Data Hadoop by kamboj
• 140 points
2,477 views
0 votes
1 answer

Hadoop Small File

Hi@himanshu, To monitor your Namenode, you can create ...READ MORE

Aug 24, 2020 in Big Data Hadoop by MD
• 95,460 points
765 views
0 votes
2 answers
0 votes
1 answer

In my hadoop namenode is not starting

Hi@Aman, There may be many reasons behind this. ...READ MORE

Jul 22, 2020 in Big Data Hadoop by MD
• 95,460 points
1,341 views
0 votes
1 answer

How to download hadoop jar files for adding eclipse

Hi@Manl, To import jar file in your Eclipse ...READ MORE

Jul 20, 2020 in Big Data Hadoop by MD
• 95,460 points
6,198 views
0 votes
1 answer

input split and block size with examples

Hi@siva, Hadoop HDFS split large files into small ...READ MORE

Jul 13, 2020 in Big Data Hadoop by MD
• 95,460 points
1,612 views
0 votes
1 answer

I have to ingest in hadoop cluster large number of files for testing , what is the best way to do it?

Hi@sonali, It depends on what kind of testing ...READ MORE

Jul 8, 2020 in Big Data Hadoop by MD
• 95,460 points
1,428 views
0 votes
0 answers

Data import using sqoop to Hive

Hello Everyone, I am trying to import data ...READ MORE

Jul 3, 2020 in Big Data Hadoop by anonymous
• 120 points
1,155 views
0 votes
1 answer

How to get the column name printed in a file along with the output in Hive?

Hi @Neethu, Regarding your query, I would suggest ...READ MORE

Jul 2, 2020 in Big Data Hadoop by Gitika
• 65,770 points
1,164 views
0 votes
1 answer

Format HDFS Namenode Error: Could not find or load main class ”-Djava.library.path=.home.hadoop.hadoop-3.2.1.lib.native”

Hi@fwood, According to your configuration, you didn't set ...READ MORE

Jun 12, 2020 in Big Data Hadoop by MD
• 95,460 points
11,523 views
0 votes
0 answers
0 votes
1 answer

What are good big data courses for freshers?

Hi@akhtar, There are lots of Big Data courses ...READ MORE

May 15, 2020 in Big Data Hadoop by MD
• 95,460 points
1,237 views
0 votes
1 answer

What skills are required to be a Hadoop developer?

Hi@akhtar, To become a Hadoop developer, you should ...READ MORE

May 15, 2020 in Big Data Hadoop by MD
• 95,460 points
840 views
0 votes
1 answer

Which is the best online Big Data Hadoop course?

Hi@akhtar, As you are a beginner, you should ...READ MORE

May 15, 2020 in Big Data Hadoop by MD
• 95,460 points
1,039 views
0 votes
1 answer

Is there any alternative for edureka vm ?

you can use Hortonworks ! READ MORE

Nov 9, 2020 in Big Data Hadoop by Reza
1,010 views
0 votes
1 answer

getting error: -bash: syntax error near unexpected token `('

hi, you should give space between PigStorage and ...READ MORE

May 9, 2020 in Big Data Hadoop by anonymous
• 140 points
3,365 views
0 votes
1 answer

can we add hadoop in docker or online server or cloud

Hi@Rajan, If you are asking, can we configure hadoop ...READ MORE

May 1, 2020 in Big Data Hadoop by MD
• 95,460 points
893 views
0 votes
1 answer

Error: Couldn't properly initialize access to HDFS internals. Please update your WAL Provider to not make use of the 'asyncfs' provider.

Hi@akhtar, I think you are trying to use AsyncFSWAL for HBase-2.x as ...READ MORE

Apr 30, 2020 in Big Data Hadoop by MD
• 95,460 points
1,709 views
0 votes
1 answer

java.lang.NoSuchMethodError: java.util.concurrent.ConcurrentHashMap.keySet()Ljava/util/concurrent/ConcurrentHashMap$KeySetView

Hi@akhtar, I think there is a problem in ...READ MORE

Apr 30, 2020 in Big Data Hadoop by MD
• 95,460 points
2,045 views
0 votes
1 answer

kernel: java: page allocation failure. order:4, mode:0x20

Hi@akhtar, You may got this error because of ...READ MORE

Apr 30, 2020 in Big Data Hadoop by MD
• 95,460 points
1,273 views
0 votes
0 answers

Real time access to data in hadoop

We need to store customer billing data ...READ MORE

Apr 30, 2020 in Big Data Hadoop by anonymous
• 120 points
1,107 views
0 votes
1 answer

How to create one job in Sqoop?

Hi@akhtar, You can create one job for future ...READ MORE

Apr 29, 2020 in Big Data Hadoop by MD
• 95,460 points
1,170 views
0 votes
1 answer

Distcp From Local to HDFS giving error file not found

Hey, @Amey, This is probably because of a ...READ MORE

Apr 29, 2020 in Big Data Hadoop by Gitika
• 65,770 points
2,235 views
0 votes
1 answer

ERROR tool.BaseSqoopTool: Got error creating database manager: java.io.IOException: No manager for connect string

Hi@akhtar, I think your jdbc jars are not ...READ MORE

Apr 24, 2020 in Big Data Hadoop by MD
• 95,460 points
3,429 views
0 votes
1 answer

error:org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:456)] HDFS IO error java.io.IOException

Hi@akhtar, There may be problem in firewall, so ...READ MORE

Apr 23, 2020 in Big Data Hadoop by MD
• 95,460 points
1,863 views
0 votes
1 answer
0 votes
0 answers

Hi. I keep on encountering the follow error when running conf in flume via flume-ng at line 189. Any possible solutions?

Running FLUME agent :     class: org.apache.flume.node.Application     arguments: -n agent1 ...READ MORE

Apr 23, 2020 in Big Data Hadoop by anonymous
• 120 points
1,539 views
0 votes
1 answer

Error while starting the daemon process in windows 10

Hi@Arun, By default, the parameter "dfs.datanode.failed.volumes.tolerated" is set ...READ MORE

Apr 20, 2020 in Big Data Hadoop by MD
• 95,460 points
8,644 views
0 votes
1 answer

ERROR 2999: Unexpected internal error. Failed to create DataStorage.

Hi@akhtar, I think you didn't set all the ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,460 points
1,715 views
0 votes
1 answer

INFO hdfs.DFSClient: Could not obtain block blk_-from any node: java.io.IOException: No live nodes contain current block

Hi@akhtar, I think your Datanodes are not in ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,460 points
2,657 views
0 votes
1 answer

java.io.IOException: File /user/hadoop/ could only be replicated to 0 nodes, instead of 1

Hi@akhtar, To avoid this error, follow the bellow ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,460 points
1,724 views
0 votes
1 answer

exception:org.apache.hadoop.security.AccessControlException Permission denied: user=test, access=WRITE, inode="/user/hive/warehouse/test"

Hi@akhtar, According to your error, it shows you ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,460 points
3,966 views
0 votes
1 answer

Error mapreduce.Job: Task Id : attempt_1475517800829_0009_m_000000_0, Status : FAILED Error: Java heap space

Hi@Hasid, To avoid this error, you have to ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,460 points
3,089 views