Most viewed questions in Big Data Hadoop

0 votes
1 answer

What are the challenges we faced as Hadoop Admin?

Hey,  There are some of the key responsibilities ...READ MORE

Jun 25, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 2,313 views
0 votes
1 answer

Exception in createBlockOutputStream java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect.[connection-pending remote=/ xxx:50010]

Hi@akhtar, This type of error indicates a write ...READ MORE

Apr 30, 2020 in Big Data Hadoop by MD
 • 95,440 points • 2,299 views
0 votes
1 answer

Not able to create Hive table from HDFS file

You dont have to specify the file name ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,296 views
0 votes
1 answer

Explain to me the correct way to get a Hadoop FileSystem object so that I can use it for reading from HDFS as well as writing to HDFS.

FileSystem needs only one configuration key to successfully ...READ MORE

Jun 7, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 2,294 views
0 votes
1 answer

Java MapReduce error saying No FileSystem for scheme:hdfs

The problem is with the dependencies. The ...READ MORE

May 9, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,292 views
0 votes
1 answer

How to configure Hadoop Client?

Hi@akhtar, To configure the Hadoop Client, you need ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
 • 95,440 points • 2,291 views
0 votes
1 answer

How to open MySql console in Ubuntu?

sudo service mysqld restart mysql -u <username> root ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,289 views
0 votes
1 answer

How to format the output being written by MapReduce in Hadoop?

Here is a simple code demonstrate the ...READ MORE

Sep 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,289 views
–1 vote
1 answer

Namenode not running

Never mind. I forgot to run hadoop namenode ...READ MORE

Dec 27, 2018 in Big Data Hadoop by digger
 • 26,740 points • 2,279 views
0 votes
1 answer

What is the difference between a zero reducer and identity reducer in Hadoop Mapreduce?

A Zero reducer as the name suggests ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 2,275 views
0 votes
1 answer

How to fetch more data from database while using Sqoop import?

Hey. You guessed it right. The max ...READ MORE

May 15, 2019 in Big Data Hadoop by Gani
 • 2,274 views
0 votes
1 answer

Sqoop import error with sqoop job

Please try the below command: sqoop job -create ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Rina
 • 2,269 views
0 votes
1 answer

How to find in incorrect file/records in hive?

A value with a wrong datatype causes ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Ritu
 • 2,267 views
+2 votes
1 answer

windows 10 C:\Users\mk>hadoop -version output:- Error: Could not find or load main class P.

Hey, I guess the error you are facing ...READ MORE

May 10, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 2,267 views
0 votes
1 answer

Sqoop error while trying to connect to MySql

Please use the below command to solve ...READ MORE

May 22, 2019 in Big Data Hadoop by Bhagavath
 • 2,261 views
0 votes
1 answer

Hadoop giving java.io.IOException, in mkdir Java code.

I am not sure about the issue. ...READ MORE

May 3, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,260 views
0 votes
1 answer

How do I print hadoop properties in command line?

You can dump Hadoop config by running: $ ...READ MORE

Aug 23, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,259 views
0 votes
1 answer

Determining how many mappers will run?

Here what happens is, each file would ...READ MORE

Aug 9, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,259 views
0 votes
1 answer

which one is better bigdata or devops for career

I think Big Data will be good ...READ MORE

Aug 26, 2019 in Big Data Hadoop by Karan
 • 2,252 views
0 votes
1 answer

How to copy files in hdfs with wildcards?

You can use the hdfs command: hdfs fs ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,251 views
0 votes
1 answer

Monitoring Hadoop with Prometheus JMX

Hi@Som, This error is not related to Prometheus ...READ MORE

Sep 14, 2020 in Big Data Hadoop by MD
 • 95,440 points • 2,237 views
0 votes
1 answer

Hadoop mapreduce error: apache.hadoop.mapred.FileAlreadyExistsException: Output directory

Seems like the output file already exists. ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,234 views
0 votes
1 answer

How hadoop command works with javac?

Javac is used for compiling your java ...READ MORE

Aug 17, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 2,225 views
0 votes
0 answers

HIve sql multiple conditions in where cluase

Hi, My table has created_date, changed_date in datetime ...READ MORE

Feb 12, 2020 in Big Data Hadoop by syam
 • 120 points
edited Feb 12, 2020 by Gitika • 2,224 views
0 votes
1 answer

What are the different types of tombstone markers in HBase for deletion?

1)Family Delete Marker- This markers marks all ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,223 views
0 votes
1 answer

Error running hadoop mapreduce in Python using Hadoop Streaming

Hi As you write mapper and reducer program  ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
 • 2,220 views
0 votes
2 answers

Unable to start YARN daemons. Error: Could not find or load main class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager

Hi@Akshitha, This seems like a path issue. you ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
 • 95,440 points • 2,211 views
0 votes
1 answer

Block Scanner HDFS

Block scanner runs periodically on every DataNode ...READ MORE

Jul 31, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 2,210 views
0 votes
1 answer

What is SerDe in Hive?

Hey, The SerDe interface allows you to instruct ...READ MORE

May 14, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 2,206 views
0 votes
1 answer

org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:54310/user/hduser/input.

Hi@akhtar, It seems you are providing the wrong ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
 • 95,440 points • 2,204 views
0 votes
1 answer

Zookeeper Quorum value: zookeeper.ClientCnxn: Client session timed out

Enter the below command on the Web ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 2,204 views
0 votes
1 answer

main" java.io.IOException: Mkdirs failed to create /user/hadoop/name.

Hi@akhtar,  I think you missed to add below property ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
 • 95,440 points • 2,186 views
0 votes
1 answer

How to create a Hive Database and store it in HDFS?

You will have to exclusively mention the ...READ MORE

May 20, 2019 in Big Data Hadoop by Jishnu
 • 2,186 views
0 votes
1 answer

How to set input split settings?

It can be controlled by setting the ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,182 views
0 votes
1 answer

Why Apache Pig is used instead of Hadoop?

As you know writing mapreduce programs in ...READ MORE

May 8, 2018 in Big Data Hadoop by Ashish
 • 2,650 points • 2,180 views
–1 vote
1 answer

Sqoop split-by problem

Hello. The -m or --num-mappers is just a ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,176 views
0 votes
1 answer

NameNode Status Check

There's one more way of checking the ...READ MORE

Jun 18, 2018 in Big Data Hadoop by shams
 • 3,670 points • 2,176 views
+1 vote
1 answer

Why do we use STORE command in pig?

Hey, We use store command to store the ...READ MORE

May 7, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 2,175 views
0 votes
1 answer

I need to copy data from one HDFS to another HDFS. Can you help me do so?

I understood your issue. Let me help you ...READ MORE

May 16, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 2,172 views
0 votes
1 answer

What does AM in “AM Container” mean in Hadoop

Here's another link from Hadoop which may ...READ MORE

Nov 2, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,166 views
0 votes
1 answer

Pig: Difference between inner bag and outer bag

Outer Bag: An outer bag is nothing but ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Firoz
 • 2,160 views
0 votes
1 answer

Hadoop: Adding multiple inputs with a different mapper using python

hadoop jar hadoop-multiple-streaming.jar \ ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,160 views
0 votes
1 answer

Setting textinputformat.record.delimiter in spark

I got this working with plain uncompressed ...READ MORE

Oct 10, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,157 views
0 votes
1 answer

Hadoop input folder not found?

Hey, This is because the user directory not ...READ MORE

Jun 14, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 2,156 views
0 votes
1 answer

What is the difference between local file system commands touch and touchz?

Actually they both do the same except touchz is ...READ MORE

Aug 14, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,152 views
–1 vote
1 answer

Setting Hive properties

Hey. It's definitely not a stupid question. ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 2,148 views
0 votes
1 answer

Passing keys and values to the reducers during a standard sort and shuffle phase of MapReduce

Let me explain you the whole scenario Reducer ...READ MORE

Jul 27, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,148 views
0 votes
1 answer

can we store hive output in hadoop hdfs

Hi, You can save your hive output to ...READ MORE

Feb 24, 2020 in Big Data Hadoop by MD
 • 95,440 points • 2,146 views
0 votes
1 answer

How to install and configure a multi-node Hadoop cluster?

I would recommend you to install Cent ...READ MORE

Mar 22, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,146 views
0 votes
1 answer

Understanding LongWritable

Hadoop needs to be able to serialise ...READ MORE

Oct 29, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,145 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.