Most viewed questions in Big Data Hadoop

0 votes
1 answer

Setting textinputformat.record.delimiter in spark

I got this working with plain uncompressed ...READ MORE

Oct 10, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,623 views
0 votes
1 answer

How a client reads a file from HDFS?

Let me explain you it briefly. So, ...READ MORE

Jul 31, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,623 views
0 votes
1 answer

Error connecting hive using python pyhs2

Seems like the host IP is not ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,621 views
0 votes
1 answer

Not able to create Hive table from HDFS file

You dont have to specify the file name ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,617 views
0 votes
1 answer

Mention what are the main configuration parameters that user need to specify to run MapReduce Job?

Hi, The user of the MapReduce framework needs ...READ MORE

Jun 10, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,613 views
0 votes
1 answer

Command to listing all the tables In HBase?

Hey, list is the command that is used ...READ MORE

May 23, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,612 views
0 votes
1 answer

can we store hive output in hadoop hdfs

Hi, You can save your hive output to ...READ MORE

Feb 24, 2020 in Big Data Hadoop by MD
• 95,460 points
2,608 views
0 votes
1 answer

Sqoop import error with sqoop job

Please try the below command: sqoop job -create ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Rina
2,600 views
0 votes
1 answer

what does velocity in big data mean?

Velocity refers to the speed at which ...READ MORE

Dec 14, 2021 in Big Data Hadoop by Edureka
• 12,690 points
2,596 views
0 votes
1 answer

What are the challenges we faced as Hadoop Admin?

Hey,  There are some of the key responsibilities ...READ MORE

Jun 25, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,595 views
0 votes
1 answer

I need to copy data from one HDFS to another HDFS. Can you help me do so?

I understood your issue. Let me help you ...READ MORE

May 16, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,595 views
0 votes
1 answer

Hadoop: Not able to start Namenode

Stop all running server 1) stop-all.sh Edit the ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,593 views
0 votes
1 answer

How can I write text in HDFS using CMD?

Hadoop put & appendToFile only reads standard ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,590 views
0 votes
1 answer

Why Apache Pig is used instead of Hadoop?

As you know writing mapreduce programs in ...READ MORE

May 8, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,585 views
0 votes
1 answer

which one is better bigdata or devops for career

I think Big Data will be good ...READ MORE

Aug 26, 2019 in Big Data Hadoop by Karan
2,580 views
0 votes
1 answer

JDBC connection to Hive using TLS/SSL

Hi. The properties are right but in ...READ MORE

May 31, 2019 in Big Data Hadoop by Karan
2,577 views
+1 vote
1 answer

starting hive gave me exception

Hi@Hans, You may got this error, if you ...READ MORE

May 20, 2020 in Big Data Hadoop by MD
• 95,460 points
2,573 views
0 votes
1 answer

Path to hiverc file

The hiverc file is not created by ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Jishan
2,569 views
0 votes
2 answers

Which framework allows random, realtime read/write access to hundreds of terabytes of data?

For this type of case you can ...READ MORE

Aug 14, 2018 in Big Data Hadoop by anonymous
2,566 views
0 votes
2 answers

How to see MySql service is running or not using linux command?

Hi, You can simply run the following commands ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
2,564 views
0 votes
1 answer

which version of sqoop should i use for hadoop 3.3.0?

Hi@shresht, This is just a warning. Did you ...READ MORE

Sep 7, 2020 in Big Data Hadoop by MD
• 95,460 points
2,561 views
0 votes
1 answer

How to add mysql database for Hue Query app?

Hi. To add mysql database in the config, open ...READ MORE

May 27, 2019 in Big Data Hadoop by Vasu
2,558 views
–1 vote
1 answer

Setting Hive properties

Hey. It's definitely not a stupid question. ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,547 views
0 votes
1 answer

What is the extension of archive file created in Hadoop?

Hadoop archive is a facility which packs ...READ MORE

Dec 9, 2021 in Big Data Hadoop by Kavya
• 700 points
2,545 views
0 votes
1 answer

How to enable impersonation in HiveServer2?

You have to configure 2 files for ...READ MORE

Jun 3, 2019 in Big Data Hadoop by Reshma
2,543 views
0 votes
3 answers

Can we run Spark without using Hadoop?

No, you can run spark without hadoop. ...READ MORE

May 7, 2019 in Big Data Hadoop by pradeep
2,539 views
+1 vote
1 answer

Why do we use STORE command in pig?

Hey, We use store command to store the ...READ MORE

May 7, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,538 views
0 votes
1 answer

Change permissions of a file in HDFS.

Hi@akhtar, You can use the Chmod command to ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,460 points
2,531 views
+3 votes
5 answers

Hadoop DistributedCache is deprecated - what is the preferred API?

I had the same problem. And not ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rohan
2,530 views
0 votes
1 answer

Hadoop job getting executed in local mode only?

Basically, you have not configured the mapreduce.framework.name ...READ MORE

May 3, 2018 in Big Data Hadoop by Atul
• 10,240 points
2,530 views
0 votes
1 answer

Is there any hdfs dfs command to restrict number of files to be created in a directory ?

Not sure about the command but you ...READ MORE

May 6, 2019 in Big Data Hadoop by Shri
2,503 views
0 votes
1 answer

What is SerDe in Hive?

Hey, The SerDe interface allows you to instruct ...READ MORE

May 14, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,502 views
0 votes
1 answer

Hadoop query regarding setJarByClass method of Job class

setJarByClass method basically tells the nodes where ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,498 views
0 votes
1 answer

How to set input split settings?

It can be controlled by setting the ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,490 views
0 votes
1 answer

Problem connecting Sqoop to MySql

Perhaps, you have slightly misunderstood the method ...READ MORE

May 15, 2019 in Big Data Hadoop by Ali
2,488 views
0 votes
1 answer

Use of MapReduce in PIG

Apache Pig programs are written in a ...READ MORE

Jul 25, 2018 in Big Data Hadoop by shams
• 3,670 points
2,486 views
0 votes
1 answer

Is it compulsory to have the hadoop user as sudo user?

No, it is not important to have ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,484 views
–1 vote
1 answer

Sqoop split-by problem

Hello. The -m or --num-mappers is just a ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,479 views
0 votes
0 answers

How I can kill the jobs using jobID running in local mode with Hadoop

I am Running hadoop jobs in local ...READ MORE

Aug 26, 2020 in Big Data Hadoop by kamboj
• 140 points
2,477 views
0 votes
1 answer

How to find the number of blocks for a file in Hadoop?

Hi@akhtar, You can use Hadoop file system command to ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,460 points
2,476 views
0 votes
1 answer

How to run MapReduce program?

Eclipse is already installed in the Edureka ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Suman
2,476 views
0 votes
1 answer

ERROR 2997: Encountered IOException. Directory does not exist.

Hi. I think the reason for this ...READ MORE

May 23, 2019 in Big Data Hadoop by Britney
2,470 views
0 votes
1 answer

Changing hostname in fs.default.name property puts Hadoop in safemode

First of all, in Safe mode the ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,465 views
0 votes
1 answer

What is the Path of hdfs.site.xml?

Here's where you can find the file: /etc/hadoop/[service ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,463 views
0 votes
1 answer

How to run Hadoop in Docker containers?

Hi, You can run Hadoop in Docker container. Follow ...READ MORE

Jan 24, 2020 in Big Data Hadoop by MD
• 95,460 points
2,462 views
0 votes
1 answer

Why does one remove or add nodes in a Hadoop cluster frequently?

One of the most attractive features of ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,451 views
0 votes
1 answer

How Impala is fast compared to Hive in terms of query response?

Impala provides faster response as it uses MPP(massively ...READ MORE

Mar 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,449 views
0 votes
1 answer

How to perform a word count on a dataframe column?

You can use the below code to ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,446 views
0 votes
1 answer

Zookeeper server going down frequently.

Hi@B, There may be several reasons behind this. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,460 points
2,445 views