Most viewed questions in Big Data Hadoop

0 votes
1 answer

How to format the output being written by MapReduce in Hadoop?

Here is a simple code demonstrate the ...READ MORE

Sep 5, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,091 views
0 votes
1 answer

Not able to start Job History Server in Hadoop 2.8.1

You have to start JobHistoryServer process specifically ...READ MORE

Mar 30, 2018 in Big Data Hadoop by Ashish
• 2,650 points
3,091 views
0 votes
1 answer

What is the difference between a zero reducer and identity reducer in Hadoop Mapreduce?

A Zero reducer as the name suggests ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
3,087 views
+1 vote
1 answer

I installed Spark but while executing command, I am getting ‘hadoop’ command not found error?

For accessing Hadoop commands & HDFS, you ...READ MORE

Mar 21, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,086 views
+3 votes
5 answers

Hadoop DistributedCache is deprecated - what is the preferred API?

I had the same problem. And not ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rohan
3,079 views
0 votes
1 answer

What does AM in “AM Container” mean in Hadoop

Here's another link from Hadoop which may ...READ MORE

Nov 2, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,078 views
0 votes
1 answer

How to configure Hadoop Client?

Hi@akhtar, To configure the Hadoop Client, you need ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,460 points
3,073 views
0 votes
1 answer

Why HBase is column oriented database?

Hey, Yes, Hbase is known to be a ...READ MORE

May 20, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,071 views
0 votes
3 answers

Can we run Spark without using Hadoop?

No, you can run spark without hadoop. ...READ MORE

May 7, 2019 in Big Data Hadoop by pradeep
3,067 views
+1 vote
1 answer

Streaming facebook data using Flume framework!!!

Hi You can find the facebook 'API' from ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
3,065 views
0 votes
1 answer

Explain to me to run Spark without Hadoop

Spark is capable to Perform in three ...READ MORE

Apr 12, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
3,062 views
0 votes
1 answer

Hadoop mapreduce error: apache.hadoop.mapred.FileAlreadyExistsException: Output directory

Seems like the output file already exists. ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,054 views
0 votes
1 answer

which of the following are hadoop built in counters?

MapReduce in Hadoop maintains some built-in counters ...READ MORE

Dec 20, 2021 in Big Data Hadoop by Kavya
• 700 points
3,047 views
0 votes
1 answer

which version of sqoop should i use for hadoop 3.3.0?

Hi@shresht, This is just a warning. Did you ...READ MORE

Sep 7, 2020 in Big Data Hadoop by MD
• 95,460 points
3,047 views
0 votes
1 answer

How can you transfer data from hive to HDFS ?

Hey, Data in Hive tables reside on HDFS, ...READ MORE

May 16, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,041 views
0 votes
1 answer

What is the standard way to create files in your hdfs file-system?

Well, it's so easy. Just enter the below ...READ MORE

Sep 23, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,037 views
0 votes
1 answer

Understanding Hadoop Master Node, Slave Node and Data Node.

The NameNode and the JobTracker are single ...READ MORE

Sep 6, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,036 views
0 votes
1 answer

How to find in incorrect file/records in hive?

A value with a wrong datatype causes ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Ritu
3,035 views
0 votes
1 answer

Hadoop: How to keep duplicates in Hive using collect_set()?

SELECT hash_id, COLLECT_LIST(num_of_cats) AS ...READ MORE

Nov 2, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,035 views
0 votes
1 answer

How to copy files in hdfs with wildcards?

You can use the hdfs command: hdfs fs ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,033 views
0 votes
1 answer

Exporting of ORC file to RDBMS using SQOOP

We have to use Sqoop-HCatalog Integration here. ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Rishi
3,028 views
0 votes
1 answer

failed to start the Namenode format in hadoop generation 2

Hi, You can check this out: 1. Delete all ...READ MORE

Jul 2, 2019 in Big Data Hadoop by Ria

edited Jul 2, 2019 by Gitika 3,024 views
0 votes
1 answer

User:hdfs not allowed to do 'DECRYPT_EEK' on 'key'.

Hi@Shilpa, I don't think you have given permission ...READ MORE

Nov 20, 2020 in Big Data Hadoop by MD
• 95,460 points
3,021 views
0 votes
1 answer

Hadoop giving java.io.IOException, in mkdir Java code.

I am not sure about the issue. ...READ MORE

May 3, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,017 views
0 votes
1 answer

How to find the used cache in HDFS

hdfs dfsadmin -report This command tells fs ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,012 views
0 votes
1 answer

How to change default block size in Hadoop Cluster?

Hi@akhtar, You can change the default block size ...READ MORE

Oct 3, 2020 in Big Data Hadoop by MD
• 95,460 points
3,011 views
0 votes
1 answer

Hadoop: ERROR1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]

Hi, I can see the error arose because the count ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,009 views
0 votes
1 answer

How to connect Sqoop to mysql Database?

Hi. You can connect Sqoop to MySql ...READ MORE

May 15, 2019 in Big Data Hadoop by Tina
3,008 views
0 votes
1 answer

Zookeeper server going down frequently.

Hi@B, There may be several reasons behind this. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,460 points
3,007 views
0 votes
1 answer

How to create a Hive Database and store it in HDFS?

You will have to exclusively mention the ...READ MORE

May 20, 2019 in Big Data Hadoop by Jishnu
3,005 views
0 votes
1 answer

Parquet & Avro File hadling with HIVE

For avro you can follow the format ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Tarun
3,000 views
0 votes
1 answer

main" java.io.IOException: Mkdirs failed to create /user/hadoop/name.

Hi@akhtar,  I think you missed to add below property ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,460 points
2,997 views
0 votes
1 answer

Passing keys and values to the reducers during a standard sort and shuffle phase of MapReduce

Let me explain you the whole scenario Reducer ...READ MORE

Jul 27, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,991 views
0 votes
1 answer

Command to listing all the tables In HBase?

Hey, list is the command that is used ...READ MORE

May 23, 2019 in Big Data Hadoop by Gitika
• 65,730 points
2,988 views
0 votes
1 answer

What are the different types of tombstone markers in HBase for deletion?

1)Family Delete Marker- This markers marks all ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,985 views
0 votes
1 answer

Exception in thread "main" java.lang.NoClassDefFoundError

As far I can make out from ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Arpit
2,978 views
0 votes
1 answer

Sqoop error while trying to connect to MySql

Please use the below command to solve ...READ MORE

May 22, 2019 in Big Data Hadoop by Bhagavath
2,976 views
0 votes
1 answer

How to open MySql console in Ubuntu?

sudo service mysqld restart mysql -u <username> root ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,971 views
0 votes
1 answer

How to install and configure a multi-node Hadoop cluster?

I would recommend you to install Cent ...READ MORE

Mar 22, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,968 views
0 votes
1 answer

How can I write text in HDFS using CMD?

Hadoop put & appendToFile only reads standard ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,962 views
0 votes
2 answers

How to see MySql service is running or not using linux command?

Hi, You can simply run the following commands ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
2,961 views
0 votes
1 answer

Permission denied at hdfs

You can spolve this by adding below ...READ MORE

Sep 27, 2018 in Big Data Hadoop by digger
• 26,740 points
2,960 views
0 votes
1 answer

Is there any way to pull data from Mainframe to Hadoop?

First of all, COBOL is a programming ...READ MORE

May 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,955 views
0 votes
0 answers

How I can kill the jobs using jobID running in local mode with Hadoop

I am Running hadoop jobs in local ...READ MORE

Aug 26, 2020 in Big Data Hadoop by kamboj
• 140 points
2,950 views
0 votes
1 answer

What is the extension of archive file created in Hadoop?

Hadoop archive is a facility which packs ...READ MORE

Dec 9, 2021 in Big Data Hadoop by Kavya
• 700 points
2,949 views
0 votes
1 answer

Can a table be renamed in hive?

Hey, Yes, you can rename a table in ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,730 points
2,948 views
0 votes
1 answer

Explain to me the correct way to get a Hadoop FileSystem object so that I can use it for reading from HDFS as well as writing to HDFS.

FileSystem needs only one configuration key to successfully ...READ MORE

Jun 7, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,942 views
0 votes
1 answer

what does velocity in big data mean?

Velocity refers to the speed at which ...READ MORE

Dec 14, 2021 in Big Data Hadoop by Edureka
• 12,700 points
2,930 views
0 votes
1 answer

INFO hdfs.DFSClient: Could not obtain block blk_-from any node: java.io.IOException: No live nodes contain current block

Hi@akhtar, I think your Datanodes are not in ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,460 points
2,929 views
0 votes
0 answers

HIve sql multiple conditions in where cluase

Hi, My table has created_date, changed_date in datetime ...READ MORE

Feb 12, 2020 in Big Data Hadoop by syam
• 120 points

edited Feb 12, 2020 by Gitika 2,928 views