Most viewed questions in Big Data Hadoop

0 votes
1 answer

How to load data from HDFS into pig relation?

Hey, To load data from HDFS to pig ...READ MORE

May 7, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,351 views
0 votes
1 answer

getting error: -bash: syntax error near unexpected token `('

hi, you should give space between PigStorage and ...READ MORE

May 9, 2020 in Big Data Hadoop by anonymous
• 140 points
3,350 views
0 votes
1 answer

Can DataNode and NameNode be commodity hardware?

DataNodes are the commodity hardware only as ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Neha
• 6,300 points
3,343 views
0 votes
1 answer

Value for HADOOP_CONF_DIR from Cluster

Install Hadoop as well. In my case ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Frankie
• 9,830 points
3,335 views
0 votes
1 answer

Not able to run hdfs commands

Because you said it ran yesterday and ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,220 points
3,326 views
0 votes
1 answer

How to change the Hive table comment?

Yes, it is possible to change the ...READ MORE

May 20, 2019 in Big Data Hadoop by Tina
3,323 views
0 votes
1 answer

What is difference between Oozie workflow, coordinator and bundle ?

Workflow does not have time specifications to ...READ MORE

Mar 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
3,323 views
0 votes
1 answer

What metadata is stored on a DataNode when a block is written to it?

Let me explain you step by step.  Each ...READ MORE

Jul 23, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,318 views
0 votes
1 answer

Difference between a failed task attempt and a killed task attempt

Let me explain you the difference between ...READ MORE

Jul 24, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,315 views
0 votes
1 answer

Differences between Hadoop-common, Hadoop-core and Hadoop-client?

To help provide some additional details regarding ...READ MORE

Mar 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
3,301 views
0 votes
1 answer

Not able to insert in hive partition table

You have to add the partition before ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,299 views
0 votes
1 answer

Command to see the status of MapReduce job?

Hi, You can use this command given below: Syntax: $ ...READ MORE

Jun 14, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,298 views
0 votes
1 answer

What is ETL tool in Hadoop?

Hi@akhtar, ETL means extract, transform, load. It is ...READ MORE

Feb 2, 2020 in Big Data Hadoop by MD
• 95,460 points
3,287 views
0 votes
1 answer

How do you start and stop region server in HBase?

Hey, You can run multiple region servers from ...READ MORE

May 23, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,286 views
0 votes
1 answer

Difference b/w reduce and reduceLeft

The reduceLeft method takes an associative binary ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Kriti
3,280 views
0 votes
1 answer

Copy a table in HBase

Directly its not possible as in case ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Loki
3,280 views
0 votes
1 answer

Using HBase jar files. Where to download and set classpath

There are many sites you can get ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,278 views
0 votes
1 answer

How to create a FileSystem object that can be used for reading from and writing to HDFS?

Read operation on HDFS In order to read ...READ MORE

Mar 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points

edited Mar 22, 2018 by nitinrawat895 3,270 views
0 votes
1 answer

How to Rerunning a Coordinator Action or Multiple Actions in Oozie?

Hey, The rerun option reruns a terminated (=TIMEDOUT=, SUCCEEDED, KILLED, ...READ MORE

Jun 24, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,268 views
+1 vote
1 answer

How to copy file from Local file system to HDFS?

Hi@akhtar, You can copy files from your local ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,460 points
3,258 views
0 votes
1 answer

Installing Oozie on Linux System

Download Oozie from this link: http://www.apache.org/dyn/closer.lua/oozie/ Extract the files. ...READ MORE

Feb 28, 2019 in Big Data Hadoop by Rajan
3,254 views
0 votes
1 answer

What are active and passive “NameNodes” in Hadoop?

In HA (High Availability) architecture, we have ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,245 views
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,242 views
0 votes
1 answer

Issue with Python Read file as stream from HDFS.

The easiest way is using the following ...READ MORE

Jun 26, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
3,241 views
0 votes
1 answer

What is Metastore in Hive?

It stores metadata for Hive tables (like their schema ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,235 views
0 votes
1 answer

Start-dfs.sh daemons not starting. localhost: mkdir: cannot create directory `/user': Permission denied

Make the following changes to the hadoop-env.sh ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,235 views
0 votes
1 answer

How to change block size in Hadoop dynamically?

Hi@akhtar, By default, the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by akhtar
• 38,260 points
3,234 views
–1 vote
1 answer

Display contents of my Parquet file.

Make sure you are running from the ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,229 views
0 votes
1 answer

how to store images and videos on to HDFS?

HDFS is capable to accept data in ...READ MORE

Jul 16, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
3,227 views
0 votes
1 answer

How to increase reducers in Hive?

By default, only one reducer is assigned ...READ MORE

May 21, 2019 in Big Data Hadoop by Lohit
3,220 views
0 votes
1 answer

Hive: org.apache.hadoop.security.AccessControlException Permission denied: user

This error is generally thrown when the ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Waniku
3,205 views
0 votes
1 answer

How to import data to hbase database?

First you have to have the file ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Kiran
3,200 views
0 votes
1 answer

How to delete a directory from Hadoop cluster which is having comma(,) in its name?

Just try the following command: hadoop fs -rm ...READ MORE

May 7, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,189 views
0 votes
1 answer

What is the use of ZooKeeper in Hbase?

Hey, The zookeeper is used to maintain the ...READ MORE

May 21, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,187 views
0 votes
1 answer

Pig: Difference between inner bag and outer bag

Outer Bag: An outer bag is nothing but ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Firoz
3,172 views
0 votes
1 answer

How to use Hbase shell in a bash script?

Hello, To write scripts with HBase shell it includes non-interactive mode, ...READ MORE

May 29, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,169 views
0 votes
1 answer

Multiple rows to columns in hive

Hi, You need to create your own customize ...READ MORE

Sep 4, 2020 in Big Data Hadoop by MD
• 95,460 points
3,137 views
0 votes
1 answer

Write data into hive table in a parquet

Below is an example query which you ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Sadu
3,132 views
0 votes
1 answer

Hdfs Service Systemd - startup

I guess the issue you are facing ...READ MORE

Mar 29, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,130 views
0 votes
1 answer

Sqoop export not working

The issue that you might be getting ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Tina
3,127 views
0 votes
1 answer

What is Shared Edit Logs in case of Stand By Name Node in Hadoop 2.x?

Yes, Shared Edit Logs exist in case ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Hansini
3,127 views
0 votes
1 answer

What is fork Keyword in Oozie? How Fork and Join keyword are related t o each other in Oozie?

Hey, Basically, when we want to run multiple jobs ...READ MORE

Jun 12, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,122 views
0 votes
1 answer

How to practice programming with Hadoop?

Well there are multiple ways to solve ...READ MORE

Mar 30, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
3,120 views
0 votes
1 answer

How to use appnedToFile command in HDFS?

Hey, This Hadoop fs command appends single sources ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,090 views
0 votes
1 answer

Error mapreduce.Job: Task Id : attempt_1475517800829_0009_m_000000_0, Status : FAILED Error: Java heap space

Hi@Hasid, To avoid this error, you have to ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,460 points
3,080 views
0 votes
1 answer

What is the significance of ‘IF EXISTS” clause while dropping a table in Hive?

Hi, Since the table being dropped does not ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,076 views
0 votes
1 answer

org.datanucleus.store.rdbms.exceptions.MissingTableException: Required table missing : "DBS" in Catalog "" Schema "".

Hi@akhtar, Here you have to add the below  ...READ MORE

Feb 5, 2020 in Big Data Hadoop by MD
• 95,460 points
3,064 views
0 votes
0 answers