Most viewed questions in Big Data Hadoop

0 votes
1 answer

Sqoop could not load db driver class

Hello, Have you tried to put the both ...READ MORE

Dec 13, 2019 in Big Data Hadoop by Alexandru
• 510 points
3,064 views
0 votes
1 answer

Hive: org.apache.hadoop.security.AccessControlException Permission denied: user

This error is generally thrown when the ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Waniku
3,064 views
0 votes
1 answer

Value for HADOOP_CONF_DIR from Cluster

Install Hadoop as well. In my case ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Frankie
• 9,830 points
3,062 views
0 votes
1 answer

Start-dfs.sh daemons not starting. localhost: mkdir: cannot create directory `/user': Permission denied

Make the following changes to the hadoop-env.sh ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,230 points
3,061 views
0 votes
1 answer

Install PostgreSQL JDBC driver for Sqoop

All you have to do to install ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Quill
3,058 views
–1 vote
1 answer

Unable to execute the jar file wordcount.

I see that the command that you ...READ MORE

Jan 21, 2019 in Big Data Hadoop by Omkar
• 69,230 points
3,055 views
0 votes
1 answer

How to change the Hive table comment?

Yes, it is possible to change the ...READ MORE

May 20, 2019 in Big Data Hadoop by Tina
3,053 views
0 votes
1 answer

Sqoop: Dsqoop.export.records.per.statement option

Dsqoop.export.records.per.statement=1 is as the name suggests how many ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Krish
3,045 views
0 votes
1 answer

What metadata is stored on a DataNode when a block is written to it?

Let me explain you step by step.  Each ...READ MORE

Jul 23, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,039 views
0 votes
1 answer

What are active and passive “NameNodes” in Hadoop?

In HA (High Availability) architecture, we have ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,025 views
0 votes
1 answer

Not able to insert data into hive table

Seems like a hive version problem.​ insert operation is ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
3,023 views
0 votes
1 answer

How do you start and stop region server in HBase?

Hey, You can run multiple region servers from ...READ MORE

May 23, 2019 in Big Data Hadoop by Gitika
• 65,890 points
3,017 views
0 votes
1 answer

How to delete a directory from Hadoop cluster which is having comma(,) in its name?

Just try the following command: hadoop fs -rm ...READ MORE

May 7, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,003 views
0 votes
1 answer

Issue with Python Read file as stream from HDFS.

The easiest way is using the following ...READ MORE

Jun 26, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
3,001 views
+2 votes
5 answers

Not able to start hadoop dfs

You can re-install openssh-client and openssh-server: $ sudo ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Jino
2,998 views
0 votes
1 answer

Installing Oozie on Linux System

Download Oozie from this link: http://www.apache.org/dyn/closer.lua/oozie/ Extract the files. ...READ MORE

Feb 28, 2019 in Big Data Hadoop by Rajan
2,996 views
0 votes
1 answer

What is difference between Oozie workflow, coordinator and bundle ?

Workflow does not have time specifications to ...READ MORE

Mar 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,995 views
0 votes
1 answer

How to change block size in Hadoop dynamically?

Hi@akhtar, By default, the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by akhtar
• 38,260 points
2,989 views
0 votes
1 answer

How to use Hbase shell in a bash script?

Hello, To write scripts with HBase shell it includes non-interactive mode, ...READ MORE

May 29, 2019 in Big Data Hadoop by Gitika
• 65,890 points
2,985 views
–1 vote
1 answer

Display contents of my Parquet file.

Make sure you are running from the ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,978 views
0 votes
1 answer

How to update the existing record in HDFS?

Hi@akhtar, HDFS follows Write Once Read Many times ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,460 points
2,974 views
0 votes
1 answer

Command to see the status of MapReduce job?

Hi, You can use this command given below: Syntax: $ ...READ MORE

Jun 14, 2019 in Big Data Hadoop by Gitika
• 65,890 points
2,968 views
0 votes
1 answer

Can DataNode and NameNode be commodity hardware?

DataNodes are the commodity hardware only as ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Neha
• 6,300 points
2,964 views
0 votes
1 answer

How to Rerunning a Coordinator Action or Multiple Actions in Oozie?

Hey, The rerun option reruns a terminated (=TIMEDOUT=, SUCCEEDED, KILLED, ...READ MORE

Jun 24, 2019 in Big Data Hadoop by Gitika
• 65,890 points
2,961 views
0 votes
1 answer

Write data into hive table in a parquet

Below is an example query which you ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Sadu
2,956 views
0 votes
1 answer

how to store images and videos on to HDFS?

HDFS is capable to accept data in ...READ MORE

Jul 16, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,952 views
0 votes
1 answer

Using HBase jar files. Where to download and set classpath

There are many sites you can get ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,948 views
0 votes
1 answer

Copy a table in HBase

Directly its not possible as in case ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Loki
2,939 views
0 votes
1 answer

How to create a FileSystem object that can be used for reading from and writing to HDFS?

Read operation on HDFS In order to read ...READ MORE

Mar 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points

edited Mar 22, 2018 by nitinrawat895 2,934 views
0 votes
1 answer

ERROR tool.BaseSqoopTool: Got error creating database manager: java.io.IOException: No manager for connect string

Hi@akhtar, I think your jdbc jars are not ...READ MORE

Apr 24, 2020 in Big Data Hadoop by MD
• 95,460 points
2,933 views
0 votes
0 answers
0 votes
1 answer

Difference b/w reduce and reduceLeft

The reduceLeft method takes an associative binary ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Kriti
2,929 views
0 votes
1 answer

What is the use of ZooKeeper in Hbase?

Hey, The zookeeper is used to maintain the ...READ MORE

May 21, 2019 in Big Data Hadoop by Gitika
• 65,890 points
2,904 views
0 votes
1 answer

What is ETL tool in Hadoop?

Hi@akhtar, ETL means extract, transform, load. It is ...READ MORE

Feb 2, 2020 in Big Data Hadoop by MD
• 95,460 points
2,891 views
0 votes
1 answer

Error mapreduce.Job: Task Id : attempt_1475517800829_0009_m_000000_0, Status : FAILED Error: Java heap space

Hi@Hasid, To avoid this error, you have to ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,460 points
2,880 views
0 votes
1 answer

Hadoop Hive Hbase: How to insert data into Hbase using Hive (JSON file)?

You can use the get_json_object function to parse the ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,879 views
–1 vote
1 answer

Error while creating Hive Database table

In your error, it says that the ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
• 69,230 points
2,875 views
0 votes
1 answer

What is fork Keyword in Oozie? How Fork and Join keyword are related t o each other in Oozie?

Hey, Basically, when we want to run multiple jobs ...READ MORE

Jun 12, 2019 in Big Data Hadoop by Gitika
• 65,890 points
2,858 views
0 votes
1 answer

How will you decide whether you need to use the Capacity Scheduler or the Fair Scheduler?

Fair Scheduling is the process in which ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,857 views
0 votes
1 answer

Hdfs Service Systemd - startup

I guess the issue you are facing ...READ MORE

Mar 29, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,857 views
0 votes
1 answer

How to practice programming with Hadoop?

Well there are multiple ways to solve ...READ MORE

Mar 30, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,830 views
+1 vote
1 answer

How to copy file from Local file system to HDFS?

Hi@akhtar, You can copy files from your local ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,460 points
2,822 views
0 votes
1 answer

What is the significance of ‘IF EXISTS” clause while dropping a table in Hive?

Hi, Since the table being dropped does not ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,890 points
2,822 views
0 votes
1 answer

What is the difference between Hive internal tables and external tables?

Hive has a relational database on the ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Neha
• 6,300 points
2,822 views
0 votes
1 answer

How to install RHadoop packages (RMR, RHDFS, RHBase)?

With dev tools you can install directly ...READ MORE

Jul 5, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,821 views
0 votes
1 answer

What is Shared Edit Logs in case of Stand By Name Node in Hadoop 2.x?

Yes, Shared Edit Logs exist in case ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Hansini
2,817 views
0 votes
1 answer

Hive: Dropping a not empty database

This behavior is because Hive by default ...READ MORE

May 20, 2019 in Big Data Hadoop by Rakshit
2,812 views
0 votes
1 answer

How to write a file in HDFS using Java Programming language?

Define the HADOOP_CONF_DIR environment variable to your Hadoop configuration ...READ MORE

Sep 28, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,811 views
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,808 views