Most viewed questions in Big Data Hadoop

0 votes
1 answer

How to change block size in Hadoop dynamically?

Hi@akhtar, By default, the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by akhtar
• 38,230 points
2,536 views
0 votes
1 answer

How to use appnedToFile command in HDFS?

Hey, This Hadoop fs command appends single sources ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,529 views
0 votes
1 answer

How to use load data local infile command?

This command should be executed in MySQL ...READ MORE

Feb 4, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,523 views
0 votes
1 answer

How to install Scala on Centos?

Maybe you don't have the install point ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,510 views
0 votes
1 answer

How can you transfer data from hive to HDFS ?

Hey, Data in Hive tables reside on HDFS, ...READ MORE

May 16, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,505 views
0 votes
1 answer

How to update the existing record in HDFS?

Hi@akhtar, HDFS follows Write Once Read Many times ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,440 points
2,493 views
0 votes
1 answer

Moving files in Hadoop using the Java API?

I would recommend you to use FileSystem.rename(). ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,492 views
0 votes
1 answer

How to connect Sqoop to mysql Database?

Hi. You can connect Sqoop to MySql ...READ MORE

May 15, 2019 in Big Data Hadoop by Tina
2,490 views
0 votes
1 answer

How can we ignore header line while loading data into Pig?

Suppose you need to load this in ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Kiran
2,489 views
0 votes
1 answer

Backup and Checkpoint Node

Checkpoint Node keeps track of the latest ...READ MORE

Jul 31, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,488 views
0 votes
1 answer

Current Date in Hive

Try this instead: select from_unixtime(unix_timestamp()); If you have an ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Tina
2,487 views
0 votes
1 answer

Understanding Hadoop Master Node, Slave Node and Data Node.

The NameNode and the JobTracker are single ...READ MORE

Sep 6, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,483 views
0 votes
1 answer

Killing an Application from ResourceManager Web UI

In hadoop v2.7.1, if you open the ...READ MORE

Apr 23, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,482 views
0 votes
1 answer

Apache Spark gives "Failed to load native-hadoop with error"

Seems like hadoop path is missing in java.library.path. ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,463 views
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,457 views
+1 vote
1 answer

How to copy file from Local file system to HDFS?

Hi@akhtar, You can copy files from your local ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,440 points
2,453 views
+1 vote
1 answer

How to count number of rows in alias in PIG?

COUNT is part of pig LOGS= LOAD 'log'; LOGS_GROUP= ...READ MORE

Oct 15, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,444 views
0 votes
1 answer

Sqoop export not working

The issue that you might be getting ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Tina
2,441 views
0 votes
1 answer

Error: permission denied locoalhost: chown: cannot access /usr/local/hadoop/ No such file or directory

Hey, As the error suggested that you have ...READ MORE

Jun 17, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,437 views
0 votes
1 answer

Why HBase is column oriented database?

Hey, Yes, Hbase is known to be a ...READ MORE

May 20, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,437 views
0 votes
1 answer

Output types of mapper and reducer does not match

job.setOutputValueClass will set the types expected as ...READ MORE

Jul 22, 2019 in Big Data Hadoop by Reena
2,435 views
0 votes
1 answer

Hadoop Spark: __spark_lib.zip does not exist

To find this file, your HADOOP_CONF_DIR env ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,423 views
+1 vote
1 answer

How to get status of hdfs directory using python?

import commands hdir_list = commands.getoutput('hadoop fs -ls hdfs: ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,422 views
0 votes
1 answer

How to import data to hbase database?

First you have to have the file ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Kiran
2,420 views
0 votes
1 answer

Junit test for Map Reduce Hadoop

Hi. This is the code I used ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,413 views
0 votes
2 answers

Explain to me the concept of HUE.

Definition: HUE is an open-source SQL Cloud Editor, ...READ MORE

May 16, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,406 views
0 votes
1 answer

How to find the running namenodes and secondary name nodes in hadoop?

Name nodes: hdfs getconf -namenodes Secondary name nodes: hdfs getconf ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,402 views
0 votes
1 answer

Permission denied at hdfs

You can spolve this by adding below ...READ MORE

Sep 27, 2018 in Big Data Hadoop by digger
• 26,740 points
2,402 views
0 votes
1 answer

Can a table be renamed in hive?

Hey, Yes, you can rename a table in ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,399 views
0 votes
1 answer

Multiple rows to columns in hive

Hi, You need to create your own customize ...READ MORE

Sep 4, 2020 in Big Data Hadoop by MD
• 95,440 points
2,388 views
0 votes
1 answer

How to read more than one files in Apache Spark?

Try this: val text = sc.wholeTextFiles("student/*") text.collect() ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,388 views
0 votes
1 answer

How to create Children or Sub-znode in zookeeper?

Hey, Creating children is similar to creating new ...READ MORE

May 28, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,384 views
0 votes
1 answer

org.datanucleus.store.rdbms.exceptions.MissingTableException: Required table missing : "DBS" in Catalog "" Schema "".

Hi@akhtar, Here you have to add the below  ...READ MORE

Feb 5, 2020 in Big Data Hadoop by MD
• 95,440 points
2,383 views
0 votes
1 answer

How to Suspending a Workflow, Coordinator or Bundle Job in Oozie?

Hey, The suspend option suspends a workflow job in RUNNING status. After ...READ MORE

Jun 24, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,380 views
0 votes
1 answer

Hive queries from mapreduce gives Null Pointer Exception.

I think you have upgraded CDH. This ...READ MORE

Jun 4, 2019 in Big Data Hadoop by Rihan
2,376 views
0 votes
1 answer

Exporting of ORC file to RDBMS using SQOOP

We have to use Sqoop-HCatalog Integration here. ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Rishi
2,368 views
0 votes
1 answer

Explain to me to run Spark without Hadoop

Spark is capable to Perform in three ...READ MORE

Apr 12, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,366 views
0 votes
3 answers

Cloudera Hadoop - Daemons not running

Please run below mentioned command. It will ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Priyaj
• 58,090 points
2,363 views
0 votes
1 answer

Is there any way to pull data from Mainframe to Hadoop?

First of all, COBOL is a programming ...READ MORE

May 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,359 views
0 votes
1 answer

Is it possible to change the default location of a managed table?

Hi, Yes, you can do it by using ...READ MORE

Jun 18, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,356 views
0 votes
1 answer

How a client reads a file from HDFS?

Let me explain you it briefly. So, ...READ MORE

Jul 31, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,351 views
0 votes
1 answer

What is the standard way to create files in your hdfs file-system?

Well, it's so easy. Just enter the below ...READ MORE

Sep 23, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,349 views
0 votes
1 answer

Not able to start Job History Server in Hadoop 2.8.1

You have to start JobHistoryServer process specifically ...READ MORE

Mar 30, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,339 views
0 votes
1 answer

How to get resource utilized(memory and CPU) by each hive query which is running under single application Id?

Hi@sivachandran, You can monitor the metrics of your ...READ MORE

Sep 18, 2020 in Big Data Hadoop by MD
• 95,440 points
2,336 views
0 votes
1 answer

Parquet & Avro File hadling with HIVE

For avro you can follow the format ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Tarun
2,335 views
+1 vote
1 answer

sql exception when exporting

Hello @Hemanth, the error String or binary data ...READ MORE

Sep 4, 2019 in Big Data Hadoop by Ramya
2,330 views
0 votes
1 answer

Hadoop: Can not start namenode: Unable to load native-hadoop library for your platform

The entries in your .bashrc file looks ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,330 views
0 votes
1 answer

Hadoop: Datanode not starting correctly

You can do the following method, copy to ...READ MORE

Nov 5, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,317 views
0 votes
1 answer

Hadoop: ERROR1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]

Hi, I can see the error arose because the count ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,313 views