Most viewed questions in Big Data Hadoop

0 votes
1 answer

How can I put file to HDFS directly without copying it local disk?

Can use pipe from wget to hdfs. You ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 5,113 views
0 votes
1 answer

Installing Hive & Hadoop in VM

For Hadoop installation, I would recommend you ...READ MORE

Apr 19, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 5,112 views
0 votes
1 answer

How to enable WebHDFS in the Datanodes?

In the datanodes, open the hdfs-site.xml file and add ...READ MORE

May 24, 2019 in Big Data Hadoop by Garima
 • 5,103 views
0 votes
1 answer

How to get absolute path of files in a directory in Hadoop?

You can use HDFS API like the ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 5,101 views
0 votes
1 answer

How to convert Spark data into CSV?

You can use this: df.write .option("header", "true") ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 5,070 views
0 votes
2 answers

How to set properties for secondary namenode in Hadoop?

Secondary NameNode in HDFS Secondary NameNode in Hadoop ...READ MORE

Mar 31, 2020 in Big Data Hadoop by anonymous
 • 5,067 views
+1 vote
2 answers

Unable to create external table on HIVE

Hi @Ozer, This error occurred because there is ...READ MORE

Nov 7, 2019 in Big Data Hadoop by Richa
 • 5,058 views
–1 vote
1 answer

How to uninstall and install mysql-server in centos?

Please find below the command to uninstall ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 5,042 views
0 votes
1 answer

Where is Hadoop Classpath?

It is set in hadoop-config.sh. You can add ...READ MORE

Apr 2, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 5,040 views
0 votes
1 answer

What is the difference between Apache ZooKeeper and Apache Oozie?

The main difference between these two is ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Anoop
 • 5,027 views
+1 vote
1 answer

Need help installing Flume on Windows

Hi. Here's what you need.  Follow the below ...READ MORE

Feb 27, 2019 in Big Data Hadoop by Thakur
 • 5,004 views
0 votes
1 answer

MySql connection localhost vs 127.0.0.1

The difference is that when you use localhost, ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 4,975 views
0 votes
1 answer

What is the slaves file configuration in Hadoop?

The main idea behind is the master ...READ MORE

Apr 24, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 4,973 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

The reason for this error is that ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Srujan
 • 4,965 views
–1 vote
1 answer

"main" java.lang.ClassNotFoundException: WordCount

When you are running a jar file ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 4,960 views
0 votes
1 answer

How to create znode in zookeeper?

Hey, Create a znode with the given path. The flag argument ...READ MORE

May 28, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 4,953 views
+4 votes
3 answers

Unable to find file error- while Streaming Hadoop

Is python installed running on the slaves that ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Vinith
 • 4,935 views
0 votes
1 answer

Is there any way to access Hadoop web UI in linux?

In this case what you can do ...READ MORE

May 9, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 4,920 views
0 votes
1 answer

How to delete a column family from table in HBase?

Hey, You can delete a column family from ...READ MORE

Jun 21, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 4,918 views
0 votes
1 answer

Sqoop - moving data from DB2 to HDFS ( hive partition table)

sqoop import --driver com.ibm.db2.jcc.DB2Driver --connect jdbc:db2://db2.my.com:50000/databaseName --username ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Payal
 • 4,914 views
0 votes
1 answer

How to decide number of mappers?

The number of mapper depends on the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 4,896 views
+1 vote
2 answers

Failed to restart Hadoop namenode using cloudera quickstart

You can use Cloudera Manager to manage ...READ MORE

Mar 19, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points
edited Jun 9, 2020 by MD • 4,888 views
0 votes
1 answer

How to access Hadoop Data using REST service?

The REST API gateway for the Apache ...READ MORE

Sep 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,886 views
0 votes
1 answer

How can create the dynamic partition table with data in Hive?

Hi, We can see some steps to do ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 4,873 views
0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Yogi
 • 4,868 views
0 votes
1 answer

What is DAG in Hive?

Hey, DAG in Hive architecture is nothing but ...READ MORE

May 11, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 4,863 views
0 votes
1 answer

InputSplit vs HDFS Block

By definition Block – Block is the continuous ...READ MORE

Jun 1, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 4,827 views
+3 votes
1 answer

Apache Nifi Execute Process Processor

Hey soujanyabargavi!  NO, ExecuteProcess does not allow incoming ...READ MORE

Sep 20, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 4,824 views
0 votes
1 answer

Sqoop incremental append by date

Consider a table with 3 records which ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 4,822 views
0 votes
1 answer

How to control logging functionality in Hadoop?

 Logs are distributed across your cluster, but ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,797 views
0 votes
2 answers

While typing 'hdfs fs -mkdir/prem' command I'm getting below error. Could not find or load main class fs and caused by java.lang.ClassNotFoundException:fs

Hi, @premkumar, ideally, you should be using hdfs dfs ...READ MORE

Aug 7, 2020 in Big Data Hadoop by Gitika
 • 65,730 points • 4,786 views
0 votes
2 answers

How are Partitioning and Bucketing different from each other in Apache Hive?

Let us consider a student database table ...READ MORE

Apr 15, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 4,781 views
0 votes
1 answer

How to install Flume on Linux?

All you have to do is get ...READ MORE

Feb 26, 2019 in Big Data Hadoop by Rishi
 • 4,777 views
0 votes
1 answer

Hadoop Hive: Correlating expression cannot contain unqualified column references

Try the following command and see if ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 4,769 views
0 votes
1 answer

How to write a file in hdfs with Java?

You could pass the URI when getting ...READ MORE

Sep 26, 2018 in Big Data Hadoop by digger
 • 26,740 points • 4,768 views
0 votes
1 answer

GROUP and COGROUP in PIG

Both GROUP and COGROUP operators are identical ...READ MORE

Jul 25, 2018 in Big Data Hadoop by shams
 • 3,670 points • 4,760 views
0 votes
1 answer

How to configure Hosts file for Hadoop Eco-System?

For UBUNTU Hosts File and other configuration for Hadoop ...READ MORE

Sep 25, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,756 views
0 votes
1 answer

How to copy files from HDFS to local system?

Hi@akhtar, You can use the put command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
 • 95,460 points • 4,755 views
0 votes
2 answers

Explain to me the difference between Name Node and Secondary Name Node

Secondary namenode is just a helper for ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Dhiman
 • 4,755 views
0 votes
1 answer

How to read multiple files in hdfs?

If you want to read files with ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 4,751 views
0 votes
1 answer

How can I calculate exact median with Apache Spark?

You need to sort RDD and take ...READ MORE

Oct 8, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 4,733 views
0 votes
1 answer

How to copy file to multiple hdfs directory?

You can use loop to copy the ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 4,722 views
0 votes
1 answer

How to run Map Reduce program using Ubuntu terminal?

 I used the following steps to execute it ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 4,640 views
0 votes
1 answer

Hadoop: “Unhealthy Node local-dirs and log-dirs are bad”

You can increase the threshold in yarn-site.xml <property> ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 4,639 views
–1 vote
1 answer

Pig command error: Failed to parse: Pig script failed to parse

There's a typo in your command: Right command: custdata ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 4,605 views
0 votes
1 answer

Differentiate: hadoop fs -text vs hadoop fs -cat vs hadoop fs -get

The main difference between -cat and -text ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,605 views
0 votes
1 answer

Backup and Checkpoint Node

Checkpoint Node keeps track of the latest ...READ MORE

Jul 31, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 4,602 views
0 votes
1 answer

In Hadoop what does dfs replicate mean?

The total number of files in the ...READ MORE

Sep 25, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,584 views
0 votes
1 answer

What are the different ways of executing pig scripts?

There are three ways to execute the ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Neha
 • 6,300 points • 4,580 views
0 votes
2 answers

How to exit NameNode safe mode?

hadoop dfsadmin -safemode leave READ MORE

Apr 11, 2019 in Big Data Hadoop by anonymous
 • 4,572 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.