Most viewed questions in Big Data Hadoop

0 votes
1 answer

How to convert Spark data into CSV?

You can use this: df.write .option("header", "true") ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,811 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

Mar 16, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 4,795 views
0 votes
1 answer

Where is Hadoop Classpath?

It is set in hadoop-config.sh. You can add ...READ MORE

Apr 2, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 4,793 views
0 votes
1 answer

Installing Hive & Hadoop in VM

For Hadoop installation, I would recommend you ...READ MORE

Apr 19, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 4,791 views
–1 vote
1 answer

"main" java.lang.ClassNotFoundException: WordCount

When you are running a jar file ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,755 views
+1 vote
2 answers

Unable to create external table on HIVE

Hi @Ozer, This error occurred because there is ...READ MORE

Nov 7, 2019 in Big Data Hadoop by Richa
 • 4,748 views
0 votes
1 answer

How to create znode in zookeeper?

Hey, Create a znode with the given path. The flag argument ...READ MORE

May 28, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 4,742 views
0 votes
2 answers

Using PHP to get all file names in a folder stored in HDFS

So i found a workaround for the ...READ MORE

Mar 13, 2019 in Big Data Hadoop by Bhavish
 • 370 points
edited Mar 13, 2019 by Omkar • 4,741 views
0 votes
1 answer

Sqoop - moving data from DB2 to HDFS ( hive partition table)

sqoop import --driver com.ibm.db2.jcc.DB2Driver --connect jdbc:db2://db2.my.com:50000/databaseName --username ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Payal
 • 4,726 views
0 votes
1 answer

What is the difference between Apache ZooKeeper and Apache Oozie?

The main difference between these two is ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Anoop
 • 4,726 views
0 votes
1 answer

What is the slaves file configuration in Hadoop?

The main idea behind is the master ...READ MORE

Apr 24, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 4,714 views
0 votes
1 answer

How to decide number of mappers?

The number of mapper depends on the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,710 views
0 votes
1 answer

How can create the dynamic partition table with data in Hive?

Hi, We can see some steps to do ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 4,703 views
0 votes
1 answer

Sqoop incremental append by date

Consider a table with 3 records which ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,686 views
0 votes
1 answer

How to delete a column family from table in HBase?

Hey, You can delete a column family from ...READ MORE

Jun 21, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 4,660 views
0 votes
1 answer

MySql connection localhost vs 127.0.0.1

The difference is that when you use localhost, ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,656 views
0 votes
1 answer

What is DAG in Hive?

Hey, DAG in Hive architecture is nothing but ...READ MORE

May 11, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 4,641 views
0 votes
1 answer

How to access Hadoop Data using REST service?

The REST API gateway for the Apache ...READ MORE

Sep 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,637 views
0 votes
1 answer

How to install Flume on Linux?

All you have to do is get ...READ MORE

Feb 26, 2019 in Big Data Hadoop by Rishi
 • 4,624 views
0 votes
1 answer

Hadoop Hive: Correlating expression cannot contain unqualified column references

Try the following command and see if ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,608 views
0 votes
2 answers

How to set properties for secondary namenode in Hadoop?

Secondary NameNode in HDFS Secondary NameNode in Hadoop ...READ MORE

Mar 31, 2020 in Big Data Hadoop by anonymous
 • 4,607 views
+4 votes
3 answers

Unable to find file error- while Streaming Hadoop

Is python installed running on the slaves that ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Vinith
 • 4,591 views
0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Yogi
 • 4,586 views
0 votes
1 answer

How to read multiple files in hdfs?

If you want to read files with ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,581 views
0 votes
1 answer

How to control logging functionality in Hadoop?

 Logs are distributed across your cluster, but ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,578 views
+1 vote
1 answer

Need help installing Flume on Windows

Hi. Here's what you need.  Follow the below ...READ MORE

Feb 27, 2019 in Big Data Hadoop by Thakur
 • 4,558 views
0 votes
1 answer

InputSplit vs HDFS Block

By definition Block – Block is the continuous ...READ MORE

Jun 1, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 4,556 views
0 votes
1 answer

How can I calculate exact median with Apache Spark?

You need to sort RDD and take ...READ MORE

Oct 8, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,551 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

The reason for this error is that ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Srujan
 • 4,550 views
0 votes
1 answer

How to copy files from HDFS to local system?

Hi@akhtar, You can use the put command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
 • 95,460 points • 4,533 views
+3 votes
1 answer

Apache Nifi Execute Process Processor

Hey soujanyabargavi!  NO, ExecuteProcess does not allow incoming ...READ MORE

Sep 20, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,530 views
+1 vote
2 answers

Failed to restart Hadoop namenode using cloudera quickstart

You can use Cloudera Manager to manage ...READ MORE

Mar 19, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points
edited Jun 9, 2020 by MD • 4,525 views
0 votes
1 answer

Is there any way to access Hadoop web UI in linux?

In this case what you can do ...READ MORE

May 9, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 4,509 views
0 votes
1 answer

GROUP and COGROUP in PIG

Both GROUP and COGROUP operators are identical ...READ MORE

Jul 25, 2018 in Big Data Hadoop by shams
 • 3,670 points • 4,481 views
0 votes
1 answer

How to write a file in hdfs with Java?

You could pass the URI when getting ...READ MORE

Sep 26, 2018 in Big Data Hadoop by digger
 • 26,740 points • 4,480 views
0 votes
2 answers

How are Partitioning and Bucketing different from each other in Apache Hive?

Let us consider a student database table ...READ MORE

Apr 15, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 4,475 views
0 votes
1 answer

How to configure Hosts file for Hadoop Eco-System?

For UBUNTU Hosts File and other configuration for Hadoop ...READ MORE

Sep 25, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,456 views
0 votes
2 answers

Explain to me the difference between Name Node and Secondary Name Node

Secondary namenode is just a helper for ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Dhiman
 • 4,452 views
0 votes
1 answer

Hadoop: “Unhealthy Node local-dirs and log-dirs are bad”

You can increase the threshold in yarn-site.xml <property> ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,447 views
–1 vote
1 answer

Pig command error: Failed to parse: Pig script failed to parse

There's a typo in your command: Right command: custdata ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,430 views
0 votes
1 answer

Differentiate: hadoop fs -text vs hadoop fs -cat vs hadoop fs -get

The main difference between -cat and -text ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,419 views
0 votes
1 answer

How to copy file to multiple hdfs directory?

You can use loop to copy the ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,392 views
0 votes
1 answer

What are the different ways of executing pig scripts?

There are three ways to execute the ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Neha
 • 6,300 points • 4,386 views
0 votes
1 answer

How to run Map Reduce program using Ubuntu terminal?

 I used the following steps to execute it ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 4,382 views
0 votes
1 answer

In Hadoop what does dfs replicate mean?

The total number of files in the ...READ MORE

Sep 25, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,353 views
0 votes
1 answer

Load data into teradata using sqoop export

The general syntax to do this as ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Kunal
 • 4,338 views
0 votes
1 answer

What is the command to count number of lines in a file in hdfs?

hadoop fs -cat /example2/doc1 | wc -l READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,324 views
0 votes
1 answer

Command to copy file from desktop to hdfs

You can use either of the below ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Firoz
 • 4,303 views
0 votes
1 answer

What is -cp command in hadoop? How it works?

/user/cloudera/data1 is not a directory, it is ...READ MORE

Oct 17, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,303 views
0 votes
1 answer

Hadoop Mapreduce: Class Not Found Exception

Try adding this Job job = new Job(conf, ...READ MORE

Oct 29, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,271 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.