Most viewed questions in Big Data Hadoop

0 votes
1 answer

How to decide number of mappers?

The number of mapper depends on the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,230 points • 4,431 views
0 votes
1 answer

Whenever I try to start the yarn daemon. ./start-dfs.sh it says access denied I have even tried changing the file permissions but it didn't work.

Seems like the ssh is not properly ...READ MORE

Mar 8, 2019 in Big Data Hadoop by Omkar
 • 69,230 points • 4,425 views
0 votes
1 answer

Hadoop Hive: Correlating expression cannot contain unqualified column references

Try the following command and see if ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 4,425 views
–1 vote
1 answer

Incremental append in Sqoop

You are right. As Hadoop follows WORM ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 4,407 views
–1 vote
1 answer

"main" java.lang.ClassNotFoundException: WordCount

When you are running a jar file ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,230 points • 4,406 views
0 votes
1 answer

How to enable WebHDFS in the Datanodes?

In the datanodes, open the hdfs-site.xml file and add ...READ MORE

May 24, 2019 in Big Data Hadoop by Garima
 • 4,386 views
0 votes
1 answer

How to get absolute path of files in a directory in Hadoop?

You can use HDFS API like the ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,386 views
0 votes
1 answer

Where is Hadoop Classpath?

It is set in hadoop-config.sh. You can add ...READ MORE

Apr 2, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 4,381 views
0 votes
1 answer

What is the difference between Apache ZooKeeper and Apache Oozie?

The main difference between these two is ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Anoop
 • 4,363 views
0 votes
1 answer

How to control logging functionality in Hadoop?

 Logs are distributed across your cluster, but ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,338 views
0 votes
1 answer

What is DAG in Hive?

Hey, DAG in Hive architecture is nothing but ...READ MORE

May 11, 2019 in Big Data Hadoop by Gitika
 • 65,890 points • 4,334 views
0 votes
1 answer

What is the slaves file configuration in Hadoop?

The main idea behind is the master ...READ MORE

Apr 24, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 4,333 views
0 votes
1 answer

How to delete a column family from table in HBase?

Hey, You can delete a column family from ...READ MORE

Jun 21, 2019 in Big Data Hadoop by Gitika
 • 65,890 points • 4,314 views
0 votes
1 answer

How to avoid a “split-brain” scenario with NameNodes?

Okay, so let me tell you that ...READ MORE

Jul 11, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 4,312 views
0 votes
1 answer

How can I calculate exact median with Apache Spark?

You need to sort RDD and take ...READ MORE

Oct 8, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 4,297 views
0 votes
1 answer

InputSplit vs HDFS Block

By definition Block – Block is the continuous ...READ MORE

Jun 1, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 4,293 views
0 votes
1 answer

How to access Hadoop Data using REST service?

The REST API gateway for the Apache ...READ MORE

Sep 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,292 views
0 votes
1 answer

How to convert Spark data into CSV?

You can use this: df.write .option("header", "true") ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 4,278 views
0 votes
1 answer

MySql connection localhost vs 127.0.0.1

The difference is that when you use localhost, ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 4,275 views
0 votes
1 answer

How to install Flume on Linux?

All you have to do is get ...READ MORE

Feb 26, 2019 in Big Data Hadoop by Rishi
 • 4,239 views
0 votes
1 answer

Differentiate: hadoop fs -text vs hadoop fs -cat vs hadoop fs -get

The main difference between -cat and -text ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,200 views
0 votes
1 answer

How to remove the directory from HDFS?

Hi@akhtar, You can remove the directory using the ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
 • 95,440 points • 4,187 views
0 votes
2 answers

Using PHP to get all file names in a folder stored in HDFS

So i found a workaround for the ...READ MORE

Mar 13, 2019 in Big Data Hadoop by Bhavish
 • 370 points
edited Mar 13, 2019 by Omkar • 4,173 views
0 votes
1 answer

How to read multiple files in hdfs?

If you want to read files with ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,230 points • 4,169 views
0 votes
1 answer

Installing Hive & Hadoop in VM

For Hadoop installation, I would recommend you ...READ MORE

Apr 19, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 4,145 views
0 votes
1 answer

How to copy files from HDFS to local system?

Hi@akhtar, You can use the put command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
 • 95,440 points • 4,138 views
0 votes
1 answer

How to configure Hosts file for Hadoop Eco-System?

For UBUNTU Hosts File and other configuration for Hadoop ...READ MORE

Sep 25, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,129 views
+1 vote
1 answer

Need help installing Flume on Windows

Hi. Here's what you need.  Follow the below ...READ MORE

Feb 27, 2019 in Big Data Hadoop by Thakur
 • 4,125 views
0 votes
1 answer

How to write a file in hdfs with Java?

You could pass the URI when getting ...READ MORE

Sep 26, 2018 in Big Data Hadoop by digger
 • 26,740 points • 4,111 views
+1 vote
2 answers

Failed to restart Hadoop namenode using cloudera quickstart

You can use Cloudera Manager to manage ...READ MORE

Mar 19, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points
edited Jun 9, 2020 by MD • 4,101 views
0 votes
1 answer

Hadoop: “Unhealthy Node local-dirs and log-dirs are bad”

You can increase the threshold in yarn-site.xml <property> ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 4,094 views
+4 votes
3 answers

Unable to find file error- while Streaming Hadoop

Is python installed running on the slaves that ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Vinith
 • 4,071 views
0 votes
2 answers

How to set properties for secondary namenode in Hadoop?

Secondary NameNode in HDFS Secondary NameNode in Hadoop ...READ MORE

Mar 31, 2020 in Big Data Hadoop by anonymous
 • 4,070 views
0 votes
1 answer

What is -cp command in hadoop? How it works?

/user/cloudera/data1 is not a directory, it is ...READ MORE

Oct 17, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,058 views
0 votes
1 answer

Command to copy file from desktop to hdfs

You can use either of the below ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Firoz
 • 4,053 views
0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Yogi
 • 4,037 views
0 votes
1 answer

In Hadoop what does dfs replicate mean?

The total number of files in the ...READ MORE

Sep 25, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,034 views
0 votes
1 answer

Hadoop HDFS: Java API to move files to hdfs

You can use the FileUtil api to do this. Example: Configuration ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 4,020 views
0 votes
1 answer

Load data into teradata using sqoop export

The general syntax to do this as ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Kunal
 • 4,005 views
0 votes
1 answer

Hive: LOCATION and WITH DBPROPERTIES command in create table command

By default, the Hive database will be ...READ MORE

May 22, 2019 in Big Data Hadoop by Firoz
 • 4,002 views
0 votes
1 answer

What are the different ways of executing pig scripts?

There are three ways to execute the ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Neha
 • 6,300 points • 4,000 views
+3 votes
1 answer

Apache Nifi Execute Process Processor

Hey soujanyabargavi!  NO, ExecuteProcess does not allow incoming ...READ MORE

Sep 20, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 3,974 views
–1 vote
1 answer

Pig command error: Failed to parse: Pig script failed to parse

There's a typo in your command: Right command: custdata ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,230 points • 3,947 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

The reason for this error is that ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Srujan
 • 3,914 views
0 votes
1 answer

GROUP and COGROUP in PIG

Both GROUP and COGROUP operators are identical ...READ MORE

Jul 25, 2018 in Big Data Hadoop by shams
 • 3,670 points • 3,914 views
0 votes
1 answer

How to run Map Reduce program using Ubuntu terminal?

 I used the following steps to execute it ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 3,888 views
+1 vote
1 answer

bash: sbin/hadoop: No such file or directory

The hadoop command is not present in ...READ MORE

Sep 18, 2019 in Big Data Hadoop by Omkar
 • 69,230 points • 3,880 views
0 votes
2 answers

Explain to me the difference between Name Node and Secondary Name Node

Secondary namenode is just a helper for ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Dhiman
 • 3,879 views
0 votes
1 answer

Is there any way to access Hadoop web UI in linux?

In this case what you can do ...READ MORE

May 9, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 3,871 views
+5 votes
2 answers

Hive to HDFS transfer

Hive does not store data. Hive is ...READ MORE

Sep 20, 2018 in Big Data Hadoop by SM
 • 3,869 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.