Most viewed questions in Big Data Hadoop

0 votes
1 answer

How to concatenate hdfs files and store in output file?

You can use a combination of cat and put command. Something ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,544 views
0 votes
1 answer

Is there any way to access Hadoop web UI in linux?

In this case what you can do ...READ MORE

May 9, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,541 views
0 votes
1 answer

Deleting directory in Sqoop

You can use the --delete-target-dir : $ sqoop import ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,523 views
0 votes
1 answer

Hadoop Job Tracker problem. I cannot connect to http://localhost:50030/

I think you are using new version ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,515 views
0 votes
1 answer

Hadoop Mapreduce: Class Not Found Exception

Try adding this Job job = new Job(conf, ...READ MORE

Oct 29, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,509 views
+1 vote
1 answer

bash: sbin/hadoop: No such file or directory

The hadoop command is not present in ...READ MORE

Sep 18, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,494 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

The reason for this error is that ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Srujan
3,485 views
0 votes
1 answer

How can Hadoop process the records that are split across the block boundaries?

First of all, Map Reduce algorithm is not programmed ...READ MORE

Apr 15, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,481 views
0 votes
1 answer

What is Network Topology in Hadoop?

Let's imagine your cluster as a tree ...READ MORE

Sep 6, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,481 views
0 votes
2 answers

How to exit NameNode safe mode?

hadoop dfsadmin -safemode leave READ MORE

Apr 11, 2019 in Big Data Hadoop by anonymous
3,480 views
0 votes
1 answer

How to choose number of Executors and Executor cores?

Refer to the below when you are ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Veer
3,477 views
0 votes
1 answer

Default file format in Hive

By Default its TextFileFormat for hive unless you use serdes to ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,471 views
0 votes
2 answers

Explain to me the difference between Name Node and Secondary Name Node

Secondary namenode is just a helper for ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Dhiman
3,469 views
0 votes
1 answer

MapReduce to count alphabets

Please find the code below for alphabet ...READ MORE

May 23, 2019 in Big Data Hadoop by Firoz
3,467 views
0 votes
2 answers

How are Partitioning and Bucketing different from each other in Apache Hive?

Let us consider a student database table ...READ MORE

Apr 15, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,462 views
0 votes
1 answer

Command to stop the zookeeper server?

Hey, After connecting the server and performing all ...READ MORE

May 28, 2019 in Big Data Hadoop by Gitika
• 65,910 points
3,451 views
0 votes
1 answer

How to create new directory in hdfs using java code?

Try this: { Configuration config ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,448 views
0 votes
1 answer

Different between zkfc and zookeeper

Hey, The key difference between both the components ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Sunny
1 flag 3,432 views
0 votes
1 answer

NodeManager is not able to connect to the ResourceManager.

Here, I guess the issue is with ...READ MORE

May 1, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,416 views
0 votes
2 answers

start-dfs.sh command is not starting Hadoop JobTracker & TaskTracker

On which version of hadoop do you ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
3,395 views
0 votes
1 answer

How to change the replication factor of specific directory in Hadoop?

Yes, you can change the replication factor ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,381 views
0 votes
1 answer

Error: schemaTool failed

Hey, The error you got because you might ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
• 65,910 points
3,380 views
0 votes
1 answer

Spark Vs Hive LLAP Question

While Apache Hive and Spark SQL perform ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Karan
3,379 views
0 votes
1 answer

What is Hue?

As you said, Hue is a web ...READ MORE

Mar 22, 2018 in Big Data Hadoop by Ashish
• 2,650 points

edited Mar 22, 2018 by Ashish 3,370 views
0 votes
1 answer

How to run Java file in Hadoop?

Try this: hadoop fs -cat hdfs:///user/hadoop/values.txt READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,355 views
0 votes
1 answer

When is the reduce tasks start in Hadoop?

Let me explain you the whole scenario. ...READ MORE

May 22, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,346 views
0 votes
1 answer

ERROR org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - ZooKeeper exists failed after 4 attempts

Hi@akhtar, This error shows, Hbase is not able ...READ MORE

Mar 31, 2020 in Big Data Hadoop by MD
• 95,440 points
3,341 views
0 votes
1 answer

How to set Hive Server port?

You can set the port in the hive-site.xml file. ...READ MORE

May 31, 2019 in Big Data Hadoop by Aisha
3,321 views
0 votes
1 answer

Is there any way to load data from MySql to HDFS?

The generic command i.e used to import ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,314 views
0 votes
1 answer

Hadoop Hive query to filter employees

select * from tablename where DOJ> '2018-01-01' ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,304 views
0 votes
1 answer

How to create a Hive table with a sequence file?

In Hive we can create a sequence ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,298 views
0 votes
2 answers

Sqoop: Could not load mysql driver exception.

I add mysql driver for sqoop and it ...READ MORE

Mar 1, 2020 in Big Data Hadoop by Manh Quang
• 180 points
3,298 views
0 votes
1 answer

Map-reduce code for finding average salary

You can choose your mapper output key ...READ MORE

May 22, 2019 in Big Data Hadoop by Yogi
3,289 views
0 votes
1 answer

Hadoop Hive: message:Version information not found in metastore. Unable to instantiate

These are the necessary tables required for metastore that are ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,282 views
0 votes
1 answer

How should I provide a URL for hdfs file system?

If you are trying to access your ...READ MORE

Sep 10, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,279 views
0 votes
2 answers

Do we need to format datanode to store data

That was not important. If you can ...READ MORE

Jan 16, 2019 in Big Data Hadoop by Sam
• 160 points
3,277 views
0 votes
1 answer

What is the command to count number of lines in a file in hdfs?

hadoop fs -cat /example2/doc1 | wc -l READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,259 views
–1 vote
1 answer

Json and snappy compression

Refer the below screenshot for your above ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,257 views
0 votes
1 answer

I am getting error while starting the Hadoop Daemons i.e. ResourceManger & NodeManager in Hadoop 3

According to me the error is because ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,249 views
0 votes
1 answer

exception:org.apache.hadoop.security.AccessControlException Permission denied: user=test, access=WRITE, inode="/user/hive/warehouse/test"

Hi@akhtar, According to your error, it shows you ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,440 points
3,245 views
0 votes
1 answer

Which is the most preferable language for Hadooop Map-Reduce programs?

MapReduce is a programming model to perform ...READ MORE

Aug 4, 2018 in Big Data Hadoop by Neha
• 6,300 points
3,244 views
–1 vote
1 answer

Create Hive table with bucketing and ORC file format

create table hive_dml (emp_id int, first_name string, last_name ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,237 views
0 votes
1 answer

What are the various ways to import files into HDFS?

There are various tools and frameworks available ...READ MORE

Apr 13, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,227 views
0 votes
1 answer

How does Hive job execution flow works?

Hey, Hive query is received from UI or ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
• 65,910 points
3,209 views
0 votes
1 answer

Hadoop Mapreduce: Error: Could not find or load main class com.sun.tools.javac.Main

You have to add HADOOP_CLASSPATH environment parameter: expor ...READ MORE

Oct 30, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,208 views
0 votes
1 answer

Edge nodes in Hadoop

Namenodes and Datanodes are a part of ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Siri
3,201 views
0 votes
1 answer

What is the hdfs command to check free space available?

You can see the free available space ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,201 views
0 votes
1 answer

Hadoop: java.io.IOException: File could only be replicated to 0 nodes instead of minReplication (=1)

Try this, first stop all the daemons, ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,193 views
0 votes
1 answer

How to copy file to multiple hdfs directory?

You can use loop to copy the ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,191 views
0 votes
1 answer

What if Resource Manager fails?

Failure of the resource manager is serious ...READ MORE

Jun 20, 2019 in Big Data Hadoop by John
3,167 views