Most viewed questions in Big Data Hadoop

0 votes
1 answer

What is the command to count number of lines in a file in hdfs?

hadoop fs -cat /example2/doc1 | wc -l READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,072 views
0 votes
2 answers

What is the difference between Oozie and Nifi ?

The main difference between Oozie and Nifi ...READ MORE

May 7, 2019 in Big Data Hadoop by Omkar
• 69,220 points
4,071 views
+1 vote
1 answer

bash: sbin/hadoop: No such file or directory

The hadoop command is not present in ...READ MORE

Sep 18, 2019 in Big Data Hadoop by Omkar
• 69,220 points
4,052 views
0 votes
1 answer

Default file format in Hive

By Default its TextFileFormat for hive unless you use serdes to ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,220 points
4,033 views
0 votes
1 answer

How to copy file to multiple hdfs directory?

You can use loop to copy the ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,220 points
4,025 views
0 votes
1 answer

Error while copying the file from local to HDFS

Well, the reason you are getting such ...READ MORE

May 3, 2018 in Big Data Hadoop by Ashish
• 2,650 points
4,019 views
0 votes
1 answer

Difference between Hadoop file system and Linux

Yes, to a certain extent we can ...READ MORE

Apr 20, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
4,011 views
0 votes
1 answer

How to concatenate hdfs files and store in output file?

You can use a combination of cat and put command. Something ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,008 views
0 votes
1 answer

What is Network Topology in Hadoop?

Let's imagine your cluster as a tree ...READ MORE

Sep 6, 2018 in Big Data Hadoop by Frankie
• 9,830 points
4,003 views
0 votes
1 answer

Deleting directory in Sqoop

You can use the --delete-target-dir : $ sqoop import ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,220 points
3,993 views
0 votes
2 answers

How to exit NameNode safe mode?

hadoop dfsadmin -safemode leave READ MORE

Apr 11, 2019 in Big Data Hadoop by anonymous
3,988 views
+5 votes
2 answers

Hive to HDFS transfer

Hive does not store data. Hive is ...READ MORE

Sep 20, 2018 in Big Data Hadoop by SM
3,984 views
0 votes
2 answers

Do we need to format datanode to store data

That was not important. If you can ...READ MORE

Jan 16, 2019 in Big Data Hadoop by Sam
• 160 points
3,963 views
0 votes
1 answer

Command to stop the zookeeper server?

Hey, After connecting the server and performing all ...READ MORE

May 28, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,951 views
0 votes
1 answer

How to run Java file in Hadoop?

Try this: hadoop fs -cat hdfs:///user/hadoop/values.txt READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,929 views
0 votes
1 answer

Hadoop Job Tracker problem. I cannot connect to http://localhost:50030/

I think you are using new version ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,929 views
0 votes
1 answer

Error: schemaTool failed

Hey, The error you got because you might ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,915 views
0 votes
1 answer

Edge nodes in Hadoop

Namenodes and Datanodes are a part of ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Siri
3,915 views
0 votes
1 answer

NodeManager is not able to connect to the ResourceManager.

Here, I guess the issue is with ...READ MORE

May 1, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,911 views
0 votes
1 answer

How can Hadoop process the records that are split across the block boundaries?

First of all, Map Reduce algorithm is not programmed ...READ MORE

Apr 15, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,892 views
0 votes
1 answer

How to create new directory in hdfs using java code?

Try this: { Configuration config ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,886 views
0 votes
2 answers

start-dfs.sh command is not starting Hadoop JobTracker & TaskTracker

On which version of hadoop do you ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
3,874 views
0 votes
1 answer

How to find the port on which hdfs is running?

If you are using hadoop 2.7 or ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,220 points
3,863 views
0 votes
2 answers

Sqoop: Could not load mysql driver exception.

I add mysql driver for sqoop and it ...READ MORE

Mar 1, 2020 in Big Data Hadoop by Manh Quang
• 180 points
3,838 views
0 votes
1 answer

Different between zkfc and zookeeper

Hey, The key difference between both the components ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Sunny
1 flag 3,834 views
0 votes
1 answer

what does velocity in big data mean

Velocity in big data refers to the ...READ MORE

Feb 3, 2022 in Big Data Hadoop by CoolCoder
• 4,420 points
3,817 views
0 votes
1 answer

How to set Hive Server port?

You can set the port in the hive-site.xml file. ...READ MORE

May 31, 2019 in Big Data Hadoop by Aisha
3,815 views
0 votes
1 answer

What is the hdfs command to check free space available?

You can see the free available space ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,789 views
0 votes
1 answer

Which is the most preferable language for Hadooop Map-Reduce programs?

MapReduce is a programming model to perform ...READ MORE

Aug 4, 2018 in Big Data Hadoop by Neha
• 6,300 points
3,775 views
0 votes
1 answer

ERROR org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - ZooKeeper exists failed after 4 attempts

Hi@akhtar, This error shows, Hbase is not able ...READ MORE

Mar 31, 2020 in Big Data Hadoop by MD
• 95,460 points
3,772 views
0 votes
1 answer

Types of Hadoop Clusters

Below is the difference given between Standalone, ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,771 views
0 votes
2 answers
–1 vote
1 answer

Json and snappy compression

The issue you're facing arises because the ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,220 points
3,750 views
–1 vote
1 answer

Create Hive table with bucketing and ORC file format

create table hive_dml (emp_id int, first_name string, last_name ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,220 points
3,748 views
0 votes
1 answer

When is the reduce tasks start in Hadoop?

Let me explain you the whole scenario. ...READ MORE

May 22, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,748 views
0 votes
1 answer

Map-reduce code for finding average salary

You can choose your mapper output key ...READ MORE

May 22, 2019 in Big Data Hadoop by Yogi
3,729 views
+1 vote
1 answer

flume twitter data file not generated in HDFS

Seems like you've missed the source and ...READ MORE

Dec 2, 2019 in Big Data Hadoop by Esha
3,727 views
0 votes
1 answer

MapReduce to count alphabets

Please find the code below for alphabet ...READ MORE

May 23, 2019 in Big Data Hadoop by Firoz
3,727 views
0 votes
1 answer

exception:org.apache.hadoop.security.AccessControlException Permission denied: user=test, access=WRITE, inode="/user/hive/warehouse/test"

Hi@akhtar, According to your error, it shows you ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
• 95,460 points
3,721 views
0 votes
1 answer

Spark Vs Hive LLAP Question

While Apache Hive and Spark SQL perform ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Karan
3,705 views
0 votes
1 answer

How to change the replication factor of specific directory in Hadoop?

Yes, you can change the replication factor ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,689 views
0 votes
1 answer

Hadoop Mapreduce: Error: Could not find or load main class com.sun.tools.javac.Main

You have to add HADOOP_CLASSPATH environment parameter: expor ...READ MORE

Oct 30, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,679 views
0 votes
1 answer

I am getting error while starting the Hadoop Daemons i.e. ResourceManger & NodeManager in Hadoop 3

According to me the error is because ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
3,677 views
0 votes
1 answer

How to choose number of Executors and Executor cores?

Refer to the below when you are ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Veer
3,675 views
0 votes
1 answer

Hadoop Hive query to filter employees

select * from tablename where DOJ> '2018-01-01' ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,674 views
0 votes
1 answer

Is there any way to load data from MySql to HDFS?

The generic command i.e used to import ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,672 views
0 votes
1 answer

What is Hue?

As you said, Hue is a web ...READ MORE

Mar 22, 2018 in Big Data Hadoop by Ashish
• 2,650 points

edited Mar 22, 2018 by Ashish 3,670 views
0 votes
1 answer

Hadoop: namenode -format error "java.io.IOException"

Run the command as sudo or add the ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,660 views
0 votes
1 answer

What if Resource Manager fails?

Failure of the resource manager is serious ...READ MORE

Jun 20, 2019 in Big Data Hadoop by John
3,656 views
0 votes
1 answer

How to Modify the Maximum Number of Versions for a Column Family in Hbase?

Hey, The example uses HBase Shell to keep ...READ MORE

May 31, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,639 views