Most voted questions in Big Data Hadoop

+1 vote
1 answer

Client not able to connect to cluster

There could be multiple reasons: Make sure you ...READ MORE

Sep 23, 2019 in Big Data Hadoop by Rishi
1,141 views
+1 vote
1 answer

2 datanodes is slower ,how to get those details .what is your approach as hadoop admin

First, enable the detection of slow nodes. ...READ MORE

Sep 23, 2019 in Big Data Hadoop by Riya
1,994 views
+1 vote
1 answer

bash: sbin/hadoop: No such file or directory

The hadoop command is not present in ...READ MORE

Sep 18, 2019 in Big Data Hadoop by Omkar
• 69,220 points
4,213 views
+1 vote
0 answers

Missing Service request

Hello All, need assistance on one issue. ...READ MORE

Sep 17, 2019 in Big Data Hadoop by Hemanth
• 250 points
924 views
+1 vote
2 answers

How to find the database daily refresh time / sync up time

I use this code to get the ...READ MORE

Sep 17, 2019 in Big Data Hadoop by Raman
9,837 views
+1 vote
0 answers

Directory not found while using java -classpath

I'm using command java -classpath  ${HADOOP_CLASSPATH} -d '/home/shravanth/Desktop/wordcount/classes' ...READ MORE

Sep 14, 2019 in Big Data Hadoop by shravanth
704 views
+1 vote
1 answer

" org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Permissions incorrectly set for dir " problem

This error is caused when hadoop tries ...READ MORE

Sep 9, 2019 in Big Data Hadoop by Kumar
5,205 views
+1 vote
1 answer

Namenode v/s Secondary namenode

Name Node is a primary node in ...READ MORE

Sep 9, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
5,321 views
+1 vote
0 answers

hdfs namenode -format not working, not showing anything.

can someone help me with this please, ...READ MORE

Sep 6, 2019 in Big Data Hadoop by nar
1,447 views
+1 vote
1 answer

sql exception when exporting

Hello @Hemanth, the error String or binary data ...READ MORE

Sep 4, 2019 in Big Data Hadoop by Ramya
2,876 views
+1 vote
1 answer

What are all the Data quality checks we do in our real time Big Data projects.

You can use a checksum to compare ...READ MORE

Sep 4, 2019 in Big Data Hadoop by Tina
2,119 views
+1 vote
0 answers

Output of dump command has empty records

this is my input file output_pig_group_education_comma/input_load.txt and its ...READ MORE

Aug 10, 2019 in Big Data Hadoop by Manju Bhargavi
1,195 views
+1 vote
2 answers

Error: com/eng/mr/WordCountDriver : Unsupported major.minor version 52.0

The reason why you get this error ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Venkita
• 240 points
857 views
+1 vote
2 answers

Hadoop: Error: Exception in thread “main” java.lang.UnsupportedClassVersionError: a

The reason for this error is because ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Venkita
• 240 points
2,007 views
+1 vote
2 answers

Hadoop Administration

Make the following changes to your configuration ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Simran
1,100 views
+1 vote
0 answers

Job failed as tasks failed. failedMaps

Hello All, I am new to hadoop, i ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Hemanth
• 250 points

edited Aug 1, 2019 by Omkar 8,138 views
+1 vote
3 answers

What is the best way to merge multi-part HDFS files into single file?

1. In order to merge two or ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Tina
31,529 views
+1 vote
1 answer
+1 vote
0 answers

Hadoop Installation error [closed]

Pls help on below error..on MAC OS WARN ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Anshuman
• 130 points

closed Jul 10, 2019 by Omkar 397 views
+1 vote
1 answer

Can we use LIKE operator in Hive?

Hey, Yes, Hive supports LIKE operator, but it ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Gitika
• 65,770 points
21,258 views
+1 vote
1 answer

Explain to me the difference between Name node and Secondary name node

First of all, let understand what is ...READ MORE

May 15, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,916 views
+1 vote
1 answer

Why do we use STORE command in pig?

Hey, We use store command to store the ...READ MORE

May 7, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,538 views
+1 vote
2 answers
+1 vote
1 answer

what are the typicall block sizes in HDFS

HDFS is a block structured file system ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
• 65,770 points
1,861 views
+1 vote
1 answer

Explain to me the difference between HBase and HDFS

Let's start from scratch. Hadoop basically consists of three ...READ MORE

Mar 19, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,314 views
+1 vote
1 answer

How can I get the Hadoop Documentation for its particular version?

Hi, You can download all the versions you ...READ MORE

Mar 19, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,842 views
+1 vote
1 answer

Need help installing Flume on Windows

Hi. Here's what you need.  Follow the below ...READ MORE

Feb 27, 2019 in Big Data Hadoop by Thakur
4,533 views
+1 vote
1 answer

Need help Installing Sqoop on Windows.

Download Sqoop from this link: http://www.apache.org/dyn/closer.lua/sqoop/1.4.7 This link is ...READ MORE

Feb 25, 2019 in Big Data Hadoop by Chandu
3,659 views
+1 vote
1 answer

How to delete sqoop job?

get the list of jobs  ==========   sqoop ...READ MORE

Feb 1, 2022 in Big Data Hadoop by sudhakar

edited Mar 5 4,915 views
+1 vote
1 answer

Sqoop: How to load all tables except one?

You can use the import-all-tables option and along with ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Omkar
• 69,220 points
7,773 views
+1 vote
1 answer

which version of sqoop i install for hadoop3.1.1 ?

Hi @lucky! The latest version of Sqoop available ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,220 points
5,985 views
+1 vote
1 answer

How to append data to a parquet file?

Try using Spark API to append the ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,220 points
17,215 views
+1 vote
1 answer

Do Cloudera’s Products Work With My Existing Data Management Infrastructure?

The Cloudera Connect Partner Program, more than ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
785 views
+1 vote
1 answer

Unable to load data in Hbase table from dataset

Try these steps (make necessary changes): First upload ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,262 views
+1 vote
1 answer

How to print data without brackets using PIG Dump?

Please refer to the below commands: student = ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,375 views
+1 vote
1 answer

What is the process to perform an incremental data load in Sqoop?

The process to perform incremental data load ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Frankie
• 9,830 points
5,708 views
+1 vote
1 answer

Hadoop Map Reduce: java.lang.reflect.InvocationTargetException

I executed the same code and it ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,811 views
+1 vote
1 answer

How to switch off Cloudera Manager Service?

First list the running services: chkconfig --list And then ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,220 points
628 views
+1 vote
1 answer

Not able to start datanode in Hadoop

Follow these steps: Stop namenode Delete the datanode directory ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,794 views
+1 vote
1 answer

How to get status of hdfs directory using python?

import commands hdir_list = commands.getoutput('hadoop fs -ls hdfs: ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,873 views
+1 vote
1 answer

How to write file in hdfs using python?

#!/usr/bin/python from subprocess import Popen, PIPE cat = Popen(["hadoop", ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,220 points
8,545 views
+1 vote
1 answer

How to limit the number of rows per each item in a Hive QL?

SELECT a_id, b, c, count(*) as sumrequests FROM ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
• 69,220 points
27,487 views
+1 vote
1 answer

Hadoop: "DEPRECATED: Use of this script to execute hdfs command is deprecated." error

The use of dfs in your command is "Deprecated". ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
9,443 views
+1 vote
1 answer

How to read HDFS and local files with the same code in Java?

You can try something like this: ​ ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,922 views
+1 vote
2 answers

Hadoop Hive: Not recognizing alias named in select part?

You can not use column aliases in ...READ MORE

Nov 26, 2019 in Big Data Hadoop by anonymous
11,272 views
+1 vote
1 answer

Hadoop: Using composite-key

You can use a Writable, something like ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,363 views
+1 vote
1 answer

Hive: How to use insert query like SQL

It is now possible to insert like ...READ MORE

Nov 5, 2018 in Big Data Hadoop by Omkar
• 69,220 points
973 views