Trending questions in Big Data Hadoop

+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Aditya
20,609 views
+1 vote
2 answers

How to find previous records from a data set in Pig??

Hi, You can use ToDate() and SubtractDuration() function ...READ MORE

21 minutes ago in Big Data Hadoop by MD
• 240 points
31 views
+1 vote
1 answer

Information Unavailable:Running jps command in Hadoop

Hi, I think this is because the process ...READ MORE

2 days ago in Big Data Hadoop by anonymous
19 views
+1 vote
1 answer

Unhandled internal error. Java heap space

Hi As your file size is too large, ...READ MORE

1 day ago in Big Data Hadoop by anonymous
17 views
+1 vote
1 answer

Streaming facebook data using Flume framework!!!

Hi You can find the facebook 'API' from ...READ MORE

1 day ago in Big Data Hadoop by anonymous
13 views
+1 vote
0 answers

About Available Space Block Placement Policy

First of all, i'm learning hadoop recently ...READ MORE

1 day ago in Big Data Hadoop by anonymous
• 130 points
17 views
+2 votes
0 answers

MapReduce Job is failed: "Job failed as tasks failed. failed Maps:1 failed Reduces:0"

Hi everyone This is an error that I'm ...READ MORE

5 days ago in Big Data Hadoop by akhtar
• 200 points
26 views
+1 vote
0 answers

Hadoop Mapreduce : Null Pointer Exception

While running the below program, I got ...READ MORE

Dec 5, 2019 in Big Data Hadoop by Tarun
• 160 points
133 views
+1 vote
1 answer

Hadoop Learning Path

Hi! Since you have only 6 weeks, it's ...READ MORE

Nov 28, 2019 in Big Data Hadoop by Farheen
172 views
+1 vote
1 answer

datanode decomissioning

You have set the replication factor to ...READ MORE

Nov 28, 2019 in Big Data Hadoop by Rahul
134 views
+10 votes
11 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

modify the glibc version.CentOS provides safe softwares ...READ MORE

Sep 10, 2018 in Big Data Hadoop by bug_seeker
• 15,390 points
16,043 views
+2 votes
0 answers
0 votes
1 answer

Sqoop could not load db driver class

Hello, Have you tried to put the both ...READ MORE

Dec 13, 2019 in Big Data Hadoop by Alexandru
• 510 points
121 views
+1 vote
0 answers

Oozie filter all coordinator jobs based on nominalTime

Hi Edureka team. I would like to ...READ MORE

Nov 11, 2019 in Big Data Hadoop by Thayanban
• 130 points
128 views
+1 vote
1 answer

how to escape delimiter in hive?

Refer to the below code used to ...READ MORE

Oct 31, 2019 in Big Data Hadoop by Kiran
193 views
+1 vote
2 answers

Unable to create external table on HIVE

Hi @Ozer, This error occurred because there is ...READ MORE

Nov 6, 2019 in Big Data Hadoop by Richa
300 views
+1 vote
1 answer

flume twitter data file not generated in HDFS

Seems like you've missed the source and ...READ MORE

Dec 2, 2019 in Big Data Hadoop by Esha
139 views
+1 vote
0 answers

Class not found exception in wordcount program in mapreduce

import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.Path; import java.io.IOException; import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat; import org.apache.hadoop.mapreduce.*; import org.apache.hadoop.mapreduce.lib.input.FileInputFormat; import ...READ MORE

Oct 3, 2019 in Big Data Hadoop by Tarun
• 160 points

edited Oct 3, 2019 by Omkar 113 views
+1 vote
1 answer

2 datanodes is slower ,how to get those details .what is your approach as hadoop admin

First, enable the detection of slow nodes. ...READ MORE

Sep 23, 2019 in Big Data Hadoop by Riya
163 views
+1 vote
1 answer

Client not able to connect to cluster

There could be multiple reasons: Make sure you ...READ MORE

Sep 23, 2019 in Big Data Hadoop by Rishi
140 views
+1 vote
2 answers

How to find the database daily refresh time / sync up time

I use this code to get the ...READ MORE

Sep 17, 2019 in Big Data Hadoop by Raman
96 views
+1 vote
1 answer

bash: sbin/hadoop: No such file or directory

The hadoop command is not present in ...READ MORE

Sep 18, 2019 in Big Data Hadoop by Omkar
• 68,860 points
84 views
+1 vote
1 answer

What is the best way to merge multi-part HDFS files into single file?

1. In order to merge two or ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Tina
2,185 views
+1 vote
0 answers

Missing Service request

Hello All, need assistance on one issue. ...READ MORE

Sep 17, 2019 in Big Data Hadoop by Hemanth
• 240 points
49 views
+1 vote
0 answers

Directory not found while using java -classpath

I'm using command java -classpath  ${HADOOP_CLASSPATH} -d '/home/shravanth/Desktop/wordcount/classes' ...READ MORE

Sep 14, 2019 in Big Data Hadoop by shravanth
47 views
+1 vote
1 answer
+1 vote
1 answer

Namenode v/s Secondary namenode

Name Node is a primary node in ...READ MORE

Sep 9, 2019 in Big Data Hadoop by ravikiran
• 4,600 points
141 views
0 votes
1 answer

How to run Hadoop 2.1.0 in Windows System?

Same problem but with recent Hadoop v. ...READ MORE

Sep 11, 2019 in Big Data Hadoop by ravikiran
• 4,600 points
73 views
0 votes
1 answer

Warning: unable to load hadoop native library

Just append word native to your HADOOP_OPTS like ...READ MORE

Sep 9, 2019 in Big Data Hadoop by ravikiran
• 4,600 points
52 views
0 votes
13 answers

What is the difference between Hadoop/HDFS & HBase?

HDFS is a distributed file system whereas ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Arihar
• 160 points
13,066 views
+1 vote
1 answer

sql exception when exporting

Hello @Hemanth, the error String or binary data ...READ MORE

Sep 4, 2019 in Big Data Hadoop by Ramya
144 views
0 votes
2 answers

How to use scoop in a Java Program

There is a trick which worked out ...READ MORE

Sep 4, 2019 in Big Data Hadoop by ravikiran
• 4,600 points
120 views
0 votes
11 answers

What is the default Namenode port of HDFS. Is it 8020 or 9000 or 50070?

8020/9000 hadoop namenode metadata port number. or ...READ MORE

Dec 31, 2018 in Big Data Hadoop by SM
16,411 views
+1 vote
0 answers

hdfs namenode -format not working, not showing anything.

can someone help me with this please, ...READ MORE

Sep 6, 2019 in Big Data Hadoop by nar
54 views
+1 vote
1 answer

What are all the Data quality checks we do in our real time Big Data projects.

You can use a checksum to compare ...READ MORE

Sep 4, 2019 in Big Data Hadoop by Tina
86 views
0 votes
1 answer

Secondary Sorting in Hadoop MapReduce

Grouping Comparator Once the data reaches a reducer, ...READ MORE

Sep 5, 2019 in Big Data Hadoop by ravikiran
• 4,600 points
74 views
+3 votes
0 answers

How to handle Sqoop failure program and restart the job from failed tables?

When running a Sqoop jobs on a ...READ MORE

Aug 29, 2019 in Big Data Hadoop by Kunal
• 150 points

edited Sep 5, 2019 by Kunal 260 views
0 votes
1 answer

How to call MapReduce program using a simple Java Program?

Because map and reduce run on different ...READ MORE

Sep 4, 2019 in Big Data Hadoop by ravikiran
• 4,600 points
51 views
0 votes
2 answers

How to see MySql service is running or not using linux command?

Hi, You can simply run the following commands ...READ MORE

2 days ago in Big Data Hadoop by anonymous
49 views
0 votes
1 answer

which one is better bigdata or devops for career

I think Big Data will be good ...READ MORE

Aug 26, 2019 in Big Data Hadoop by Karan
265 views
0 votes
1 answer

Converting CSV files to Parquet

--Create Hive external Table for existing data CREATE ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Yogi
1,372 views
0 votes
11 answers

How to check size of HDFS directory?

It is the same syntax. Use the ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Sowmya
11,745 views
0 votes
0 answers

Cloudera Certification

Hi, I want to write CCA-175 (CCA Spark ...READ MORE

Aug 23, 2019 in Big Data Hadoop by Nagajyothi
• 160 points
56 views
0 votes
1 answer

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

 Try using the below build.sbt, code.scala and command ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Kishan
1,029 views
0 votes
1 answer

I want to change the string datatype to timestamp, can anyone help me??

I am not sure if you want ...READ MORE

Aug 22, 2019 in Big Data Hadoop by Karan
47 views
0 votes
0 answers

HIve query data dates issue

Hello All, I am facing one issue, my ...READ MORE

Aug 21, 2019 in Big Data Hadoop by anonymous

edited Aug 22, 2019 by Omkar 79 views
0 votes
1 answer

ERROR 1142 (42000): SELECT command denied to user ''@'localhost' for table 'user'

Hey, This is a mysql command line error ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Gitika
• 25,440 points
2,735 views
0 votes
1 answer
0 votes
1 answer

Sqoop - moving data from DB2 to HDFS ( hive partition table)

sqoop import --driver com.ibm.db2.jcc.DB2Driver --connect jdbc:db2://db2.my.com:50000/databaseName --username ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Payal
493 views