Trending questions in Big Data Hadoop

0 votes
1 answer

Hbase installation Issue. Cant start HRegionServer and HQuorumPeer

It seems hbase did not start properly ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,754 views
0 votes
1 answer

What is the hdfs command to check free space available?

You can see the free available space ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,263 views
0 votes
1 answer

How to read more than one files in Apache Spark?

Try this: val text = sc.wholeTextFiles("student/*") text.collect() ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,384 views
–1 vote
1 answer

IDE Eclipse: Failed to locate the winutils binary in the hadoop binary path

Try this: First, click on file import appliance. Now ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,559 views
+1 vote
1 answer

How to print data without brackets using PIG Dump?

Please refer to the below commands: student = ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,033 views
0 votes
1 answer

Error while creating avrodatafile?

The error you are getting is AvroWrapper class not ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
544 views
0 votes
1 answer

How does the number of groups affect the cost of the shuffling phase?

Shuffle happens with key-value pairs. So, when ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
513 views
0 votes
1 answer

hadoop: command not found

The reason you are getting hadoop as ...READ MORE

Mar 28, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
13,488 views
–1 vote
1 answer

Not able to run java mapreduce

The error which you are getting i.e ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,037 views
0 votes
1 answer

How to copy files in hdfs with wildcards?

You can use the hdfs command: hdfs fs ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,247 views
+1 vote
1 answer

How to get status of hdfs directory using python?

import commands hdir_list = commands.getoutput('hadoop fs -ls hdfs: ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,420 views
0 votes
1 answer

ReduceByKey Avereage

You can try the code mentioned below ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
461 views
0 votes
1 answer

Hive: How to know the path of a created table?

You can use the DESCRIBE command to ...READ MORE

Nov 28, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,788 views
0 votes
1 answer

Hadoop Java Error: java.lang.NoClassDefFoundError: WordCount (wrong name: org/myorg/WordCount)

Hey, try this code import java.io.IOException; import java.util.Iterator; import java.util.StringTokenizer; import ...READ MORE

Sep 19, 2018 in Big Data Hadoop by slayer
• 29,350 points
5,817 views
+1 vote
1 answer

Unable to load data in Hbase table from dataset

Try these steps (make necessary changes): First upload ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,881 views
0 votes
1 answer

mongo-hadoop connector:how to query data?

You can add more parameters in the ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Frankie
• 9,830 points
1,042 views
0 votes
1 answer

In Hue, how to to download the script?

You can download the script to your ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,047 views
–1 vote
1 answer

Hdfs command to see available free space in hdfs

Yes, you check the free space using ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
474 views
0 votes
1 answer

UnsupportedClassVersionError while running Mapreduce program.

Seems like the jar file was not ...READ MORE

Jan 18, 2019 in Big Data Hadoop by Omkar
• 69,210 points
560 views
–1 vote
1 answer

Jobtracker and tasktracker is nor running.

Hi. You'll need to run start-mapred.sh if you want the ...READ MORE

Jan 19, 2019 in Big Data Hadoop by Omkar
• 69,210 points
595 views
0 votes
1 answer

Sqoop creating new file for import evertime

No, you are not doing anything wrong ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
• 69,210 points
908 views
0 votes
1 answer

How can I access S3/S3n from a local Hadoop 2.6 installation?

For some reason, the jar hadoop-aws-[version].jar which contains the ...READ MORE

Oct 3, 2018 in Big Data Hadoop by digger
• 26,740 points
5,109 views
0 votes
1 answer

Issue in hdfs dfs command

Hadoop has a special file system called ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
954 views
–1 vote
1 answer

Beeline and Hive Query Editor in Embedded mode

Running Hive client tools with embedded servers ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,278 views
0 votes
1 answer

Why does one remove or add nodes in a Hadoop cluster frequently?

One of the most attractive features of ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,988 views
0 votes
1 answer

How do I join 2 tables in PIG using 2 fields?

Here, we have two tables: Tab1 having columns ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,983 views
0 votes
1 answer

Hadoop: Can not start namenode: Unable to load native-hadoop library for your platform

The entries in your .bashrc file looks ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,326 views
0 votes
1 answer

How to connect hive to tableau?

We Can not connect hive to tableau ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,365 views
–1 vote
1 answer

Who will setup multimode and single node modes?

Cluster management is something that is generally ...READ MORE

Jan 21, 2019 in Big Data Hadoop by Omkar
• 69,210 points
328 views
0 votes
1 answer

Sqoop import gives error: org.apache.hadoop.security.AccessControlException: Permission denied

Seems like you are not passing the ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,797 views
0 votes
1 answer

Hadoop Hive: message:Version information not found in metastore. Unable to instantiate

These are the necessary tables required for metastore that are ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,306 views
0 votes
1 answer

Hive table not able to use row format serde

Try this: create table books(isbn string, book_title string, ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,179 views
0 votes
1 answer

Not able to create Hive table from HDFS file

You dont have to specify the file name ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,295 views
0 votes
1 answer

"Cant connect to local mysql server through socket "var/lib/mysql/mysql.sock" .

Seems like mysql.sock does not exist in the ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,384 views
–1 vote
1 answer

Cant open spark-shell webconsole

Seems like you have installed Spark2 but ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,339 views
0 votes
1 answer

How to change file format using Sqoop?

For change in the file format, you ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,726 views
–1 vote
1 answer

How to change the default HUE logs path?

You can change/replace the LOG_DIR variable to ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
847 views
+1 vote
1 answer

How can we list files in HDFS directory as per timestamp?

No, there is no other option to ...READ MORE

May 8, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
11,302 views
–1 vote
1 answer

Hive partition tables

Yes, you can create manual partition. Here's ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,003 views
0 votes
1 answer

Not able to start/stop hadoop daemons

If you were able to start the ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,550 views
0 votes
1 answer

Hadoop mapreduce error: apache.hadoop.mapred.FileAlreadyExistsException: Output directory

Seems like the output file already exists. ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,230 views
0 votes
1 answer

Cant access the Hadoop Namenode from browser

As mentioned in the error, the nodes ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,540 views
–1 vote
1 answer

Beeline vs Hive Query Editor

Hive CLI connects to a remote HiveServer1 ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,099 views
0 votes
1 answer

Script storage in Hue

You can follow these steps to find ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
750 views
–1 vote
1 answer

Serde query understanding

In the query mentioned in your question, ...READ MORE

Dec 29, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,160 views
–1 vote
1 answer

Changing map and reduce slots

Follow these steps to set the map ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,210 points
819 views
–1 vote
1 answer

How to access Hadoop counter values using API?

You can use the job object to access the ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
959 views
+1 vote
1 answer

Hadoop Map Reduce: java.lang.reflect.InvocationTargetException

I executed the same code and it ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,461 views
0 votes
1 answer

How to find the running namenodes and secondary name nodes in hadoop?

Name nodes: hdfs getconf -namenodes Secondary name nodes: hdfs getconf ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,397 views
–1 vote
1 answer

How we can run spark SQL over hive tables in our cluster?

Open spark-shell. scala> import org.apache.spark.sql.hive._ scala> val hc = ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,140 views