Trending questions in Big Data Hadoop

0 votes
1 answer

Hbase installation Issue. Cant start HRegionServer and HQuorumPeer

It seems hbase did not start properly ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,750 views
0 votes
1 answer

What is the hdfs command to check free space available?

You can see the free available space ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,253 views
0 votes
1 answer

How to read more than one files in Apache Spark?

Try this: val text = sc.wholeTextFiles("student/*") text.collect() ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,383 views
–1 vote
1 answer

IDE Eclipse: Failed to locate the winutils binary in the hadoop binary path

Try this: First, click on file import appliance. Now ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,558 views
+1 vote
1 answer

How to print data without brackets using PIG Dump?

Please refer to the below commands: student = ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,031 views
0 votes
1 answer

Error while creating avrodatafile?

The error you are getting is AvroWrapper class not ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
543 views
0 votes
1 answer

How does the number of groups affect the cost of the shuffling phase?

Shuffle happens with key-value pairs. So, when ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
513 views
–1 vote
1 answer

Not able to run java mapreduce

The error which you are getting i.e ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,036 views
0 votes
1 answer

hadoop: command not found

The reason you are getting hadoop as ...READ MORE

Mar 28, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
13,477 views
+1 vote
1 answer

How to get status of hdfs directory using python?

import commands hdir_list = commands.getoutput('hadoop fs -ls hdfs: ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,419 views
0 votes
1 answer

How to copy files in hdfs with wildcards?

You can use the hdfs command: hdfs fs ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,240 views
0 votes
1 answer

ReduceByKey Avereage

You can try the code mentioned below ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
459 views
+1 vote
1 answer

Unable to load data in Hbase table from dataset

Try these steps (make necessary changes): First upload ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,880 views
0 votes
1 answer

Hive: How to know the path of a created table?

You can use the DESCRIBE command to ...READ MORE

Nov 28, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,782 views
0 votes
1 answer

Hadoop Java Error: java.lang.NoClassDefFoundError: WordCount (wrong name: org/myorg/WordCount)

Hey, try this code import java.io.IOException; import java.util.Iterator; import java.util.StringTokenizer; import ...READ MORE

Sep 19, 2018 in Big Data Hadoop by slayer
• 29,350 points
5,814 views
0 votes
1 answer

mongo-hadoop connector:how to query data?

You can add more parameters in the ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Frankie
• 9,830 points
1,041 views
–1 vote
1 answer

Hdfs command to see available free space in hdfs

Yes, you check the free space using ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
472 views
0 votes
1 answer

In Hue, how to to download the script?

You can download the script to your ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,041 views
–1 vote
1 answer

Jobtracker and tasktracker is nor running.

Hi. You'll need to run start-mapred.sh if you want the ...READ MORE

Jan 19, 2019 in Big Data Hadoop by Omkar
• 69,210 points
594 views
0 votes
1 answer

UnsupportedClassVersionError while running Mapreduce program.

Seems like the jar file was not ...READ MORE

Jan 18, 2019 in Big Data Hadoop by Omkar
• 69,210 points
556 views
0 votes
1 answer

Sqoop creating new file for import evertime

No, you are not doing anything wrong ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
• 69,210 points
907 views
0 votes
1 answer

How can I access S3/S3n from a local Hadoop 2.6 installation?

For some reason, the jar hadoop-aws-[version].jar which contains the ...READ MORE

Oct 3, 2018 in Big Data Hadoop by digger
• 26,740 points
5,107 views
0 votes
1 answer

Issue in hdfs dfs command

Hadoop has a special file system called ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
952 views
–1 vote
1 answer

Beeline and Hive Query Editor in Embedded mode

Running Hive client tools with embedded servers ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,275 views
0 votes
1 answer

Why does one remove or add nodes in a Hadoop cluster frequently?

One of the most attractive features of ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,986 views
0 votes
1 answer

How do I join 2 tables in PIG using 2 fields?

Here, we have two tables: Tab1 having columns ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,980 views
0 votes
1 answer

Hadoop: Can not start namenode: Unable to load native-hadoop library for your platform

The entries in your .bashrc file looks ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,325 views
0 votes
1 answer

How to connect hive to tableau?

We Can not connect hive to tableau ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,363 views
–1 vote
1 answer

Who will setup multimode and single node modes?

Cluster management is something that is generally ...READ MORE

Jan 21, 2019 in Big Data Hadoop by Omkar
• 69,210 points
327 views
0 votes
1 answer

Sqoop import gives error: org.apache.hadoop.security.AccessControlException: Permission denied

Seems like you are not passing the ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,795 views
0 votes
1 answer

Hadoop Hive: message:Version information not found in metastore. Unable to instantiate

These are the necessary tables required for metastore that are ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,303 views
0 votes
1 answer

Hive table not able to use row format serde

Try this: create table books(isbn string, book_title string, ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,173 views
0 votes
1 answer

Not able to create Hive table from HDFS file

You dont have to specify the file name ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,293 views
0 votes
1 answer

"Cant connect to local mysql server through socket "var/lib/mysql/mysql.sock" .

Seems like mysql.sock does not exist in the ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,384 views
–1 vote
1 answer

Cant open spark-shell webconsole

Seems like you have installed Spark2 but ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,336 views
0 votes
1 answer

How to change file format using Sqoop?

For change in the file format, you ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,724 views
–1 vote
1 answer

How to change the default HUE logs path?

You can change/replace the LOG_DIR variable to ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
846 views
+1 vote
1 answer

How can we list files in HDFS directory as per timestamp?

No, there is no other option to ...READ MORE

May 8, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
11,292 views
–1 vote
1 answer

Hive partition tables

Yes, you can create manual partition. Here's ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,000 views
0 votes
1 answer

Not able to start/stop hadoop daemons

If you were able to start the ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,548 views
0 votes
1 answer

Hadoop mapreduce error: apache.hadoop.mapred.FileAlreadyExistsException: Output directory

Seems like the output file already exists. ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,227 views
0 votes
1 answer

Cant access the Hadoop Namenode from browser

As mentioned in the error, the nodes ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,539 views
–1 vote
1 answer

Beeline vs Hive Query Editor

Hive CLI connects to a remote HiveServer1 ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,095 views
0 votes
1 answer

Script storage in Hue

You can follow these steps to find ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
749 views
–1 vote
1 answer

Serde query understanding

In the query mentioned in your question, ...READ MORE

Dec 29, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,159 views
–1 vote
1 answer

Changing map and reduce slots

Follow these steps to set the map ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,210 points
818 views
–1 vote
1 answer

How to access Hadoop counter values using API?

You can use the job object to access the ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,210 points
957 views
+1 vote
1 answer

Hadoop Map Reduce: java.lang.reflect.InvocationTargetException

I executed the same code and it ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,461 views
0 votes
1 answer

How to find the running namenodes and secondary name nodes in hadoop?

Name nodes: hdfs getconf -namenodes Secondary name nodes: hdfs getconf ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,395 views
–1 vote
1 answer

How we can run spark SQL over hive tables in our cluster?

Open spark-shell. scala> import org.apache.spark.sql.hive._ scala> val hc = ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,210 points
1,136 views