Trending questions in Big Data Hadoop

0 votes
1 answer

Pig mapreduce mode vs local mode?

Both MapReduce mode and local mode seem ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,776 views
0 votes
1 answer

Hbase to pig integration

First enter into grunt shell: $ ./pig –x ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,210 points
774 views
–1 vote
1 answer

Error while creating Hive Database table

In your error, it says that the ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,618 views
0 votes
1 answer

Hadoop Hive: How to convert multiple rows into comma separated values?

You can use the aggregator function collect_set to do ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,959 views
0 votes
0 answers

How Pig programming gets converted into MapReduce jobs?

Could you please give me a brief ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Neha
• 6,300 points
688 views
0 votes
1 answer

Hadoop HDFS: Exception in createBlockOutputStream

It's a connection error. Have you turned ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,662 views
0 votes
1 answer

Differentiate: hadoop fs -text vs hadoop fs -cat vs hadoop fs -get

The main difference between -cat and -text ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Frankie
• 9,830 points
4,017 views
0 votes
1 answer

Pig: mismatched input "T1" expecting RIGHT_CURLY

In Pig, the bag and tuple format ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Yuri
976 views
0 votes
1 answer

Hadoop: How to get the column name along with the output in Hive?

You can get the column names by ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,619 views
+1 vote
1 answer

How to read HDFS and local files with the same code in Java?

You can try something like this: ​ ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,485 views
0 votes
1 answer

Hbase: Client not able to connect with remote Hbase server

You have to remove the localhost entry from hbase server's ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,116 views
0 votes
1 answer

Sqoop getting error while connecting to MySQL

Have you set a password for MySQL? ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,146 views
0 votes
1 answer

Apache storm installation

The “conf/storm.yaml” file contains configurations of Storm. And ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Omkar
• 69,210 points
801 views
0 votes
1 answer

Not able to delete file using pig

rmf is a hadoop file system command and you ...READ MORE

Feb 4, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,269 views
0 votes
1 answer

Error while accessing the file outformat method SetOutputpath

You have imported org.apache.hadoop.mapred.FileOutputFormat, ​​you need to import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat So, make ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
492 views
0 votes
1 answer

How to create a Hive table with a sequence file?

In Hive we can create a sequence ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,324 views
0 votes
1 answer

BigData in MPI

MPI is a communication protocol for programming ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Disha
793 views
0 votes
1 answer

How to reduce shuffling cost in map reduce?

You can define a Combiner function, which does the ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,729 views
0 votes
1 answer

Not able to see racks in reports

Seems like rack awareness is not configure.  Try ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Lucky
363 views
+1 vote
3 answers

HIVE: java.net.URISyntaxException

Change in hfs-site.xml this properties <name>hive.exec.scratchdir</name> <value>/tmp/hive-${user.name}</value> <name>hive.exec.local.scratchdir</name> <value>/tmp/${user.name}</value> <name>hive.downloaded.resources.dir</name> <value>/tmp/${user.name}_resources</value> <name>hive.scratch.dir.permission</name> ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Roshan
4,571 views
0 votes
2 answers

Not able to use npm after installing yarn

 "The easiest way to get started is ...READ MORE

Feb 5, 2019 in Big Data Hadoop by rajesh
• 1,270 points
1,040 views
0 votes
1 answer

MapReduce: Map Value Mismatch error

Seems like you have not specified few ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Haman
705 views
0 votes
1 answer

How to run Java file in Hadoop?

Try this: hadoop fs -cat hdfs:///user/hadoop/values.txt READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,416 views
–1 vote
1 answer

WARN util.NativeCodeLoader: Unable to load native-hadoop library

To remove this warning, you can use:  hdfs ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,723 views
0 votes
1 answer

Speculative Execution in Hadoop

In Hadoop, Speculative Execution is a process ...READ MORE

Aug 28, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
8,033 views
0 votes
1 answer

Failing to execute the script pig file on HDFS

By convention, the pig script that you ...READ MORE

Feb 15, 2019 in Big Data Hadoop by John
617 views
0 votes
1 answer

Hadoop Hive query to filter employees

select * from tablename where DOJ> '2018-01-01' ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,332 views
0 votes
1 answer

Unable to instantiate org.apache.hadoop.hive

You might not have set the connector. ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,500 views
0 votes
1 answer

How to send curl downloaded data in hdfs?

Try using put command with stdin as ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,492 views
0 votes
1 answer

Permission denied while uploading files to hdfs

It is not the problem about permission ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,472 views
0 votes
1 answer

Why should we use "extends Mapper" for Mapreduce code?

The Mapper class belongs to package org.apache.hadoop.mapreduce ...READ MORE

Feb 8, 2019 in Big Data Hadoop by Omkar
• 69,210 points
835 views
0 votes
1 answer

Hadoop Distribution Differences

The Yahoo distribution is a version of ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Frankie
• 9,830 points
401 views
0 votes
1 answer

Error connecting hive using python pyhs2

Seems like the host IP is not ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,000 views
0 votes
1 answer

Doubt in word count query

The COUNT function returns the number of ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,210 points
343 views
0 votes
1 answer

How to concatenate hdfs files and store in output file?

You can use a combination of cat and put command. Something ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,568 views
0 votes
1 answer

Difference between Application Master and Application Manager?

The Application Master is responsible for the ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
13,893 views
0 votes
1 answer

Spark - load CSV file as DataFrame?

spark-csv is part of core Spark functionality ...READ MORE

Sep 25, 2018 in Big Data Hadoop by slayer
• 29,350 points
6,631 views
0 votes
1 answer

How to create new directory in hdfs using java code?

Try this: { Configuration config ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,210 points
3,484 views
0 votes
1 answer

What is Metastore in Hive?

It stores metadata for Hive tables (like their schema ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,881 views
0 votes
1 answer

Mapreduce problem with output part file

As the error suggests and you have ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
762 views
0 votes
1 answer

Hadoop Spark Derby: Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database

As mentioned in the error, there's another ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,347 views
0 votes
1 answer

Hadoop: localhost: Error: JAVA_HOME is not set.

Seems like PATH problem in hadoop-env.sh file. Try ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,746 views
0 votes
1 answer

Browse HDFS & Job Logs

You can browse the hdfs and see the ...READ MORE

Jan 26, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,275 views
–1 vote
1 answer

Getting error while starting hdfs namenode -format

Check your /etc/hosts file, the format should be like ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,885 views
0 votes
1 answer

How will you submit job as particular user?

You need to create a new user ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,210 points
989 views
0 votes
1 answer

Doubt regarding sqoop updated data

Incremental append or load in sqoop will ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Omkar
• 69,210 points
344 views
0 votes
1 answer

How to convert Spark data into CSV?

You can use this: df.write .option("header", "true") ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
4,015 views
0 votes
1 answer

How to create files in hdfs?

You can create a file directly in ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,210 points
1,234 views
–1 vote
1 answer

Setting Hive properties

Hey. It's definitely not a stupid question. ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,148 views
0 votes
2 answers

start-dfs.sh command is not starting Hadoop JobTracker & TaskTracker

On which version of hadoop do you ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
3,422 views