Trending questions in Big Data Hadoop

0 votes
1 answer

Not able to delete file using pig

rmf is a hadoop file system command and you ...READ MORE

Feb 4, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 2,086 views
0 votes
1 answer

Differentiate: hadoop fs -text vs hadoop fs -cat vs hadoop fs -get

The main difference between -cat and -text ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,661 views
0 votes
1 answer

Pig: mismatched input "T1" expecting RIGHT_CURLY

In Pig, the bag and tuple format ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Yuri
 • 1,601 views
–1 vote
1 answer

Error while creating Hive Database table

In your error, it says that the ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 3,196 views
0 votes
2 answers

start-dfs.sh command is not starting Hadoop JobTracker & TaskTracker

On which version of hadoop do you ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
 • 4,613 views
0 votes
1 answer

Error while accessing the file outformat method SetOutputpath

You have imported org.apache.hadoop.mapred.FileOutputFormat, ​​you need to import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat So, make ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,212 views
0 votes
1 answer

How to convert Spark data into CSV?

You can use this: df.write .option("header", "true") ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 5,161 views
0 votes
1 answer

How to reduce shuffling cost in map reduce?

You can define a Combiner function, which does the ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 2,477 views
0 votes
1 answer

How to create a Hive table with a sequence file?

In Hive we can create a sequence ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 4,024 views
0 votes
1 answer

Sqoop getting error while connecting to MySQL

Have you set a password for MySQL? ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,745 views
0 votes
1 answer

Hadoop Spark Derby: Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database

As mentioned in the error, there's another ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 5,320 views
0 votes
1 answer

Hbase to pig integration

First enter into grunt shell: $ ./pig –x ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,202 views
0 votes
1 answer

Error connecting hive using python pyhs2

Seems like the host IP is not ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 2,880 views
0 votes
1 answer

What is the difference between Apache ZooKeeper and Apache Oozie?

The main difference between these two is ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Anoop
 • 5,094 views
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 3,778 views
0 votes
1 answer

How to send curl downloaded data in hdfs?

Try using put command with stdin as ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 2,247 views
–1 vote
1 answer

WARN util.NativeCodeLoader: Unable to load native-hadoop library

To remove this warning, you can use:  hdfs ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 2,421 views
0 votes
1 answer

How to concatenate hdfs files and store in output file?

You can use a combination of cat and put command. Something ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 4,387 views
0 votes
1 answer

Permission denied while uploading files to hdfs

It is not the problem about permission ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 2,198 views
0 votes
1 answer

Apache storm installation

The “conf/storm.yaml” file contains configurations of Storm. And ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,297 views
0 votes
1 answer

How to create new directory in hdfs using java code?

Try this: { Configuration config ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 4,313 views
0 votes
1 answer

Hadoop Hive query to filter employees

select * from tablename where DOJ> '2018-01-01' ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 3,992 views
–1 vote
1 answer

Getting error while starting hdfs namenode -format

Check your /etc/hosts file, the format should be like ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 2,753 views
0 votes
1 answer

Unable to instantiate org.apache.hadoop.hive

You might not have set the connector. ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 2,132 views
0 votes
1 answer

Failing to execute the script pig file on HDFS

By convention, the pig script that you ...READ MORE

Feb 15, 2019 in Big Data Hadoop by John
 • 1,205 views
0 votes
1 answer

Why should we use "extends Mapper" for Mapreduce code?

The Mapper class belongs to package org.apache.hadoop.mapreduce ...READ MORE

Feb 8, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,468 views
0 votes
1 answer

Hadoop Distribution Differences

The Yahoo distribution is a version of ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 1,062 views
0 votes
1 answer

MapReduce: Map Value Mismatch error

Seems like you have not specified few ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Haman
 • 1,213 views
0 votes
1 answer

BigData in MPI

MPI is a communication protocol for programming ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Disha
 • 1,205 views
0 votes
1 answer

Not able to see racks in reports

Seems like rack awareness is not configure.  Try ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Lucky
 • 804 views
0 votes
1 answer

How to check Cloudera Manager Service status?

There surely is a command to check ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 3,692 views
0 votes
1 answer

Not able to insert data into hive table

Seems like a hive version problem.​ insert operation is ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 3,816 views
0 votes
1 answer

Can DataNode and NameNode be commodity hardware?

DataNodes are the commodity hardware only as ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 3,636 views
0 votes
1 answer

Doubt in word count query

The COUNT function returns the number of ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 910 views
0 votes
1 answer

Spark - load CSV file as DataFrame?

spark-csv is part of core Spark functionality ...READ MORE

Sep 25, 2018 in Big Data Hadoop by slayer
 • 29,370 points • 7,228 views
0 votes
1 answer

Mapreduce problem with output part file

As the error suggests and you have ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,375 views
0 votes
1 answer

Hadoop Job Tracker problem. I cannot connect to http://localhost:50030/

I think you are using new version ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 4,386 views
–1 vote
1 answer

Display contents of my Parquet file.

Make sure you are running from the ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 3,561 views
0 votes
1 answer

Browse HDFS & Job Logs

You can browse the hdfs and see the ...READ MORE

Jan 26, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,894 views
0 votes
1 answer

What is Metastore in Hive?

It stores metadata for Hive tables (like their schema ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 3,453 views
0 votes
1 answer

What is the command to count number of lines in a file in hdfs?

hadoop fs -cat /example2/doc1 | wc -l READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 4,614 views
0 votes
1 answer

expected org.apache.hadoop.io.IntWritable, received org.apache.hadoop.io.LongWritable

Hey George!  This error comes whenever you use ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,843 views
–1 vote
1 answer

Setting Hive properties

Hey. It's definitely not a stupid question. ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 2,754 views
0 votes
1 answer

How to create files in hdfs?

You can create a file directly in ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,820 views
0 votes
1 answer

[edureka_159609@ip-20-0-41-190 bin]$ hdfs dfs -mkdir ://localhost:9000/Pig_Data -mkdir: java.net.URISyntaxException: Expected scheme name at index 0: ://localhost:9000/Pig_Data

Hey @Mohan! Could you try the following ...READ MORE

Jan 23, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,878 views
0 votes
1 answer

Not able to insert in hive partition table

You have to add the partition before ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 3,599 views
0 votes
1 answer

What is the Path of hdfs.site.xml?

Here's where you can find the file: /etc/hadoop/[service ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 2,684 views
0 votes
1 answer

Using HBase jar files. Where to download and set classpath

There are many sites you can get ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 3,594 views
–1 vote
1 answer

Does Hadoop merge the output files after reduce phase?

No, the files after the reduce phase are ...READ MORE

Jan 23, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,935 views
0 votes
1 answer

How will you submit job as particular user?

You need to create a new user ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,531 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.