Trending questions in Big Data Hadoop

0 votes
1 answer

Mutliple Output Format in Hadoop

Each reducer uses an OutputFormat to write ...READ MORE

3 minutes ago in Big Data Hadoop by ravikiran
 • 3,560 points • 2 views
0 votes
1 answer

How to fix corrupt files on HDFS

1 - Spark if following slave/master architecture. So ...READ MORE

23 hours ago in Big Data Hadoop by ravikiran
 • 3,560 points • 9 views
0 votes
1 answer

Spark Vs Hive LLAP Question

While Apache Hive and Spark SQL perform ...READ MORE

3 days ago in Big Data Hadoop by Karan
 • 21 views
0 votes
1 answer

Copy file from local to hdfs from the spark job in yarn mode

Please refer to the below code: import org.apache.hadoop.conf.Configuration import ...READ MORE

3 days ago in Big Data Hadoop by Raj
 • 16 views
0 votes
1 answer

How does data gets split in Sqoop?

I will drop the answer in the ...READ MORE

3 days ago in Big Data Hadoop by ravikiran
 • 3,560 points • 15 views
0 votes
1 answer

Output Splitting problem in Hadoop

When you are loading two different files, ...READ MORE

3 days ago in Big Data Hadoop by Sayni
 • 12 views
0 votes
1 answer

How to execute combiner and partitioning program without adding package name?

Yes, it is possible to do so ...READ MORE

3 days ago in Big Data Hadoop by Raman
 • 11 views
0 votes
1 answer

Sqoop export not working

The issue that you might be getting ...READ MORE

3 days ago in Big Data Hadoop by Tina
 • 8 views
0 votes
1 answer

how to store images and videos on to HDFS?

HDFS is capable to accept data in ...READ MORE

3 days ago in Big Data Hadoop by ravikiran
 • 3,560 points • 12 views
0 votes
1 answer

Pig: Difference between inner bag and outer bag

Outer Bag: An outer bag is nothing but ...READ MORE

3 days ago in Big Data Hadoop by Firoz
 • 8 views
0 votes
1 answer

RDMBS integration with Hadoop

About integrating RDBMS with Hadoop, you can ...READ MORE

3 days ago in Big Data Hadoop by Nanda
 • 8 views
0 votes
1 answer

CSV integration with Hadoop

For integrating Hadoop with CSV, we can use ...READ MORE

3 days ago in Big Data Hadoop by Krish
 • 7 views
0 votes
1 answer

Which one is better MR or Spark?

The above difference clearly points out that ...READ MORE

4 days ago in Big Data Hadoop by Daniel
 • 14 views
0 votes
1 answer

Import JSON file into hive

There are two ways to load json ...READ MORE

4 days ago in Big Data Hadoop by Guru
 • 13 views
0 votes
1 answer

Error in running hdfs commands

The command you entered is incorrect. Run ...READ MORE

4 days ago in Big Data Hadoop by Guru
 • 10 views
0 votes
1 answer

Pig script not dumping the data correctly

The first column is denoted by $0, ...READ MORE

4 days ago in Big Data Hadoop by George
 • 9 views
0 votes
1 answer

Exception in thread "main" java.lang.UnsupportedClassVersionError

Try removing the / before the input ...READ MORE

4 days ago in Big Data Hadoop by Kriti
 • 10 views
0 votes
1 answer

Sqoop: Dsqoop.export.records.per.statement option

Dsqoop.export.records.per.statement=1 is as the name suggests how many ...READ MORE

4 days ago in Big Data Hadoop by Krish
 • 8 views
0 votes
1 answer

Load data into teradata using sqoop

The general syntax to do this as ...READ MORE

4 days ago in Big Data Hadoop by Ritu
 • 8 views
0 votes
1 answer

How to Import the complete directory into HDFS?

First, need to create a directory in Hadoop: $ ...READ MORE

4 days ago in Big Data Hadoop by Hiran
 • 7 views
0 votes
1 answer

Creating a hive script and execute in the edureka cloudlab.

Please remove -f option from hive arguments and use hql extension ...READ MORE

5 days ago in Big Data Hadoop by Karan
 • 10 views
0 votes
1 answer

Hive Query to sort data

If you are trying to sort first ...READ MORE

5 days ago in Big Data Hadoop by Tina
 • 8 views
0 votes
1 answer

How to set up Map and Reduce Tasks?

when using the basic FileInputFormat classes is just the ...READ MORE

Jul 12 in Big Data Hadoop by ravikiran
 • 3,560 points • 27 views
0 votes
1 answer

How to remove duplicate records from Hive table?

A record is duplicate if there are ...READ MORE

Jul 11 in Big Data Hadoop by Bhuvan
 • 23 views
0 votes
1 answer

Primary keys in apache Spark

from pyspark.sql.functions import monotonically_increasing_id df.withColumn("id", monotonically_increasing_id()).show() Verify the second ...READ MORE

Jul 11 in Big Data Hadoop by ravikiran
 • 3,560 points • 20 views
0 votes
1 answer

Hive: ParseException line 5:20 missing EOF at '.' near

In the stored as parameter, you have specified the ...READ MORE

Jul 11 in Big Data Hadoop by Kim
 • 18 views
0 votes
1 answer

Unable to Locate WinUtils Library in Hadoop binary path.

If you are facing this problem while running a ...READ MORE

Jul 11 in Big Data Hadoop by ravikiran
 • 3,560 points • 14 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

The reason for this error is that ...READ MORE

Jul 11 in Big Data Hadoop by Srujan
 • 14 views
0 votes
1 answer

Command to copy file from desktop to hdfs

You can use either of the below ...READ MORE

Jul 11 in Big Data Hadoop by Firoz
 • 13 views
0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 11 in Big Data Hadoop by Yogi
 • 14 views
0 votes
1 answer

HDFS: Upload file from local file system to Edureka cloud lab

Step 1: Go to My Lab and ...READ MORE

Jul 11 in Big Data Hadoop by Zora
 • 10 views
0 votes
1 answer

Is data sent to some other location to be processed in pig?

With pig, we are not taking data ...READ MORE

Jul 10 in Big Data Hadoop by Adi
 • 17 views
0 votes
1 answer

Pig: Does these jar files run in NodeManager to produce result?

Below is what happens with the map-reduce ...READ MORE

Jul 10 in Big Data Hadoop by Lucy
 • 14 views
0 votes
1 answer

How to import data to hbase database?

There are 3 Ways to Load Data ...READ MORE

Jul 10 in Big Data Hadoop by Karan Reddy
 • 14 views
0 votes
1 answer

Use of Group ALL in Pig

Suppose we have a data set as ...READ MORE

Jul 10 in Big Data Hadoop by Roshan
 • 12 views
0 votes
1 answer

Sqoop ERROR 1290 (HY000): The MySQL server is running with the --secure-file-priv option

If your dataset is in the FTP ...READ MORE

Jul 10 in Big Data Hadoop by Kunal
 • 12 views
0 votes
1 answer

When and when not to use PigStore?

The Pig storage is not used only ...READ MORE

Jul 10 in Big Data Hadoop by Rushil
 • 9 views
0 votes
1 answer

How can we ignore header line while loading data into Pig?

Suppose you need to load this in ...READ MORE

Jul 10 in Big Data Hadoop by Kiran
 • 11 views
0 votes
1 answer

Syntax to mention that the data is enclosed in double quotes in pig

So, we will execute the below command, new_A_2 ...READ MORE

Jul 10 in Big Data Hadoop by Esha
 • 8 views
+1 vote
0 answers

Hadoop Installation error [closed]

Pls help on below error..on MAC OS WARN ...READ MORE

Jul 9 in Big Data Hadoop by Anshuman
 • 130 points
closed Jul 10 by Omkar • 12 views
0 votes
1 answer

Can we use different i/p and o/p format classes in mapreduce code?

Yes, InputFormatClass and OutputFormatClass are independent of ...READ MORE

Jul 9 in Big Data Hadoop by Jimmy
 • 17 views
0 votes
1 answer

How to solve error caused due to output types of mapper and reducer not matching?

job.setOutputValueClass will set the types expected as ...READ MORE

Jul 9 in Big Data Hadoop by Rishab
 • 17 views
0 votes
1 answer

Integration of hbase

For HBase Pig integration, you can refer to ...READ MORE

Jul 9 in Big Data Hadoop by Kiran
 • 17 views
0 votes
1 answer

Why do we use job.waitForCompletion(true)?

The main reason for job.waitForCompletion exists is ...READ MORE

Jul 9 in Big Data Hadoop by Josh
 • 16 views
0 votes
1 answer

What is the use of setting the name of the job in mapreduce?

Job job = new Job(conf,"job_name") is just used ...READ MORE

Jul 9 in Big Data Hadoop by Umesh
 • 14 views
0 votes
1 answer

Regarding unstructured data handling in hadoop

There are multiple ways to import unstructured ...READ MORE

Jul 9 in Big Data Hadoop by Jishan
 • 18 views
0 votes
1 answer

Merging Files using PIG

In order to merge two or more ...READ MORE

Jul 9 in Big Data Hadoop by Tina
 • 12 views
0 votes
1 answer

Query regarding temporary File type conversion of parquet to text

Suppose I have the below parquet file ...READ MORE

Jul 9 in Big Data Hadoop by Janan
 • 11 views
0 votes
1 answer

Pdf to csv file format conversions

You can convert the pdf files with ...READ MORE

Jul 9 in Big Data Hadoop by Esha
 • 13 views
0 votes
1 answer

Sqoop import error with sqoop job

Please try the below command: sqoop job -create ...READ MORE

Jul 9 in Big Data Hadoop by Rina
 • 14 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.