Most voted questions in Big Data Hadoop

0 votes
1 answer

How to Import the complete directory into HDFS?

First, need to create a directory in Hadoop: $ ...READ MORE

Jul 15 in Big Data Hadoop by Hiran
 • 16 views
0 votes
1 answer

Which one is better MR or Spark?

The above difference clearly points out that ...READ MORE

Jul 15 in Big Data Hadoop by Daniel
 • 45 views
0 votes
1 answer

Sqoop: Dsqoop.export.records.per.statement option

Dsqoop.export.records.per.statement=1 is as the name suggests how many ...READ MORE

Jul 15 in Big Data Hadoop by Krish
 • 90 views
0 votes
1 answer

Load data into teradata using sqoop

The general syntax to do this as ...READ MORE

Jul 15 in Big Data Hadoop by Ritu
 • 94 views
0 votes
2 answers

Exception in thread "main" java.lang.UnsupportedClassVersionError

Hi, keep in mind do not forget to ...READ MORE

Aug 5 in Big Data Hadoop by Rashi
 • 72 views
0 votes
1 answer

Import JSON file into hive

There are two ways to load json ...READ MORE

Jul 15 in Big Data Hadoop by Guru
 • 572 views
0 votes
1 answer

Hive Query to sort data

If you are trying to sort first ...READ MORE

Jul 14 in Big Data Hadoop by Tina
 • 31 views
0 votes
1 answer

Creating a hive script and execute in the edureka cloudlab.

Please remove -f option from hive arguments and use hql extension ...READ MORE

Jul 14 in Big Data Hadoop by Karan
 • 26 views
0 votes
2 answers

How to set up Map and Reduce Tasks?

Hi, The number of map tasks for a ...READ MORE

Aug 5 in Big Data Hadoop by Rashi
 • 89 views
0 votes
1 answer

Unable to Locate WinUtils Library in Hadoop binary path.

If you are facing this problem while running a ...READ MORE

Jul 11 in Big Data Hadoop by ravikiran
 • 4,560 points • 88 views
0 votes
1 answer

Primary keys in apache Spark

from pyspark.sql.functions import monotonically_increasing_id df.withColumn("id", monotonically_increasing_id()).show() Verify the second ...READ MORE

Jul 11 in Big Data Hadoop by ravikiran
 • 4,560 points • 112 views
0 votes
1 answer

How to remove duplicate records from Hive table?

A record is duplicate if there are ...READ MORE

Jul 11 in Big Data Hadoop by Bhuvan
 • 868 views
0 votes
1 answer

Hive: ParseException line 5:20 missing EOF at '.' near

In the stored as parameter, you have specified the ...READ MORE

Jul 11 in Big Data Hadoop by Kim
 • 849 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

The reason for this error is that ...READ MORE

Jul 11 in Big Data Hadoop by Srujan
 • 77 views
0 votes
1 answer

HDFS: Upload file from local file system to Edureka cloud lab

Step 1: Go to My Lab and ...READ MORE

Jul 11 in Big Data Hadoop by Zora
 • 68 views
0 votes
1 answer

Command to copy file from desktop to hdfs

You can use either of the below ...READ MORE

Jul 11 in Big Data Hadoop by Firoz
 • 48 views
0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 11 in Big Data Hadoop by Yogi
 • 180 views
0 votes
1 answer

Pig: Does these jar files run in NodeManager to produce result?

Below is what happens with the map-reduce ...READ MORE

Jul 10 in Big Data Hadoop by Lucy
 • 31 views
0 votes
1 answer

Is data sent to some other location to be processed in pig?

With pig, we are not taking data ...READ MORE

Jul 10 in Big Data Hadoop by Adi
 • 27 views
0 votes
1 answer

When and when not to use PigStore?

The Pig storage is not used only ...READ MORE

Jul 10 in Big Data Hadoop by Rushil
 • 23 views
0 votes
1 answer

Use of Group ALL in Pig

Suppose we have a data set as ...READ MORE

Jul 10 in Big Data Hadoop by Roshan
 • 42 views
0 votes
1 answer

How to import data to hbase database?

There are 3 Ways to Load Data ...READ MORE

Jul 10 in Big Data Hadoop by Karan Reddy
 • 96 views
0 votes
1 answer

Sqoop ERROR 1290 (HY000): The MySQL server is running with the --secure-file-priv option

If your dataset is in the FTP ...READ MORE

Jul 10 in Big Data Hadoop by Kunal
 • 105 views
0 votes
1 answer

Syntax to mention that the data is enclosed in double quotes in pig

So, we will execute the below command, new_A_2 ...READ MORE

Jul 10 in Big Data Hadoop by Esha
 • 30 views
0 votes
1 answer

How can we ignore header line while loading data into Pig?

Suppose you need to load this in ...READ MORE

Jul 10 in Big Data Hadoop by Kiran
 • 117 views
0 votes
1 answer

Can we use different i/p and o/p format classes in mapreduce code?

Yes, InputFormatClass and OutputFormatClass are independent of ...READ MORE

Jul 9 in Big Data Hadoop by Jimmy
 • 32 views
0 votes
1 answer

Why do we use job.waitForCompletion(true)?

The main reason for job.waitForCompletion exists is ...READ MORE

Jul 9 in Big Data Hadoop by Josh
 • 258 views
0 votes
1 answer

What is the use of setting the name of the job in mapreduce?

Job job = new Job(conf,"job_name") is just used ...READ MORE

Jul 9 in Big Data Hadoop by Umesh
 • 33 views
0 votes
1 answer

How to solve error caused due to output types of mapper and reducer not matching?

job.setOutputValueClass will set the types expected as ...READ MORE

Jul 9 in Big Data Hadoop by Rishab
 • 35 views
0 votes
1 answer

Integration of hbase

For HBase Pig integration, you can refer to ...READ MORE

Jul 9 in Big Data Hadoop by Kiran
 • 40 views
0 votes
1 answer

Merging Files using PIG

In order to merge two or more ...READ MORE

Jul 9 in Big Data Hadoop by Tina
 • 31 views
0 votes
1 answer

Query regarding temporary File type conversion of parquet to text

Suppose I have the below parquet file ...READ MORE

Jul 9 in Big Data Hadoop by Janan
 • 68 views
0 votes
1 answer

Pdf to csv file format conversions

You can convert the pdf files with ...READ MORE

Jul 9 in Big Data Hadoop by Esha
 • 45 views
0 votes
1 answer

Regarding unstructured data handling in hadoop

There are multiple ways to import unstructured ...READ MORE

Jul 9 in Big Data Hadoop by Jishan
 • 57 views
0 votes
1 answer

Sqoop import error with sqoop job

Please try the below command: sqoop job -create ...READ MORE

Jul 9 in Big Data Hadoop by Rina
 • 56 views
0 votes
1 answer

Sending hdfs file to a non hadoop cluster

There are different ways to do this. ...READ MORE

Jul 9 in Big Data Hadoop by Tarun
 • 30 views
0 votes
1 answer

Exporting of ORC file to RDBMS using SQOOP

We have to use Sqoop-HCatalog Integration here. ...READ MORE

Jul 9 in Big Data Hadoop by Rishi
 • 82 views
0 votes
1 answer

Amazon AWS Web Services

If you want to limit your hadoop ...READ MORE

Jul 8 in Big Data Hadoop by ravikiran
 • 4,560 points • 32 views
0 votes
1 answer

Install Hadoop On Ubuntu

I guess it should be at /hadoop/hadoop-common-project/hadoop-common/sr ...READ MORE

Jul 8 in Big Data Hadoop by ravikiran
 • 4,560 points • 30 views
0 votes
1 answer

Creating testjob in sqoop for incremental load

Yes, it is possible to do so. ...READ MORE

Jul 5 in Big Data Hadoop by Umar
 • 38 views
0 votes
1 answer

How to set rep to particular user in hdfs?

HDFS does not allocate capacity separately based ...READ MORE

Jul 5 in Big Data Hadoop by Leena
 • 32 views
0 votes
1 answer

How to resolve corrupted blocks in Hadoop?

You can use hdfs fsck / to ...READ MORE

Jul 5 in Big Data Hadoop by Nandini
 • 171 views
0 votes
1 answer

Unable to instantiate hive metastore

To resolve this issue, follow the steps ...READ MORE

Jul 5 in Big Data Hadoop by Ritu
 • 54 views
0 votes
1 answer

Hive complex data types

There are three complex types in hive, arrays: ...READ MORE

Jul 5 in Big Data Hadoop by Gani
 • 561 views
0 votes
1 answer

How does decreasing the block size make more space on Datanode?

When there is space in data nodes ...READ MORE

Jul 5 in Big Data Hadoop by Krish
 • 33 views
0 votes
1 answer

Getting error while using sqoop import.

You are trying to execute the sqoop ...READ MORE

Jul 5 in Big Data Hadoop by Reshma
 • 65 views
0 votes
1 answer

How to install RHadoop packages (RMR, RHDFS, RHBase)?

With dev tools you can install directly ...READ MORE

Jul 5 in Big Data Hadoop by ravikiran
 • 4,560 points • 192 views
0 votes
1 answer

How to install Hadoop on Ubuntu?

You can manually create a file hadoop-env.sh ...READ MORE

Jul 5 in Big Data Hadoop by ravikiran
 • 4,560 points • 44 views
0 votes
1 answer

Merging Files using PIG

In order to merge two or more ...READ MORE

Jul 4 in Big Data Hadoop by Tina
 • 167 views
0 votes
1 answer

Explain to me how to transfer data between Azure tables and Hadoop on Azure

I shall redirect you to a link ...READ MORE

Jul 4 in Big Data Hadoop by ravikiran
 • 4,560 points • 46 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.