Most answered questions in Big Data Hadoop

0 votes
1 answer

How to remove duplicate records from Hive table?

A record is duplicate if there are ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Bhuvan
 • 9,350 views
0 votes
1 answer

Hive: ParseException line 5:20 missing EOF at '.' near

In the stored as parameter, you have specified the ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Kim
 • 16,932 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

The reason for this error is that ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Srujan
 • 3,606 views
0 votes
1 answer

HDFS: Upload file from local file system to Edureka cloud lab

Step 1: Go to My Lab and ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Zora
 • 1,161 views
0 votes
1 answer

Command to copy file from desktop to hdfs

You can use either of the below ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Firoz
 • 3,872 views
0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Yogi
 • 3,804 views
0 votes
1 answer

Pig: Does these jar files run in NodeManager to produce result?

Below is what happens with the map-reduce ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Lucy
 • 470 views
0 votes
1 answer

Is data sent to some other location to be processed in pig?

With pig, we are not taking data ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Adi
 • 520 views
0 votes
1 answer

When and when not to use PigStore?

The Pig storage is not used only ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Rushil
 • 529 views
0 votes
1 answer

Use of Group ALL in Pig

Suppose we have a data set as ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Roshan
 • 2,916 views
0 votes
1 answer

How to import data to hbase database?

There are 3 Ways to Load Data ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Karan Reddy
 • 5,083 views
0 votes
1 answer

Sqoop ERROR 1290 (HY000): The MySQL server is running with the --secure-file-priv option

If your dataset is in the FTP ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Kunal
 • 2,160 views
0 votes
1 answer

Syntax to mention that the data is enclosed in double quotes in pig

So, we will execute the below command, new_A_2 ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Esha
 • 1,127 views
0 votes
1 answer

How can we ignore header line while loading data into Pig?

Suppose you need to load this in ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Kiran
 • 2,513 views
0 votes
1 answer

Can we use different i/p and o/p format classes in mapreduce code?

Yes, InputFormatClass and OutputFormatClass are independent of ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Jimmy
 • 619 views
0 votes
1 answer

Why do we use job.waitForCompletion(true)?

The main reason for job.waitForCompletion exists is ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Josh
 • 4,490 views
0 votes
1 answer

What is the use of setting the name of the job in mapreduce?

Job job = new Job(conf,"job_name") is just used ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Umesh
 • 418 views
0 votes
1 answer

How to solve error caused due to output types of mapper and reducer not matching?

job.setOutputValueClass will set the types expected as ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Rishab
 • 929 views
0 votes
1 answer

Integration of hbase

For HBase Pig integration, you can refer to ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Kiran
 • 666 views
0 votes
1 answer

Merging Files using PIG

In order to merge two or more ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Tina
 • 452 views
0 votes
1 answer

Query regarding temporary File type conversion of parquet to text

Suppose I have the below parquet file ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Janan
 • 1,131 views
0 votes
1 answer

Pdf to csv file format conversions

You can convert the pdf files with ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Esha
 • 952 views
0 votes
1 answer

Regarding unstructured data handling in hadoop

There are multiple ways to import unstructured ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Jishan
 • 4,500 views
0 votes
1 answer

Sqoop import error with sqoop job

Please try the below command: sqoop job -create ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Rina
 • 2,287 views
0 votes
1 answer

Sending hdfs file to a non hadoop cluster

There are different ways to do this. ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Tarun
 • 593 views
0 votes
1 answer

Exporting of ORC file to RDBMS using SQOOP

We have to use Sqoop-HCatalog Integration here. ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Rishi
 • 2,402 views
0 votes
1 answer

Amazon AWS Web Services

If you want to limit your hadoop ...READ MORE

Jul 8, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 560 views
0 votes
1 answer

Install Hadoop On Ubuntu

I guess it should be at /hadoop/hadoop-common-project/hadoop-common/sr ...READ MORE

Jul 8, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 482 views
0 votes
1 answer

Creating testjob in sqoop for incremental load

Yes, it is possible to do so. ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Umar
 • 739 views
0 votes
1 answer

How to set rep to particular user in hdfs?

HDFS does not allocate capacity separately based ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Leena
 • 493 views
0 votes
1 answer

How to resolve corrupted blocks in Hadoop?

You can use hdfs fsck / to ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Nandini
 • 5,243 views
0 votes
1 answer

Unable to instantiate hive metastore

To resolve this issue, follow the steps ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Ritu
 • 713 views
0 votes
1 answer

Hive complex data types

There are three complex types in hive, arrays: ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Gani
 • 15,386 views
0 votes
1 answer

How does decreasing the block size make more space on Datanode?

When there is space in data nodes ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Krish
 • 709 views
0 votes
1 answer

Getting error while using sqoop import.

You are trying to execute the sqoop ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Reshma
 • 1,217 views
0 votes
1 answer

How to install RHadoop packages (RMR, RHDFS, RHBase)?

With dev tools you can install directly ...READ MORE

Jul 5, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 2,639 views
0 votes
1 answer

How to install Hadoop on Ubuntu?

You can manually create a file hadoop-env.sh ...READ MORE

Jul 5, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 567 views
0 votes
1 answer

Merging Files using PIG

In order to merge two or more ...READ MORE

Jul 4, 2019 in Big Data Hadoop by Tina
 • 1,425 views
0 votes
1 answer

Explain to me how to transfer data between Azure tables and Hadoop on Azure

I shall redirect you to a link ...READ MORE

Jul 4, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 570 views
0 votes
1 answer

Relationship between Hadoop and Database

HDFS is a software framework designed for ...READ MORE

Jul 4, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 416 views
0 votes
1 answer

What is GraphX in Spark?

Hi, Spark uses GraphX for graph processing to ...READ MORE

Jul 2, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 927 views
0 votes
1 answer

Hadoop security GroupMappingServiceProvider exception for Spark job via Dataproc API

If you don't want to turn off ...READ MORE

Jul 2, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,561 views
0 votes
1 answer

ElasticSearch Hadoop Cluster

The elasticsearch Hadoop library is not a ...READ MORE

Jul 2, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 522 views
0 votes
1 answer

failed to start the Namenode format in hadoop generation 2

Hi, You can check this out: 1. Delete all ...READ MORE

Jul 2, 2019 in Big Data Hadoop by Ria
edited Jul 2, 2019 by Gitika • 2,104 views
0 votes
1 answer

what is Hive on spark?

Hey, Hive contains significant support for Apache Spark, ...READ MORE

Jul 2, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 988 views
0 votes
1 answer

Currently am working on Hadoop BigTop installation and am getting this particular error which reads, "GPG key retrieval failed: [Errno 14] problem making ssl connection"

If you are new to this installation ...READ MORE

Jul 1, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 686 views
0 votes
1 answer

How does Hadoop process data which is split across multiple boundaries in an HDFS?

I found some comments: from the Hadoop ...READ MORE

Jul 1, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 743 views
0 votes
1 answer

Explain to me the installation procedures for RHadoop packages (RMR, RHDFS, RHBase).

Download packages rhdfs, rhbase, rmr2 and plyrmr ...READ MORE

Jun 28, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 792 views
0 votes
1 answer

Warning: Unable to load Hadoop Native Library for your platform. [closed]

 I had the same issue. It's solved ...READ MORE

Jun 28, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 5,859 views
0 votes
1 answer

How to connect Relational Database using Sqoop?

Hi, You can use the command below to ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 754 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.