Trending questions in Big Data Hadoop

0 votes
1 answer

Load data into teradata using sqoop

The general syntax to do this as ...READ MORE

Jul 15 in Big Data Hadoop by Ritu
 • 49 views
0 votes
1 answer

Which one is better MR or Spark?

The above difference clearly points out that ...READ MORE

Jul 15 in Big Data Hadoop by Daniel
 • 33 views
0 votes
1 answer

Pig script not dumping the data correctly

The first column is denoted by $0, ...READ MORE

Jul 15 in Big Data Hadoop by George
 • 17 views
0 votes
2 answers

Error While Running Oozie Project

You need to add your current user ...READ MORE

Aug 6 in Big Data Hadoop by Dhimanshu
 • 35 views
0 votes
1 answer

How to Import the complete directory into HDFS?

First, need to create a directory in Hadoop: $ ...READ MORE

Jul 15 in Big Data Hadoop by Hiran
 • 14 views
0 votes
1 answer

Hive Query to sort data

If you are trying to sort first ...READ MORE

Jul 14 in Big Data Hadoop by Tina
 • 23 views
0 votes
1 answer

Creating a hive script and execute in the edureka cloudlab.

Please remove -f option from hive arguments and use hql extension ...READ MORE

Jul 14 in Big Data Hadoop by Karan
 • 21 views
0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 11 in Big Data Hadoop by Yogi
 • 102 views
0 votes
1 answer

Primary keys in apache Spark

from pyspark.sql.functions import monotonically_increasing_id df.withColumn("id", monotonically_increasing_id()).show() Verify the second ...READ MORE

Jul 11 in Big Data Hadoop by ravikiran
 • 4,560 points • 81 views
0 votes
1 answer

Unable to Locate WinUtils Library in Hadoop binary path.

If you are facing this problem while running a ...READ MORE

Jul 11 in Big Data Hadoop by ravikiran
 • 4,560 points • 61 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

The reason for this error is that ...READ MORE

Jul 11 in Big Data Hadoop by Srujan
 • 53 views
0 votes
1 answer

HDFS: Upload file from local file system to Edureka cloud lab

Step 1: Go to My Lab and ...READ MORE

Jul 11 in Big Data Hadoop by Zora
 • 52 views
0 votes
1 answer

Why do we use job.waitForCompletion(true)?

The main reason for job.waitForCompletion exists is ...READ MORE

Jul 9 in Big Data Hadoop by Josh
 • 119 views
0 votes
1 answer

Command to copy file from desktop to hdfs

You can use either of the below ...READ MORE

Jul 11 in Big Data Hadoop by Firoz
 • 33 views
0 votes
1 answer

How can we ignore header line while loading data into Pig?

Suppose you need to load this in ...READ MORE

Jul 10 in Big Data Hadoop by Kiran
 • 63 views
0 votes
1 answer

How to import data to hbase database?

There are 3 Ways to Load Data ...READ MORE

Jul 10 in Big Data Hadoop by Karan Reddy
 • 44 views
0 votes
1 answer

Hive complex data types

There are three complex types in hive, arrays: ...READ MORE

Jul 5 in Big Data Hadoop by Gani
 • 263 views
0 votes
1 answer

Sqoop ERROR 1290 (HY000): The MySQL server is running with the --secure-file-priv option

If your dataset is in the FTP ...READ MORE

Jul 10 in Big Data Hadoop by Kunal
 • 38 views
0 votes
10 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Aditya
 • 14,712 views
0 votes
1 answer

Use of Group ALL in Pig

Suppose we have a data set as ...READ MORE

Jul 10 in Big Data Hadoop by Roshan
 • 36 views
0 votes
1 answer

Pig: Does these jar files run in NodeManager to produce result?

Below is what happens with the map-reduce ...READ MORE

Jul 10 in Big Data Hadoop by Lucy
 • 27 views
0 votes
1 answer

Is data sent to some other location to be processed in pig?

With pig, we are not taking data ...READ MORE

Jul 10 in Big Data Hadoop by Adi
 • 23 views
0 votes
1 answer

Syntax to mention that the data is enclosed in double quotes in pig

So, we will execute the below command, new_A_2 ...READ MORE

Jul 10 in Big Data Hadoop by Esha
 • 21 views
0 votes
1 answer

When and when not to use PigStore?

The Pig storage is not used only ...READ MORE

Jul 10 in Big Data Hadoop by Rushil
 • 16 views
0 votes
1 answer

Query regarding temporary File type conversion of parquet to text

Suppose I have the below parquet file ...READ MORE

Jul 9 in Big Data Hadoop by Janan
 • 42 views
0 votes
1 answer

Exporting of ORC file to RDBMS using SQOOP

We have to use Sqoop-HCatalog Integration here. ...READ MORE

Jul 9 in Big Data Hadoop by Rishi
 • 45 views
0 votes
1 answer

Sqoop import error with sqoop job

Please try the below command: sqoop job -create ...READ MORE

Jul 9 in Big Data Hadoop by Rina
 • 41 views
0 votes
1 answer

Pdf to csv file format conversions

You can convert the pdf files with ...READ MORE

Jul 9 in Big Data Hadoop by Esha
 • 36 views
+1 vote
0 answers

Hadoop Installation error [closed]

Pls help on below error..on MAC OS WARN ...READ MORE

Jul 9 in Big Data Hadoop by Anshuman
 • 130 points
closed Jul 10 by Omkar • 25 views
0 votes
1 answer

Integration of hbase

For HBase Pig integration, you can refer to ...READ MORE

Jul 9 in Big Data Hadoop by Kiran
 • 29 views
0 votes
1 answer

How to solve error caused due to output types of mapper and reducer not matching?

job.setOutputValueClass will set the types expected as ...READ MORE

Jul 9 in Big Data Hadoop by Rishab
 • 28 views
0 votes
1 answer

What is the use of setting the name of the job in mapreduce?

Job job = new Job(conf,"job_name") is just used ...READ MORE

Jul 9 in Big Data Hadoop by Umesh
 • 27 views
0 votes
1 answer

Can we use different i/p and o/p format classes in mapreduce code?

Yes, InputFormatClass and OutputFormatClass are independent of ...READ MORE

Jul 9 in Big Data Hadoop by Jimmy
 • 26 views
0 votes
1 answer

Regarding unstructured data handling in hadoop

There are multiple ways to import unstructured ...READ MORE

Jul 9 in Big Data Hadoop by Jishan
 • 31 views
0 votes
1 answer

Merging Files using PIG

In order to merge two or more ...READ MORE

Jul 9 in Big Data Hadoop by Tina
 • 25 views
0 votes
1 answer

Sending hdfs file to a non hadoop cluster

There are different ways to do this. ...READ MORE

Jul 9 in Big Data Hadoop by Tarun
 • 26 views
0 votes
1 answer

Amazon AWS Web Services

If you want to limit your hadoop ...READ MORE

Jul 8 in Big Data Hadoop by ravikiran
 • 4,560 points • 31 views
0 votes
1 answer

Install Hadoop On Ubuntu

I guess it should be at /hadoop/hadoop-common-project/hadoop-common/sr ...READ MORE

Jul 8 in Big Data Hadoop by ravikiran
 • 4,560 points • 24 views
0 votes
1 answer

How to install RHadoop packages (RMR, RHDFS, RHBase)?

With dev tools you can install directly ...READ MORE

Jul 5 in Big Data Hadoop by ravikiran
 • 4,560 points • 117 views
0 votes
1 answer

How to resolve corrupted blocks in Hadoop?

You can use hdfs fsck / to ...READ MORE

Jul 5 in Big Data Hadoop by Nandini
 • 92 views
0 votes
1 answer

Merging Files using PIG

In order to merge two or more ...READ MORE

Jul 4 in Big Data Hadoop by Tina
 • 116 views
0 votes
1 answer

Unable to instantiate hive metastore

To resolve this issue, follow the steps ...READ MORE

Jul 5 in Big Data Hadoop by Ritu
 • 43 views
0 votes
1 answer

Getting error while using sqoop import.

You are trying to execute the sqoop ...READ MORE

Jul 5 in Big Data Hadoop by Reshma
 • 51 views
0 votes
1 answer

Creating testjob in sqoop for incremental load

Yes, it is possible to do so. ...READ MORE

Jul 5 in Big Data Hadoop by Umar
 • 30 views
0 votes
1 answer

How to install Hadoop on Ubuntu?

You can manually create a file hadoop-env.sh ...READ MORE

Jul 5 in Big Data Hadoop by ravikiran
 • 4,560 points • 39 views
0 votes
1 answer

How to set rep to particular user in hdfs?

HDFS does not allocate capacity separately based ...READ MORE

Jul 5 in Big Data Hadoop by Leena
 • 25 views
0 votes
1 answer

How does decreasing the block size make more space on Datanode?

When there is space in data nodes ...READ MORE

Jul 5 in Big Data Hadoop by Krish
 • 30 views
0 votes
1 answer

Explain to me how to transfer data between Azure tables and Hadoop on Azure

I shall redirect you to a link ...READ MORE

Jul 4 in Big Data Hadoop by ravikiran
 • 4,560 points • 42 views
0 votes
1 answer

failed to start the Namenode format in hadoop generation 2

Hi, You can check this out: 1. Delete all ...READ MORE

Jul 2 in Big Data Hadoop by Ria
edited Jul 2 by Gitika • 118 views
0 votes
1 answer

Relationship between Hadoop and Database

HDFS is a software framework designed for ...READ MORE

Jul 4 in Big Data Hadoop by ravikiran
 • 4,560 points • 26 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.