Trending questions in Big Data Hadoop

0 votes
1 answer

Load data into teradata using sqoop

The general syntax to do this as ...READ MORE

Jul 15 in Big Data Hadoop by Ritu
49 views
0 votes
1 answer

Which one is better MR or Spark?

The above difference clearly points out that ...READ MORE

Jul 15 in Big Data Hadoop by Daniel
33 views
0 votes
1 answer

Pig script not dumping the data correctly

The first column is denoted by $0, ...READ MORE

Jul 15 in Big Data Hadoop by George
17 views
0 votes
2 answers

Error While Running Oozie Project

You need to add your current user ...READ MORE

Aug 6 in Big Data Hadoop by Dhimanshu
35 views
0 votes
1 answer

How to Import the complete directory into HDFS?

First, need to create a directory in Hadoop: $ ...READ MORE

Jul 15 in Big Data Hadoop by Hiran
14 views
0 votes
1 answer

Hive Query to sort data

If you are trying to sort first ...READ MORE

Jul 14 in Big Data Hadoop by Tina
23 views
0 votes
1 answer

Creating a hive script and execute in the edureka cloudlab.

Please remove -f option from hive arguments and use hql extension ...READ MORE

Jul 14 in Big Data Hadoop by Karan
21 views
0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 11 in Big Data Hadoop by Yogi
102 views
0 votes
1 answer

Primary keys in apache Spark

from pyspark.sql.functions import monotonically_increasing_id df.withColumn("id", monotonically_increasing_id()).show() Verify the second ...READ MORE

Jul 11 in Big Data Hadoop by ravikiran
• 4,560 points
81 views
0 votes
1 answer

Unable to Locate WinUtils Library in Hadoop binary path.

If you are facing this problem while running a ...READ MORE

Jul 11 in Big Data Hadoop by ravikiran
• 4,560 points
61 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

The reason for this error is that ...READ MORE

Jul 11 in Big Data Hadoop by Srujan
53 views
0 votes
1 answer

HDFS: Upload file from local file system to Edureka cloud lab

Step 1: Go to My Lab and ...READ MORE

Jul 11 in Big Data Hadoop by Zora
52 views
0 votes
1 answer

Why do we use job.waitForCompletion(true)?

The main reason for job.waitForCompletion exists is ...READ MORE

Jul 9 in Big Data Hadoop by Josh
119 views
0 votes
1 answer

Command to copy file from desktop to hdfs

You can use either of the below ...READ MORE

Jul 11 in Big Data Hadoop by Firoz
33 views
0 votes
1 answer

How can we ignore header line while loading data into Pig?

Suppose you need to load this in ...READ MORE

Jul 10 in Big Data Hadoop by Kiran
63 views
0 votes
1 answer

How to import data to hbase database?

There are 3 Ways to Load Data ...READ MORE

Jul 10 in Big Data Hadoop by Karan Reddy
44 views
0 votes
1 answer

Hive complex data types

There are three complex types in hive, arrays: ...READ MORE

Jul 5 in Big Data Hadoop by Gani
263 views
0 votes
1 answer
0 votes
10 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Aditya
14,712 views
0 votes
1 answer

Use of Group ALL in Pig

Suppose we have a data set as ...READ MORE

Jul 10 in Big Data Hadoop by Roshan
36 views
0 votes
1 answer

Pig: Does these jar files run in NodeManager to produce result?

Below is what happens with the map-reduce ...READ MORE

Jul 10 in Big Data Hadoop by Lucy
27 views
0 votes
1 answer

Is data sent to some other location to be processed in pig?

With pig, we are not taking data ...READ MORE

Jul 10 in Big Data Hadoop by Adi
23 views
0 votes
1 answer

Syntax to mention that the data is enclosed in double quotes in pig

So, we will execute the below command, new_A_2 ...READ MORE

Jul 10 in Big Data Hadoop by Esha
21 views
0 votes
1 answer

When and when not to use PigStore?

The Pig storage is not used only ...READ MORE

Jul 10 in Big Data Hadoop by Rushil
16 views
0 votes
1 answer

Query regarding temporary File type conversion of parquet to text

Suppose I have the below parquet file ...READ MORE

Jul 9 in Big Data Hadoop by Janan
42 views
0 votes
1 answer

Exporting of ORC file to RDBMS using SQOOP

We have to use Sqoop-HCatalog Integration here. ...READ MORE

Jul 9 in Big Data Hadoop by Rishi
45 views
0 votes
1 answer

Sqoop import error with sqoop job

Please try the below command: sqoop job -create ...READ MORE

Jul 9 in Big Data Hadoop by Rina
41 views
0 votes
1 answer

Pdf to csv file format conversions

You can convert the pdf files with ...READ MORE

Jul 9 in Big Data Hadoop by Esha
36 views
+1 vote
0 answers

Hadoop Installation error [closed]

Pls help on below error..on MAC OS WARN ...READ MORE

Jul 9 in Big Data Hadoop by Anshuman
• 130 points

closed Jul 10 by Omkar 25 views
0 votes
1 answer

Integration of hbase

For HBase Pig integration, you can refer to ...READ MORE

Jul 9 in Big Data Hadoop by Kiran
29 views
0 votes
1 answer

How to solve error caused due to output types of mapper and reducer not matching?

job.setOutputValueClass will set the types expected as ...READ MORE

Jul 9 in Big Data Hadoop by Rishab
28 views
0 votes
1 answer

What is the use of setting the name of the job in mapreduce?

Job job = new Job(conf,"job_name") is just used ...READ MORE

Jul 9 in Big Data Hadoop by Umesh
27 views
0 votes
1 answer

Can we use different i/p and o/p format classes in mapreduce code?

Yes, InputFormatClass and OutputFormatClass are independent of ...READ MORE

Jul 9 in Big Data Hadoop by Jimmy
26 views
0 votes
1 answer

Regarding unstructured data handling in hadoop

There are multiple ways to import unstructured ...READ MORE

Jul 9 in Big Data Hadoop by Jishan
31 views
0 votes
1 answer

Merging Files using PIG

In order to merge two or more ...READ MORE

Jul 9 in Big Data Hadoop by Tina
25 views
0 votes
1 answer

Sending hdfs file to a non hadoop cluster

There are different ways to do this. ...READ MORE

Jul 9 in Big Data Hadoop by Tarun
26 views
0 votes
1 answer

Amazon AWS Web Services

If you want to limit your hadoop ...READ MORE

Jul 8 in Big Data Hadoop by ravikiran
• 4,560 points
31 views
0 votes
1 answer

Install Hadoop On Ubuntu

I guess it should be at /hadoop/hadoop-common-project/hadoop-common/sr ...READ MORE

Jul 8 in Big Data Hadoop by ravikiran
• 4,560 points
24 views
0 votes
1 answer

How to install RHadoop packages (RMR, RHDFS, RHBase)?

With dev tools you can install directly ...READ MORE

Jul 5 in Big Data Hadoop by ravikiran
• 4,560 points
117 views
0 votes
1 answer

How to resolve corrupted blocks in Hadoop?

You can use hdfs fsck / to ...READ MORE

Jul 5 in Big Data Hadoop by Nandini
92 views
0 votes
1 answer

Merging Files using PIG

In order to merge two or more ...READ MORE

Jul 4 in Big Data Hadoop by Tina
116 views
0 votes
1 answer

Unable to instantiate hive metastore

To resolve this issue, follow the steps ...READ MORE

Jul 5 in Big Data Hadoop by Ritu
43 views
0 votes
1 answer

Getting error while using sqoop import.

You are trying to execute the sqoop ...READ MORE

Jul 5 in Big Data Hadoop by Reshma
51 views
0 votes
1 answer

Creating testjob in sqoop for incremental load

Yes, it is possible to do so. ...READ MORE

Jul 5 in Big Data Hadoop by Umar
30 views
0 votes
1 answer

How to install Hadoop on Ubuntu?

You can manually create a file hadoop-env.sh ...READ MORE

Jul 5 in Big Data Hadoop by ravikiran
• 4,560 points
39 views
0 votes
1 answer

How to set rep to particular user in hdfs?

HDFS does not allocate capacity separately based ...READ MORE

Jul 5 in Big Data Hadoop by Leena
25 views
0 votes
1 answer

How does decreasing the block size make more space on Datanode?

When there is space in data nodes ...READ MORE

Jul 5 in Big Data Hadoop by Krish
30 views
0 votes
1 answer

Explain to me how to transfer data between Azure tables and Hadoop on Azure

I shall redirect you to a link ...READ MORE

Jul 4 in Big Data Hadoop by ravikiran
• 4,560 points
42 views
0 votes
1 answer

failed to start the Namenode format in hadoop generation 2

Hi, You can check this out: 1. Delete all ...READ MORE

Jul 2 in Big Data Hadoop by Ria

edited Jul 2 by Gitika 118 views
0 votes
1 answer

Relationship between Hadoop and Database

HDFS is a software framework designed for ...READ MORE

Jul 4 in Big Data Hadoop by ravikiran
• 4,560 points
26 views