Trending questions in Big Data Hadoop

0 votes
1 answer

Index LZO files

You can do it using the following ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Rishi
 • 616 views
0 votes
1 answer

Map-reduce code for finding average salary

You can choose your mapper output key ...READ MORE

May 22, 2019 in Big Data Hadoop by Yogi
 • 3,335 views
0 votes
1 answer

Pig script not dumping the data correctly

The first column is denoted by $0, ...READ MORE

Jul 15, 2019 in Big Data Hadoop by George
 • 996 views
0 votes
1 answer

HDFS: Upload file from local file system to Edureka cloud lab

Step 1: Go to My Lab and ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Zora
 • 1,153 views
0 votes
1 answer

Hadoop security GroupMappingServiceProvider exception for Spark job via Dataproc API

If you don't want to turn off ...READ MORE

Jul 2, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,548 views
0 votes
1 answer

Does HQL query go to all the nodes to process data?

InputSplits are created by logical division of ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Tina
 • 500 views
0 votes
1 answer

Merging Files using PIG

In order to merge two or more ...READ MORE

Jul 4, 2019 in Big Data Hadoop by Tina
 • 1,419 views
0 votes
1 answer

Output Splitting problem in Hadoop

When you are loading two different files, ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Sayni
 • 888 views
0 votes
1 answer

Primary keys in apache Spark

from pyspark.sql.functions import monotonically_increasing_id df.withColumn("id", monotonically_increasing_id()).show() Verify the second ...READ MORE

Jul 11, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,093 views
0 votes
1 answer

Syntax to mention that the data is enclosed in double quotes in pig

So, we will execute the below command, new_A_2 ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Esha
 • 1,126 views
0 votes
1 answer

Hive Query: Split value

You can use the SUBSTR() in hive ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Paul
 • 468 views
0 votes
0 answers

Sqoop exclude tables

How to exclude tables in sqoop if ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Will
 • 492 views
0 votes
1 answer

What are the services running in Hadoop

Below are the services Running in Hadoop Hdfs  yarn mapreduce ozzie zookeeper hive hue hbase impala flume sqoop spark Depending ...READ MORE

Jun 24, 2019 in Big Data Hadoop by deepak
 • 1,830 views
0 votes
1 answer

Query regarding temporary File type conversion of parquet to text

Suppose I have the below parquet file ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Janan
 • 1,124 views
0 votes
1 answer

CSV integration with Hadoop

For integrating Hadoop with CSV, we can use ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Krish
 • 807 views
0 votes
1 answer

How many partitions can do for one table?

Well, there are two kinds of partitions: 1. ...READ MORE

Jul 22, 2019 in Big Data Hadoop by Kunal
 • 535 views
0 votes
1 answer

How can we ignore header line while loading data into Pig?

You can use the following code: A = ...READ MORE

Jul 22, 2019 in Big Data Hadoop by kiran
 • 524 views
0 votes
1 answer

Classes implementing InputFormat frequently

FileInputFormat : Base class for all file-based InputFormats Other ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Reshma
 • 418 views
0 votes
1 answer

Hadoop input folder not found?

Hey, This is because the user directory not ...READ MORE

Jun 14, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 2,177 views
0 votes
1 answer

How to execute combiner and partitioning program without adding package name?

Yes, it is possible to do so ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Raman
 • 761 views
0 votes
1 answer

Query regarding ArrayBuffer

It's because that is the syntax. This ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Rishi
 • 326 views
0 votes
1 answer

Can we use different input and output format classes?

Yes, InputFormatClass and OutputFormatClass are independent of ...READ MORE

Jul 22, 2019 in Big Data Hadoop by Jishan
 • 476 views
0 votes
1 answer

Delimiter on the data

You can use this: import org.apache.spark.sql.functions.struct val df = ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Vinay
 • 350 views
0 votes
1 answer

Limit for Namenode Quantity

Each file Schema = 150bytes   Block schema ...READ MORE

Jul 25, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 349 views
0 votes
1 answer

Getting error while using sqoop import.

You are trying to execute the sqoop ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Reshma
 • 1,211 views
0 votes
1 answer

Hive: "SET LOCATION" command not changing the location of the database

The SET LOCATION command does not change ...READ MORE

May 20, 2019 in Big Data Hadoop by Yash
 • 3,189 views
0 votes
1 answer

Produce compressed data from map reduce

 It is straight forward and you can achieve ...READ MORE

Jul 24, 2019 in Big Data Hadoop by John
 • 371 views
0 votes
1 answer

Error: schemaTool failed

Hey, The error you got because you might ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 3,471 views
0 votes
1 answer

How to use Hbase shell in a bash script?

Hello, To write scripts with HBase shell it includes non-interactive mode, ...READ MORE

May 29, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 2,778 views
+1 vote
1 answer

Sqoop: How to load all tables except one?

You can use the import-all-tables option and along with ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Omkar
 • 69,230 points • 7,040 views
0 votes
1 answer

Difference between root of hdfs and local machine

The command hdfs dfs -put command is used to ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Mahi
 • 1,815 views
0 votes
2 answers

What is the difference between Oozie and Nifi ?

The main difference between Oozie and Nifi ...READ MORE

May 7, 2019 in Big Data Hadoop by Omkar
 • 69,230 points • 3,633 views
0 votes
1 answer

Pdf to csv file format conversions

You can convert the pdf files with ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Esha
 • 948 views
0 votes
1 answer

How to merge two consecutive regions using command line in HBase?

Hey, The Master and RegionServer both participate in ...READ MORE

May 29, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 2,707 views
0 votes
0 answers

pattern mapreduce

i need to write some mapreduce pattern ...READ MORE

Jul 23, 2019 in Big Data Hadoop by tiza
 • 374 views
0 votes
1 answer

How to solve error caused due to output types of mapper and reducer not matching?

job.setOutputValueClass will set the types expected as ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Rishab
 • 921 views
0 votes
1 answer

Explain to me the correct way to get a Hadoop FileSystem object so that I can use it for reading from HDFS as well as writing to HDFS.

FileSystem needs only one configuration key to successfully ...READ MORE

Jun 7, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 2,302 views
0 votes
1 answer

Mutliple Output Format in Hadoop

Each reducer uses an OutputFormat to write ...READ MORE

Jul 19, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 445 views
0 votes
1 answer

Hive queries from mapreduce gives Null Pointer Exception.

I think you have upgraded CDH. This ...READ MORE

Jun 4, 2019 in Big Data Hadoop by Rihan
 • 2,382 views
0 votes
1 answer

How to load data from flat files into different partitions of Hive table?

Hi, You can load data from flat files ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,394 views
0 votes
1 answer

Mention what are the main configuration parameters that user need to specify to run MapReduce Job?

Hi, The user of the MapReduce framework needs ...READ MORE

Jun 10, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 2,085 views
0 votes
1 answer

Does NameNode provide with the IP address of data nodes where replication of data is to be stored?

No, the data node does not select ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Kim
 • 1,647 views
0 votes
1 answer

How to increase reducers in Hive?

By default, only one reducer is assigned ...READ MORE

May 21, 2019 in Big Data Hadoop by Lohit
 • 2,966 views
0 votes
1 answer

Hive Query to sort data

If you are trying to sort first ...READ MORE

Jul 14, 2019 in Big Data Hadoop by Tina
 • 620 views
0 votes
1 answer

what is the difference between CREATE TABLE and CREATE EXTERNAL TABLE in Hive?

Hey, Although, we can create two types of ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,366 views
0 votes
1 answer

How to Import the complete directory into HDFS?

First, need to create a directory in Hadoop: $ ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Hiran
 • 545 views
0 votes
1 answer

How does Hive job execution flow works?

Hey, Hive query is received from UI or ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 3,260 views
0 votes
2 answers

Error While Running Oozie Project

You need to add your current user ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Dhimanshu
 • 553 views
0 votes
1 answer

RDMBS integration with Hadoop

About integrating RDBMS with Hadoop, you can ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Nanda
 • 488 views
0 votes
1 answer

Hadoop Hive: How to split string in Hive?

You can use the split function along ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,230 points • 11,333 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.