Trending questions in Big Data Hadoop

0 votes
1 answer

Explain to me to download a Hadoop documentation of a particular version.

I'll drop a link here which will ...READ MORE

May 7, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
363 views
0 votes
1 answer

Why should we use "distinct" keyword in pig script?

Hey, The "distinct" statement is very simple. It ...READ MORE

May 3, 2019 in Big Data Hadoop by Gitika
• 65,910 points
530 views
0 votes
1 answer

How to save Spark dataframe as dynamic partitioned table in Hive?

Hey, you can try something like this: df.write.partitionBy('year', ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,210 points
8,208 views
0 votes
1 answer

SQOOP Export command failing

First create a table, which should have ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,512 views
0 votes
1 answer

What are the relational operators available related to loading and storing in pig language?

Hey, For loading data and storing it into ...READ MORE

May 3, 2019 in Big Data Hadoop by Gitika
• 65,910 points
498 views
0 votes
0 answers

How run wordcount on multi node hadoop using eclipse?

Apr 24, 2019 in Big Data Hadoop by حسين
• 200 points

recategorized Apr 24, 2019 by Omkar 888 views
+1 vote
1 answer

what are the typicall block sizes in HDFS

HDFS is a block structured file system ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,484 views
0 votes
1 answer

How to insert data inside the database in Linux?

First you need to create a table ...READ MORE

Apr 16, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,186 views
0 votes
1 answer

Default file format in Hive

By Default its TextFileFormat for hive unless you use serdes to ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,538 views
0 votes
1 answer

Explain to me the method to transfer data between Azure tables and Hadoop on Azure

this article on HiveStorageHandler will let you create ...READ MORE

May 3, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
407 views
0 votes
1 answer

How data distribution is done in Hadoop?

To understand how or what are the process ...READ MORE

Apr 4, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,638 views
0 votes
1 answer

What is the difference in DistCP command and Sqoop command in Hadoop?

Both the distCP (Distributed copy in Hadoop) ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,256 views
0 votes
1 answer

Method to schedule the number of Mappers and Reducers in a Hadoop MapReduce Tsk.

The number of Mapper tasks for a ...READ MORE

Apr 25, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
624 views
0 votes
1 answer

Why do we need the FOR EACH operation in Pig Scripts?

The operation FOREACH in Apache Pig is ...READ MORE

Apr 30, 2019 in Big Data Hadoop by Gitika
• 65,910 points
386 views
0 votes
1 answer

How to handle exceptions in Spark and Scala?

There is no particular format to handle ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
4,653 views
0 votes
1 answer

How to read multiple files in hdfs?

If you want to read files with ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,910 views
0 votes
1 answer

Where does HDFS stores data on the local file system?

First find the Hadoop directory present in ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,490 points
15,757 views
+1 vote
1 answer

Need help Installing Sqoop on Windows.

Download Sqoop from this link: http://www.apache.org/dyn/closer.lua/sqoop/1.4.7 This link is ...READ MORE

Feb 25, 2019 in Big Data Hadoop by Chandu
3,041 views
0 votes
1 answer

How to decide number of mappers?

The number of mapper depends on the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,210 points
4,180 views
0 votes
1 answer

Can I use Amazon Web Services for free?

If you would like to use AWS ...READ MORE

Apr 25, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
516 views
0 votes
0 answers

Nutch with hadoop 2.7 error "GC overhead limit exceeded"

I have a small cluster of 5 ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Hafiz
• 170 points
1,202 views
0 votes
1 answer

Why we need to install "ant -Dhadoopversion=23" ? What is the use of this?

Hi, We install ant to build pig, If the ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Gitika
• 65,910 points
462 views
0 votes
1 answer

Connect to Hive using Pyhive

Here's how we can connect to Hive ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,105 views
0 votes
1 answer

Difference between hive.exec.compress.output=true; and mapreduce.output.fileoutputformat.compress=true;

Hey there! The definition of these two properties ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,556 views
0 votes
1 answer

Why do we need Hadoop framework?

The function of Distributes File System is ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Apr 12, 2019 by Gitika 1,147 views
–1 vote
1 answer

unable to start hive server

It seems that your hive server is ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,350 views
0 votes
1 answer

Edge nodes in Hadoop

Namenodes and Datanodes are a part of ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Siri
3,255 views
0 votes
1 answer

Deleting directory in Sqoop

You can use the --delete-target-dir : $ sqoop import ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,547 views
0 votes
1 answer

Copy files to all Hadoop DFS directories

Hi @Bhavish. There is no Hadoop command ...READ MORE

Feb 24, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,028 views
0 votes
1 answer

Elastisearch Hadoop

I will redirect you to a repository ...READ MORE

Apr 24, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
440 views
–1 vote
1 answer

Apache Spark - Nested JSON array to flatten columns

It depends on the structure of your ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,315 views
0 votes
1 answer

Command to establish connection between MySql with linux?

This is the command you can use ...READ MORE

Apr 15, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Apr 18, 2019 by Gitika 784 views
0 votes
1 answer

Hadoop Java: org.apache.hadoop.conf.Configuration does not exist error

To solve this error, add hadoop-common to ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
7,024 views
0 votes
1 answer

Installing Oozie on Linux System

Download Oozie from this link: http://www.apache.org/dyn/closer.lua/oozie/ Extract the files. ...READ MORE

Feb 28, 2019 in Big Data Hadoop by Rajan
2,725 views
0 votes
1 answer

How to install Hadoop on Windows system?

First you need to download Hadoop files. ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,210 points
2,991 views
0 votes
1 answer

How Sqoop import command works internally?

First when client execute Sqoop import commands through ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
• 65,910 points
840 views
0 votes
1 answer

I am install hadoop on signal node and run program but delay time if have dataset size 3.3 GB take time about 2 hours

Hey @Faris! Try increasing the number of reducers. ...READ MORE

Apr 12, 2019 in Big Data Hadoop by Omkar
• 69,210 points
778 views
0 votes
1 answer

Why sqoop internally generates MapRed code?

By default Sqoop always create 4 Map ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
• 65,910 points
822 views
0 votes
1 answer

Writing File into HDFS using spark scala

The reason you are not able to ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
16,792 views
0 votes
1 answer

How to create table inside database in MySql in Linux?

We can use this command to create ...READ MORE

Apr 16, 2019 in Big Data Hadoop by Gitika
• 65,910 points
580 views
0 votes
1 answer

What can you do with sqoop in Hadoop ecosystem?

Scoop came into scenario because there were tools ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Apr 8, 2019 by Gitika 874 views
0 votes
1 answer

How to create database in Mysql?

The command you can use is: create table ...READ MORE

Apr 15, 2019 in Big Data Hadoop by Gitika
• 65,910 points
525 views
0 votes
1 answer

File formats in Hadoop?

File format is just a way to ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Apr 12, 2019 by Gitika 790 views
0 votes
1 answer

What are the different hdfs dfs commands to perform copy operation?

The different hdfs dfs commands to perform ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Gitika
• 65,910 points
775 views
0 votes
1 answer

What command is used to install MySql in centos?

You can use this command to install ...READ MORE

Apr 12, 2019 in Big Data Hadoop by Gitika
• 65,910 points
645 views
–1 vote
1 answer

"main" java.lang.ClassNotFoundException: WordCount

When you are running a jar file ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
4,173 views
0 votes
0 answers

What are Hadoop daemons? What are their live examples?

First of all why Hadoop daemon are ...READ MORE

Apr 4, 2019 in Big Data Hadoop by rashmi
1,021 views