Trending questions in Big Data Hadoop

0 votes
1 answer

Explain to me to download a Hadoop documentation of a particular version.

I'll drop a link here which will ...READ MORE

May 7, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
364 views
0 votes
1 answer

Why should we use "distinct" keyword in pig script?

Hey, The "distinct" statement is very simple. It ...READ MORE

May 3, 2019 in Big Data Hadoop by Gitika
• 65,910 points
534 views
0 votes
1 answer

How to save Spark dataframe as dynamic partitioned table in Hive?

Hey, you can try something like this: df.write.partitionBy('year', ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,210 points
8,213 views
0 votes
1 answer

SQOOP Export command failing

First create a table, which should have ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,520 views
0 votes
1 answer

What are the relational operators available related to loading and storing in pig language?

Hey, For loading data and storing it into ...READ MORE

May 3, 2019 in Big Data Hadoop by Gitika
• 65,910 points
504 views
+1 vote
1 answer

what are the typicall block sizes in HDFS

HDFS is a block structured file system ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,489 views
0 votes
0 answers

How run wordcount on multi node hadoop using eclipse?

Apr 24, 2019 in Big Data Hadoop by حسين
• 200 points

recategorized Apr 24, 2019 by Omkar 892 views
0 votes
1 answer

How to insert data inside the database in Linux?

First you need to create a table ...READ MORE

Apr 16, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,190 views
0 votes
1 answer

Default file format in Hive

By Default its TextFileFormat for hive unless you use serdes to ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,547 views
0 votes
1 answer

Explain to me the method to transfer data between Azure tables and Hadoop on Azure

this article on HiveStorageHandler will let you create ...READ MORE

May 3, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
412 views
0 votes
1 answer

How data distribution is done in Hadoop?

To understand how or what are the process ...READ MORE

Apr 4, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,651 views
0 votes
1 answer

What is the difference in DistCP command and Sqoop command in Hadoop?

Both the distCP (Distributed copy in Hadoop) ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,259 views
0 votes
1 answer

Method to schedule the number of Mappers and Reducers in a Hadoop MapReduce Tsk.

The number of Mapper tasks for a ...READ MORE

Apr 25, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
628 views
0 votes
1 answer

Why do we need the FOR EACH operation in Pig Scripts?

The operation FOREACH in Apache Pig is ...READ MORE

Apr 30, 2019 in Big Data Hadoop by Gitika
• 65,910 points
391 views
0 votes
1 answer

How to handle exceptions in Spark and Scala?

There is no particular format to handle ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
4,659 views
0 votes
1 answer

How to read multiple files in hdfs?

If you want to read files with ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,914 views
0 votes
1 answer

Where does HDFS stores data on the local file system?

First find the Hadoop directory present in ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,490 points
15,785 views
+1 vote
1 answer

Need help Installing Sqoop on Windows.

Download Sqoop from this link: http://www.apache.org/dyn/closer.lua/sqoop/1.4.7 This link is ...READ MORE

Feb 25, 2019 in Big Data Hadoop by Chandu
3,052 views
0 votes
1 answer

How to decide number of mappers?

The number of mapper depends on the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,210 points
4,193 views
0 votes
0 answers

Nutch with hadoop 2.7 error "GC overhead limit exceeded"

I have a small cluster of 5 ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Hafiz
• 170 points
1,220 views
0 votes
1 answer

Can I use Amazon Web Services for free?

If you would like to use AWS ...READ MORE

Apr 25, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
524 views
0 votes
1 answer

Why we need to install "ant -Dhadoopversion=23" ? What is the use of this?

Hi, We install ant to build pig, If the ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Gitika
• 65,910 points
466 views
0 votes
1 answer

Connect to Hive using Pyhive

Here's how we can connect to Hive ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,115 views
0 votes
1 answer

Difference between hive.exec.compress.output=true; and mapreduce.output.fileoutputformat.compress=true;

Hey there! The definition of these two properties ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Omkar
• 69,210 points
5,563 views
0 votes
1 answer

Why do we need Hadoop framework?

The function of Distributes File System is ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Apr 12, 2019 by Gitika 1,152 views
–1 vote
1 answer

unable to start hive server

It seems that your hive server is ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,359 views
0 votes
1 answer

Edge nodes in Hadoop

Namenodes and Datanodes are a part of ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Siri
3,264 views
0 votes
1 answer

Copy files to all Hadoop DFS directories

Hi @Bhavish. There is no Hadoop command ...READ MORE

Feb 24, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,040 views
0 votes
1 answer

Deleting directory in Sqoop

You can use the --delete-target-dir : $ sqoop import ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,555 views
–1 vote
1 answer

Apache Spark - Nested JSON array to flatten columns

It depends on the structure of your ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,210 points
5,320 views
0 votes
1 answer

Elastisearch Hadoop

I will redirect you to a repository ...READ MORE

Apr 24, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
440 views
0 votes
1 answer

Command to establish connection between MySql with linux?

This is the command you can use ...READ MORE

Apr 15, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Apr 18, 2019 by Gitika 789 views
0 votes
1 answer

Hadoop Java: org.apache.hadoop.conf.Configuration does not exist error

To solve this error, add hadoop-common to ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
7,040 views
0 votes
1 answer

Installing Oozie on Linux System

Download Oozie from this link: http://www.apache.org/dyn/closer.lua/oozie/ Extract the files. ...READ MORE

Feb 28, 2019 in Big Data Hadoop by Rajan
2,731 views
0 votes
1 answer

How to install Hadoop on Windows system?

First you need to download Hadoop files. ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,210 points
3,000 views
0 votes
1 answer

How Sqoop import command works internally?

First when client execute Sqoop import commands through ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
• 65,910 points
842 views
0 votes
1 answer

Why sqoop internally generates MapRed code?

By default Sqoop always create 4 Map ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
• 65,910 points
833 views
0 votes
1 answer

I am install hadoop on signal node and run program but delay time if have dataset size 3.3 GB take time about 2 hours

Hey @Faris! Try increasing the number of reducers. ...READ MORE

Apr 12, 2019 in Big Data Hadoop by Omkar
• 69,210 points
786 views
0 votes
1 answer

Writing File into HDFS using spark scala

The reason you are not able to ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
16,810 views
0 votes
1 answer

How to create table inside database in MySql in Linux?

We can use this command to create ...READ MORE

Apr 16, 2019 in Big Data Hadoop by Gitika
• 65,910 points
588 views
0 votes
1 answer

What can you do with sqoop in Hadoop ecosystem?

Scoop came into scenario because there were tools ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Apr 8, 2019 by Gitika 882 views
0 votes
1 answer

How to create database in Mysql?

The command you can use is: create table ...READ MORE

Apr 15, 2019 in Big Data Hadoop by Gitika
• 65,910 points
530 views
0 votes
1 answer

File formats in Hadoop?

File format is just a way to ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
• 65,910 points

edited Apr 12, 2019 by Gitika 793 views
0 votes
1 answer

What are the different hdfs dfs commands to perform copy operation?

The different hdfs dfs commands to perform ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Gitika
• 65,910 points
778 views
0 votes
1 answer

What command is used to install MySql in centos?

You can use this command to install ...READ MORE

Apr 12, 2019 in Big Data Hadoop by Gitika
• 65,910 points
650 views
–1 vote
1 answer

"main" java.lang.ClassNotFoundException: WordCount

When you are running a jar file ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,210 points
4,181 views
0 votes
0 answers

What are Hadoop daemons? What are their live examples?

First of all why Hadoop daemon are ...READ MORE

Apr 4, 2019 in Big Data Hadoop by rashmi
1,029 views