Most viewed questions in Big Data Hadoop

0 votes
1 answer

Setting up Hadoop Multi-node cluster on windows 10 systems

Hi@Hassan, You can do it windows system as ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,440 points
1,686 views
0 votes
1 answer

Impala: Add months to current time

You can add the months using the add_months method ...READ MORE

Jun 6, 2019 in Big Data Hadoop by John
1,686 views
0 votes
1 answer

Bucketing in Hive

By default, only 1 bucket will be ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,230 points
1,678 views
0 votes
1 answer

How to configure Yarn from command line?

It's a bit non-intuitive, but it turns ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,678 views
0 votes
1 answer

Submitting MapReduce job using jobConf object vs job object

Both JobConf & Job objects are used ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,675 views
0 votes
1 answer

Hadoop vs Data Lake

A data lake is a storage repository that holds ...READ MORE

Mar 26, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,675 views
0 votes
1 answer

Hive JDBC driver URL format and driver class.

For Hive server 1, the URL format ...READ MORE

May 31, 2019 in Big Data Hadoop by Adi
1,673 views
0 votes
1 answer

I have installed Hadoop on Ubuntu but name node is not running.

If you are using Hadoop version-2.7.7, then ...READ MORE

Apr 30, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,670 views
0 votes
1 answer

How data distribution is done in Hadoop?

To understand how or what are the process ...READ MORE

Apr 4, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,670 views
0 votes
1 answer

Sqoop overwrite a directory

You can use the --hive-overwrite: $ sqoop import --connect ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,230 points
1,667 views
0 votes
1 answer

Hadoop: No Such Method Exception

Mapper and reducer classes need to be ...READ MORE

Oct 26, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,664 views
0 votes
1 answer

Hive: Display logs on console

You can emit the logs on the ...READ MORE

May 21, 2019 in Big Data Hadoop by Jishnu
1,661 views
0 votes
1 answer

How should I connect Hadoop in C#?

The Uri should be your Cluster Name, ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Neha
• 6,300 points
1,661 views
–1 vote
1 answer

Hadoop error: can not start-all.sh

Try adding <property> <name>dfs.name.dir</name> <value>/path/to/hdfs/dir</value> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,230 points
1,660 views
0 votes
1 answer

Disabling Kerberos authentication in Hadoop

Make the following changes: core-site.xml(Hadoop_Dir/etc/hadoop): ...READ MORE

May 16, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,659 views
+1 vote
1 answer

When I try to execute any Hadoop commands error pops up saying unable to find or load main class M

The error might be due to the ...READ MORE

Jul 17, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,656 views
0 votes
1 answer

What do we exactly mean by “Hadoop” – the definition of Hadoop?

The official definition of Apache Hadoop given ...READ MORE

Mar 16, 2018 in Big Data Hadoop by Shubham
1,654 views
0 votes
1 answer

Job and Task Scheduling In Hadoop

I  n case of fair scheduler, when there is ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Neha
• 6,300 points
1,653 views
0 votes
1 answer

out of Memory Error in Hadoop

See if you can share the screenshot ...READ MORE

May 22, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,652 views
0 votes
1 answer
0 votes
1 answer

Killing oozie Jobs by userid

Suppose you want to kill the jobs ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Esha
1,643 views
0 votes
1 answer

which of the following are hadoop built in counters?

MapReduce in Hadoop maintains some built-in counters ...READ MORE

Dec 20, 2021 in Big Data Hadoop by Kavya
• 700 points
1,642 views
0 votes
1 answer

Why we are configuring mapred.job.tracker in YARN?

I really dont know the reason behind ...READ MORE

Mar 29, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,642 views
0 votes
1 answer

ERROR org.apache.hadoop.hbase.regionserver.HRegionServer: ZooKeeper session expired

Hi@akhtar, To avoid this error you have to ...READ MORE

Mar 31, 2020 in Big Data Hadoop by MD
• 95,440 points
1,638 views
0 votes
1 answer

How to set the number of Map & Reduce tasks?

The map tasks created for a job ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,638 views
0 votes
1 answer

IDE for writing and running hadoop jobs?

You can use the Eclipse IDE. It's ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
1,636 views
0 votes
1 answer

error: Access denied for user 'sample'@'localhost'.

This kind of error occurs when we ...READ MORE

Apr 15, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,632 views
0 votes
1 answer

Hadoop: ERROR datanode.DataNode: All directories in dfs.data.dir are invalid.

Hi, Try this, first delete all contents from ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,630 views
0 votes
1 answer

How to discover missing or corrupt HDFS data?

HDFS supports fsck command to check for ...READ MORE

Sep 19, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,619 views
0 votes
1 answer

Python read file as stream from HDFS

I could redirect to a Python library ...READ MORE

May 30, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,609 views
0 votes
1 answer

How do we authenticate user from http.signature.secret file?

hadoop.http.authentication.signature.secret.file: The signature secret file for signing ...READ MORE

Apr 24, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,607 views
0 votes
3 answers

How to specify KeyValueTextInputFormat Separator in Hadoop-.20 api?

conf.set("key.value.separator.in.input.line", ","); Job job = new ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Rio
1,606 views
0 votes
1 answer

Which one is better MR or Spark?

The above difference clearly points out that ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Daniel
1,602 views
0 votes
1 answer

Importing a portion of Relational Database to HDFS

Yes, there is a tool called Sqoop ...READ MORE

Jul 20, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,595 views
0 votes
1 answer

Will hadoop(sqoop) load oracle faster than SQL loader?

down vote Had a similar task of exporting ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,592 views
0 votes
1 answer

How to add a column in Hive table?

Hi@akhtar, You can use the alter table command ...READ MORE

Oct 19, 2020 in Big Data Hadoop by MD
• 95,440 points
1,591 views
0 votes
1 answer

What is Streaming data and Hadoop?

The hack you describe is more or ...READ MORE

Nov 2, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,591 views
0 votes
1 answer

How to Create a table with region replication in Hbase?

Hi, Region replication is a per-table property. All ...READ MORE

Jun 1, 2019 in Big Data Hadoop by Gitika
• 65,910 points
1,590 views
0 votes
1 answer

Error while connecting to Hive using Java JDBC

Use ​org.apache.hive.jdbc.HiveDriver as your driver ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,590 views
0 votes
1 answer

Hadoop: What is the difference between `hadoop dfs` and `hadoop fs`?

You can find the definition here: $HADOOP_HOME/bin/hadoop ... elif [ ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,589 views
0 votes
1 answer

What is Modeling data in Hadoop and how to do it?

I suggest spending some time with Apache ...READ MORE

Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,589 views
0 votes
1 answer

How to import selected columns in Sqoop?

If you want to import selected columns, ...READ MORE

May 15, 2019 in Big Data Hadoop by Shirish
1,588 views
0 votes
1 answer

Secondary Sorting in Hadoop MapReduce

Grouping Comparator Once the data reaches a reducer, ...READ MORE

Sep 5, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,579 views
0 votes
1 answer

How will you choose various file formats for storing and processing data using Apache Hadoop ?

The decision to choose a particular file ...READ MORE

Sep 27, 2018 in Big Data Hadoop by zombie
• 3,790 points
1,578 views
–1 vote
1 answer

IDE Eclipse: Failed to locate the winutils binary in the hadoop binary path

Try this: First, click on file import appliance. Now ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,572 views
0 votes
1 answer

Explain to me the relationship between Hadoop and Databases.

Okay, that's a lot of queries together, ...READ MORE

May 15, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,571 views
0 votes
1 answer

How to Install Cloudera Manager into my Virtual Machine ?

Before you start anything, First make sure ...READ MORE

Aug 9, 2018 in Big Data Hadoop by Neha
• 6,300 points
1,569 views
0 votes
1 answer

Not able to start/stop hadoop daemons

If you were able to start the ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,568 views
0 votes
1 answer

Different ports in a Hadoop cluster environment?

Below image will help you in understanding ...READ MORE

Apr 6, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,565 views