Most viewed questions in Big Data Hadoop

0 votes
2 answers

Is there a .NET equivalent to Apache Hadoop?

Hadoop is a Java-based platform. So, to ...READ MORE

Jul 16, 2020 in Big Data Hadoop by Suhana
• 340 points
2,210 views
0 votes
2 answers

Download & Install Cloudera parcels without being connected to internet?

You can find the details over here ...READ MORE

Aug 16, 2018 in Big Data Hadoop by Priyaj
• 58,020 points
2,207 views
0 votes
1 answer

Multiple Output format in Hadoop

Each reducer uses an OutputFormat to write ...READ MORE

Jul 26, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,206 views
0 votes
1 answer

How to install Hadoop in Ubuntu?

Hey. Follow these steps to install hadoop. First ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,202 views
0 votes
1 answer

How to merge two Spark DataFrames?

Hi@akhtar, You can perform join operation in spark. ...READ MORE

Sep 17, 2020 in Big Data Hadoop by MD
• 95,460 points
2,199 views
+1 vote
1 answer

2 datanodes is slower ,how to get those details .what is your approach as hadoop admin

First, enable the detection of slow nodes. ...READ MORE

Sep 23, 2019 in Big Data Hadoop by Riya
2,190 views
0 votes
1 answer

What is Streaming data and Hadoop?

The hack you describe is more or ...READ MORE

Nov 2, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,189 views
0 votes
1 answer

How to configure Yarn from command line?

It's a bit non-intuitive, but it turns ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,185 views
+1 vote
2 answers

How to authenticate username & password while using Connector for Cloudera Hadoop in Tableau?

Hadoop server installed was kerberos enabled server. ...READ MORE

Aug 21, 2018 in Big Data Hadoop by Priyaj
• 58,020 points
2,185 views
0 votes
1 answer

Setting up Hadoop Multi-node cluster on windows 10 systems

Hi@Hassan, You can do it windows system as ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,460 points
2,183 views
+1 vote
1 answer

Explain to me the difference between Name node and Secondary name node

First of all, let understand what is ...READ MORE

May 15, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,183 views
0 votes
1 answer

Submitting MapReduce job using jobConf object vs job object

Both JobConf & Job objects are used ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,182 views
0 votes
2 answers

if HDFS threshold has been reached. What is the our approach to resolve this issue?

This was a fundamental issue in HDFS ...READ MORE

Jun 24, 2019 in Big Data Hadoop by Gitika
• 65,730 points
2,181 views
0 votes
1 answer

Are there any Limitations of Pig?

Limitations of the Apache Pig are: As the ...READ MORE

Jul 6, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
2,179 views
0 votes
1 answer

Will hadoop(sqoop) load oracle faster than SQL loader?

down vote Had a similar task of exporting ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,176 views
0 votes
1 answer

Difference between ensemble and quorum in zookeeper?

Hey, When you want to have high availability ...READ MORE

May 25, 2019 in Big Data Hadoop by Gitika
• 65,730 points
2,174 views
0 votes
1 answer

How to send curl downloaded data in hdfs?

Try using put command with stdin as ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,168 views
0 votes
1 answer

How to Create a table with region replication in Hbase?

Hi, Region replication is a per-table property. All ...READ MORE

Jun 1, 2019 in Big Data Hadoop by Gitika
• 65,730 points
2,165 views
0 votes
2 answers

How do I integrate Kdb+ and hadoop?

 kdb+ could be installed on every Hadoop ...READ MORE

Aug 6, 2018 in Big Data Hadoop by Abhi
• 3,720 points
2,164 views
0 votes
1 answer

Hive: Configure Hue as a proxy user

On your node, go to the hadoop ...READ MORE

May 24, 2019 in Big Data Hadoop by Esha
2,163 views
0 votes
1 answer

Python read file as stream from HDFS

I could redirect to a Python library ...READ MORE

May 30, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,162 views
0 votes
1 answer

How to set a custom install directory for a deb package with fpm

Here's something that you can try... the last ...READ MORE

Mar 26, 2018 in Big Data Hadoop by Amrinder
• 140 points
2,159 views
0 votes
1 answer

What is pig storage and why it is used?

Hello, In pig, there is a default load ...READ MORE

May 8, 2019 in Big Data Hadoop by Gitika
• 65,730 points

edited May 8, 2019 by Gitika 2,158 views
0 votes
1 answer

Permission denied while uploading files to hdfs

It is not the problem about permission ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,155 views
0 votes
1 answer

Error while connecting to Hive using Java JDBC

Use ​org.apache.hive.jdbc.HiveDriver as your driver ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,154 views
0 votes
2 answers

Error:- cannot locate pig-core-hr. jar. do ‘ant -Dhadoopversion=23 jar’

Even I got the same error, I ...READ MORE

Apr 26, 2019 in Big Data Hadoop by disha

edited Apr 29, 2019 by Gitika 2,152 views
0 votes
1 answer

What is Memstore in Hbase?

Hey, In HBase the the store contains memory ...READ MORE

May 21, 2019 in Big Data Hadoop by Gitika
• 65,730 points
2,150 views
0 votes
1 answer

How to discover missing or corrupt HDFS data?

HDFS supports fsck command to check for ...READ MORE

Sep 19, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,149 views
0 votes
1 answer

Hadoop: What is the difference between `hadoop dfs` and `hadoop fs`?

You can find the definition here: $HADOOP_HOME/bin/hadoop ... elif [ ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,147 views
0 votes
1 answer

FAILEDError: java.io.IOException: Type mismatch in key from map

This error is thrown when the parameters ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Rishi
2,145 views
0 votes
1 answer

out of Memory Error in Hadoop

See if you can share the screenshot ...READ MORE

May 22, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,142 views
0 votes
1 answer

What is Modeling data in Hadoop and how to do it?

I suggest spending some time with Apache ...READ MORE

Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,139 views
0 votes
1 answer

Can we integrate Hadoop with Python?

Use Hadoop streaming for using python,php etc ...READ MORE

Aug 23, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,137 views
0 votes
1 answer

How to use Sqoop in Java Program?

You can run sqoop from inside your ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Neha
• 6,300 points
2,133 views
0 votes
1 answer

Which one is better MR or Spark?

The above difference clearly points out that ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Daniel
2,132 views
0 votes
1 answer

How to display the Access Control Lists (ACLs) of files and directories in HDFS?

Hi@akhtar, You can see the Access Control Lists (ACLs) ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,460 points
2,127 views
0 votes
1 answer

Bucketing in Hive

By default, only 1 bucket will be ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,123 views
0 votes
1 answer

Hadoop security GroupMappingServiceProvider exception for Spark job via Dataproc API

If you don't want to turn off ...READ MORE

Jul 2, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,115 views
0 votes
1 answer

How to create smaller table from big table in HIVE?

You could probably best use Hive's built-in sampling ...READ MORE

Sep 24, 2018 in Big Data Hadoop by digger
• 26,740 points
2,113 views
0 votes
1 answer

How to upload file to HDFS in Ubuntu

you can use  hadoop fs -copyFromLocal  "/home/ritwi ...READ MORE

Apr 19, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
2,113 views
0 votes
1 answer

Cant access the Hadoop Namenode from browser

As mentioned in the error, the nodes ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,109 views
0 votes
1 answer

Secondary Sorting in Hadoop MapReduce

Grouping Comparator Once the data reaches a reducer, ...READ MORE

Sep 5, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,104 views
0 votes
1 answer

How do I parse pdf file using MapReduce?

If you have your own custom InputFormat(WholeFileInputFormat). ...READ MORE

Apr 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,104 views
+1 vote
1 answer

what are the typicall block sizes in HDFS

HDFS is a block structured file system ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
• 65,730 points
2,100 views
0 votes
1 answer

Job and Task Scheduling In Hadoop

I  n case of fair scheduler, when there is ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Neha
• 6,300 points
2,095 views
0 votes
1 answer

Heartbeat time interval for Datanode

The heartbeat interval is 3 seconds by ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Rajat
2,091 views
0 votes
1 answer

Point data from Hive to Hbase

Refer to the below steps to transfer ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,090 views