Most viewed questions in Big Data Hadoop

0 votes
1 answer

Hadoop security GroupMappingServiceProvider exception for Spark job via Dataproc API

One of the reason behin you getting ...READ MORE

Mar 23, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
749 views
0 votes
1 answer

What is the use of Apache Kafka in a Big Data Cluster?

Kafka is a Distributed Messaging System which ...READ MORE

Jun 21, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
748 views
0 votes
1 answer

Analyse log files in pig?

Hey, Log files are created by an application which ...READ MORE

May 7, 2019 in Big Data Hadoop by Gitika
• 65,910 points
748 views
0 votes
1 answer

Sqoop vs Oracle Hadoop Connectors

Most of the connectors would have the ...READ MORE

May 18, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
747 views
+1 vote
2 answers

Hadoop Administration

Make the following changes to your configuration ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Simran
746 views
0 votes
1 answer

To locate the HBase data cell which three co-ordinate is used ?

Hey,  HBase uses the coordinates to locate a ...READ MORE

May 29, 2019 in Big Data Hadoop by Gitika
• 65,910 points
745 views
+3 votes
1 answer

Getting Connection Error while loading data into table using cloudera hive

Hey Nafeesa, Itseems that Hive is not able ...READ MORE

Oct 4, 2018 in Big Data Hadoop by Vardhan
• 13,190 points
745 views
0 votes
1 answer

How does Hadoop process data which is split across multiple boundaries in an HDFS?

I found some comments: from the Hadoop ...READ MORE

Jul 1, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
744 views
0 votes
1 answer

How does the HDFS architecture provide redundancy?

Hadoop provides redundancy by storing multiple replicas ...READ MORE

Sep 19, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
742 views
0 votes
1 answer

Creating testjob in sqoop for incremental load

Yes, it is possible to do so. ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Umar
741 views
0 votes
1 answer

High Availability Yarn configuration in Hue

Here's the default configuration suggested by the ...READ MORE

May 30, 2019 in Big Data Hadoop by Rajan
739 views
0 votes
1 answer

HBase configuration in Hue

Hue allows you to point to the ...READ MORE

May 27, 2019 in Big Data Hadoop by Reshma
738 views
0 votes
1 answer

Is there any alternative for edureka vm ?

you can use Hortonworks ! READ MORE

Nov 9, 2020 in Big Data Hadoop by Reza
737 views
0 votes
1 answer

Sqoop Job not working

I have made a little change to ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Vishwa
736 views
0 votes
1 answer

Where are Hadoop's task log files stored?

For each MapReduce job, Hadoop stores the ...READ MORE

Sep 18, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
736 views
0 votes
1 answer

What is the Data format and database choices in Hadoop and Spark?

Use Parquet. I'm not sure about CSV ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Frankie
• 9,830 points
735 views
0 votes
1 answer

How to configure the Hadoop cluster with proxyuser for the Oozie process?

Hey, The following two properties are required in ...READ MORE

Jun 10, 2019 in Big Data Hadoop by Gitika
• 65,910 points
734 views
0 votes
1 answer

Which java class handles the Input record encoding into files which store the tables in Hive?

Hey, This particular format will handle the input ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,910 points
733 views
–1 vote
1 answer

Facing the below error while installing mysql in VM

We would like to say that the ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,230 points
732 views
0 votes
1 answer

Setting Pig examples on Hue

Hi. Any property of Pig can be ...READ MORE

May 27, 2019 in Big Data Hadoop by Esha
729 views
0 votes
1 answer

How to set Secret Key for Hue?

You have to set the secret key ...READ MORE

May 24, 2019 in Big Data Hadoop by Yogi
729 views
0 votes
1 answer

How to set LDAP authentication for HiveServer2 for unmanaged clusters?

To enable LDAP authentication for HiveServer2 unmanaged ...READ MORE

Jun 3, 2019 in Big Data Hadoop by Sanman
727 views
0 votes
1 answer

How to create one job in Sqoop?

Hi@akhtar, You can create one job for future ...READ MORE

Apr 29, 2020 in Big Data Hadoop by MD
• 95,440 points
726 views
0 votes
1 answer

How to see a running workflow, coordinate or bundle of job in Oozie?

Hey, You can use this example to see, $ ...READ MORE

Jun 18, 2019 in Big Data Hadoop by Gitika
• 65,910 points
725 views
0 votes
1 answer

What is group_name_filter property in Hue file?

The group_name_attr is used to set the username in the ...READ MORE

May 28, 2019 in Big Data Hadoop by Vasu
725 views
0 votes
1 answer

How to override Mapred home directory using sqoop?

Sqoop provides an option to override the ...READ MORE

May 17, 2019 in Big Data Hadoop by Rajini
725 views
0 votes
1 answer

Is Hadoop a good open-source project to join?

Yes, Hadoop has a whole ecosystem of ...READ MORE

Sep 27, 2018 in Big Data Hadoop by Frankie
• 9,830 points
725 views
0 votes
1 answer

Custom setting of MapReduce tasks in HIVE

When we set number of mappers to ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Ferry
724 views
0 votes
1 answer

What is the difference between Hadoop API and Streaming?

Usually we have Map/Reduce pair written in ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Neha
• 6,300 points
722 views
0 votes
1 answer

How to set Zookeeper server for Accumulo in sqoop?

Hi. To mention the Zookeeper server in ...READ MORE

May 17, 2019 in Big Data Hadoop by Kumar
721 views
0 votes
1 answer

Increasing HFile block size

If you increase the block size then ...READ MORE

Aug 6, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
721 views
0 votes
1 answer

How is Delete command is different with remove command with znode in zookeeper?

Hey, Delete (delete /path) command is similar to remove command, except the ...READ MORE

May 28, 2019 in Big Data Hadoop by Gitika
• 65,910 points
720 views
0 votes
1 answer

Datanode not running and not able start

Please type the below command in the ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,230 points
720 views
0 votes
1 answer

MapReduce: Map Value Mismatch error

Seems like you have not specified few ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Haman
719 views
0 votes
1 answer

Where does Hive store files in HDFS?

Hi@akhtar, It depends on what you set in ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,440 points
718 views
0 votes
1 answer

Hadoop: Java code to get Hive table properties.

You can try this: org.apache.hadoop.hive.metastore.api.Table table=..........; org.apache.hadoop.hive.metastore.api.StorageDescriptor sd=table.getSd(); String loc=sd.getLocation(); String ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,230 points
717 views
0 votes
1 answer

Hive query: Join tables based on ID

After creating the tables a1 and b1 ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Tarun
716 views
0 votes
1 answer

How are HDFS and HBase different from each other?

Apache Hadoop project includes four key modules Hadoop ...READ MORE

Jun 25, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
716 views
0 votes
1 answer

Unable to instantiate hive metastore

To resolve this issue, follow the steps ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Ritu
714 views
0 votes
1 answer

Differences between Cassandra and Hadoop, Real-time Processing v/s Batch Processing

Hadoop is basically designed including HDFS loaded with ...READ MORE

Jun 18, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
713 views
0 votes
1 answer

How does decreasing the block size make more space on Datanode?

When there is space in data nodes ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Krish
712 views
0 votes
1 answer

Can't access hadoop job logs

The error which you are getting can ...READ MORE

Jan 28, 2019 in Big Data Hadoop by Omkar
• 69,230 points
712 views
0 votes
0 answers

hadoop namenode ~format

When i type  hadoop namenode ~format WARNING: Use ...READ MORE

Nov 10, 2021 in Big Data Hadoop by anonymous
• 140 points
711 views
0 votes
1 answer

Does map/reduce merge output files after reduce phase?

Hey there, instead of doing the file ...READ MORE

Sep 25, 2018 in Big Data Hadoop by digger
• 26,740 points
710 views
0 votes
1 answer

Hadoop Documentation for Eclipse.

Few considerations to be taken are here: If ...READ MORE

Sep 11, 2018 in Big Data Hadoop by Frankie
• 9,830 points
710 views
0 votes
1 answer

Why Max is throwing in below query in hive for alias?

Hi, You can do one thing, just enclose ...READ MORE

May 17, 2019 in Big Data Hadoop by reshma
709 views
0 votes
1 answer

touchz: java.io.IOException: java.lang.IllegalArgumentException: Unexpected value for the block size

Hi@akhtar, You are trying to create a block ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,440 points
708 views
0 votes
1 answer

How to use scala Map size() method?

The size() is utilized to find the number of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,910 points
707 views
0 votes
1 answer

Which Windows client is used for Cloudera Hadoop Cluster?

You can very well use VM linux ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Frankie
• 9,830 points
705 views