Recent questions tagged bigdata

0 votes
1 answer

How Namenode handles data node failures?

Jul 11, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 8,044 views
0 votes
1 answer

Not able to fetch messages from Kafka cluster

Jul 10, 2018 in Apache Kafka by coldcode
 • 2,090 points • 4,200 views
0 votes
1 answer

Re-balancing error while reading messages from Kafka.

Jul 10, 2018 in Apache Kafka by coldcode
 • 2,090 points • 4,144 views
0 votes
1 answer

Hive Precedence Order

Jul 9, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,777 views
0 votes
1 answer

Are there any Limitations of Pig?

Jul 6, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 2,768 views
+1 vote
2 answers

How can I convert Spark Dataframe to Spark RDD?

Jul 4, 2018 in Apache Spark by code799
 • 22,549 views
0 votes
1 answer

Difference between Spark ML & Spark MLlib package

Jul 4, 2018 in Apache Spark by code799
 • 3,498 views
0 votes
3 answers

Sorting rows in descending order in Spark SQL

Jul 4, 2018 in Apache Spark by code799
 • 18,285 views
0 votes
1 answer

Spark streaming with Kafka dependency error

Jul 4, 2018 in Apache Spark by code799
 • 2,217 views
+11 votes
52 answers

What could be the heights of smart homes in the future?

Jul 3, 2018 in Career Counselling by bug_seeker
 • 15,520 points • 17,607 views
0 votes
1 answer

Checkpointing in Hadoop

Jul 3, 2018 in Big Data Hadoop by shams
 • 3,670 points • 2,280 views
0 votes
1 answer

Hadoop Nodes for Multiple Disks

Jul 3, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 2,990 views
0 votes
1 answer

How to analyze block placement on datanodes and rebalancing data across Hadoop nodes?

Jun 21, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,943 views
0 votes
2 answers

What is the difference between the Smart Data Access of SAP HANA and SAP HANA Vora?

Jun 21, 2018 in Big Data Hadoop by shelly
 • 120 points • 2,604 views
0 votes
1 answer

Is there any way to setup Hadoop nodes (data nodes/namenodes) to use multiple volumes/disks?

Jun 20, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,998 views
0 votes
3 answers

Lineage Graph in Spark

Jun 19, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 14,147 views
0 votes
1 answer

Minimizing Data Transfers in Spark

Jun 19, 2018 in Apache Spark by shams
 • 3,670 points • 2,765 views
0 votes
1 answer

NameNode Status Check

Jun 18, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 3,201 views
0 votes
1 answer

What is Speculative Execution?

Jun 18, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,414 views
0 votes
1 answer

Is it mandatory to start Hadoop to run spark application?

Jun 14, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 1,745 views
0 votes
1 answer

Different Hadoop Modes

Jun 13, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 14,295 views
0 votes
1 answer

HDFS usage for small files

Jun 12, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,462 views
0 votes
1 answer

NameNode & DataNode memory

Jun 12, 2018 in Big Data Hadoop by shams
 • 3,670 points • 2,381 views
0 votes
1 answer

NAS and HDFS Comparison

Jun 11, 2018 in Big Data Hadoop by shams
 • 3,670 points • 2,542 views
0 votes
1 answer

Replication and Calculations

Jun 11, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,581 views
0 votes
1 answer

Persistence Levels in Spark

Jun 8, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 7,226 views
0 votes
1 answer

What is Shark?

Jun 8, 2018 in Apache Spark by shams
 • 3,670 points • 1,988 views
0 votes
1 answer

How to find the number of elements present in the array in a Spark DataFame column?

Jun 6, 2018 in Apache Spark by code799
 • 24,031 views
0 votes
3 answers

Filtering a row in Spark DataFrame based on matching values from a list

Jun 6, 2018 in Apache Spark by code799
 • 95,141 views
0 votes
1 answer

Convert the given Spar rdd object to Spark DataFrame.

Jun 6, 2018 in Apache Spark by code799
 • 2,107 views
0 votes
1 answer

JobTracker Task Scheduling

Jun 5, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,707 views
+5 votes
2 answers

Hive to HDFS transfer

Jun 5, 2018 in Big Data Hadoop by shams
 • 3,670 points • 5,190 views
0 votes
1 answer

Different Spark Ecosystem

Jun 4, 2018 in Apache Spark by shams
 • 3,670 points • 2,035 views
0 votes
1 answer

InputSplit vs HDFS Block

Jun 1, 2018 in Big Data Hadoop by shams
 • 3,670 points • 5,575 views
0 votes
1 answer

Hadoop mandatory for Spark?

Jun 1, 2018 in Apache Spark by shams
 • 3,670 points • 1,471 views
0 votes
1 answer

How to import the dependencies of Spark MLlib into eclipse project?

May 31, 2018 in Apache Spark by hack236
 • 3,140 views
0 votes
1 answer

Spark Machine Learning pipeline works fine in Spark 1.6, but it gives error when executed on Spark 2.x?

May 31, 2018 in Apache Spark by hack236
 • 1,934 views
0 votes
1 answer

Akka in Spark

May 31, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 2,962 views
0 votes
1 answer

Sqoop vs distCP

May 30, 2018 in Big Data Hadoop by shams
 • 3,670 points • 2,189 views
0 votes
2 answers

What is Shuffle Phase?

May 30, 2018 in Big Data Hadoop by shams
 • 3,670 points • 3,109 views
+1 vote
1 answer

How can I write a text file in HDFS not from an RDD, in Spark program?

May 29, 2018 in Apache Spark by code799
 • 10,170 views
0 votes
5 answers

How to change the spark Session configuration in Pyspark?

May 29, 2018 in Apache Spark by code799
 • 132,103 views
0 votes
1 answer

What are the parameters in local[a,b,c] explains?

May 29, 2018 in Apache Spark by code799
 • 1,588 views
0 votes
1 answer

How to save and retrieve the Spark RDD from HDFS?

May 29, 2018 in Apache Spark by code799
 • 15,399 views
0 votes
1 answer

NameNode without any data

May 29, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 2,221 views
0 votes
1 answer

Is it possible to run Spark and Mesos along with Hadoop?

May 29, 2018 in Apache Spark by shams
 • 3,670 points • 1,873 views
0 votes
1 answer

What is Sliding Window?

May 28, 2018 in Apache Spark by shams
 • 3,670 points • 3,437 views
0 votes
1 answer

Spark 2.3? What is new in it?

May 28, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 1,697 views
0 votes
1 answer

How can I compare the elements of the RDD using MapReduce?

May 24, 2018 in Apache Spark by code799
 • 4,447 views
0 votes
3 answers

How to transpose Spark DataFrame?

May 24, 2018 in Apache Spark by anonymous
 • 22,054 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.