Recent questions tagged bigdata

0 votes
1 answer

How Namenode handles data node failures?

Jul 11, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 6,279 views
0 votes
1 answer

Not able to fetch messages from Kafka cluster

Jul 10, 2018 in Apache Kafka by coldcode
 • 2,090 points • 3,005 views
0 votes
1 answer

Re-balancing error while reading messages from Kafka.

Jul 10, 2018 in Apache Kafka by coldcode
 • 2,090 points • 2,878 views
0 votes
1 answer

Hive Precedence Order

Jul 9, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 931 views
0 votes
1 answer

Are there any Limitations of Pig?

Jul 6, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,701 views
+1 vote
2 answers

How can I convert Spark Dataframe to Spark RDD?

Jul 4, 2018 in Apache Spark by code799
 • 20,547 views
0 votes
1 answer

Difference between Spark ML & Spark MLlib package

Jul 4, 2018 in Apache Spark by code799
 • 2,077 views
0 votes
3 answers

Sorting rows in descending order in Spark SQL

Jul 4, 2018 in Apache Spark by code799
 • 16,647 views
0 votes
1 answer

Spark streaming with Kafka dependency error

Jul 4, 2018 in Apache Spark by code799
 • 1,297 views
+11 votes
52 answers

What could be the heights of smart homes in the future?

Jul 3, 2018 in Career Counselling by bug_seeker
 • 15,520 points • 6,013 views
0 votes
1 answer

Checkpointing in Hadoop

Jul 3, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,267 views
0 votes
1 answer

Hadoop Nodes for Multiple Disks

Jul 3, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,926 views
0 votes
1 answer

How to analyze block placement on datanodes and rebalancing data across Hadoop nodes?

Jun 21, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 965 views
0 votes
2 answers

What is the difference between the Smart Data Access of SAP HANA and SAP HANA Vora?

Jun 21, 2018 in Big Data Hadoop by shelly
 • 120 points • 1,289 views
0 votes
1 answer

Is there any way to setup Hadoop nodes (data nodes/namenodes) to use multiple volumes/disks?

Jun 20, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 935 views
0 votes
3 answers

Lineage Graph in Spark

Jun 19, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 11,669 views
0 votes
1 answer

Minimizing Data Transfers in Spark

Jun 19, 2018 in Apache Spark by shams
 • 3,670 points • 1,352 views
0 votes
1 answer

NameNode Status Check

Jun 18, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 2,296 views
0 votes
1 answer

What is Speculative Execution?

Jun 18, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 508 views
0 votes
1 answer

Is it mandatory to start Hadoop to run spark application?

Jun 14, 2018 in Apache Spark by kurt_cobain
 • 9,390 points • 817 views
0 votes
1 answer

Different Hadoop Modes

Jun 13, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 13,032 views
0 votes
1 answer

HDFS usage for small files

Jun 12, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 521 views
0 votes
1 answer

NameNode & DataNode memory

Jun 12, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,356 views
0 votes
1 answer

NAS and HDFS Comparison

Jun 11, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,596 views
0 votes
1 answer

Replication and Calculations

Jun 11, 2018 in Big Data Hadoop by shams
 • 3,670 points • 786 views
0 votes
1 answer

Persistence Levels in Spark

Jun 8, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 5,976 views
0 votes
1 answer

What is Shark?

Jun 8, 2018 in Apache Spark by shams
 • 3,670 points • 945 views
0 votes
1 answer

How to find the number of elements present in the array in a Spark DataFame column?

Jun 6, 2018 in Apache Spark by code799
 • 22,336 views
0 votes
3 answers

Filtering a row in Spark DataFrame based on matching values from a list

Jun 6, 2018 in Apache Spark by code799
 • 92,645 views
0 votes
1 answer

Convert the given Spar rdd object to Spark DataFrame.

Jun 6, 2018 in Apache Spark by code799
 • 1,077 views
0 votes
1 answer

JobTracker Task Scheduling

Jun 5, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 880 views
+5 votes
2 answers

Hive to HDFS transfer

Jun 5, 2018 in Big Data Hadoop by shams
 • 3,670 points • 3,937 views
0 votes
1 answer

Different Spark Ecosystem

Jun 4, 2018 in Apache Spark by shams
 • 3,670 points • 839 views
0 votes
1 answer

InputSplit vs HDFS Block

Jun 1, 2018 in Big Data Hadoop by shams
 • 3,670 points • 4,377 views
0 votes
1 answer

Hadoop mandatory for Spark?

Jun 1, 2018 in Apache Spark by shams
 • 3,670 points • 559 views
0 votes
1 answer

How to import the dependencies of Spark MLlib into eclipse project?

May 31, 2018 in Apache Spark by hack236
 • 1,979 views
0 votes
1 answer

Spark Machine Learning pipeline works fine in Spark 1.6, but it gives error when executed on Spark 2.x?

May 31, 2018 in Apache Spark by hack236
 • 960 views
0 votes
1 answer

Akka in Spark

May 31, 2018 in Apache Spark by kurt_cobain
 • 9,390 points • 2,084 views
0 votes
1 answer

Sqoop vs distCP

May 30, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,304 views
0 votes
2 answers

What is Shuffle Phase?

May 30, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,569 views
+1 vote
1 answer

How can I write a text file in HDFS not from an RDD, in Spark program?

May 29, 2018 in Apache Spark by code799
 • 8,400 views
0 votes
5 answers

How to change the spark Session configuration in Pyspark?

May 29, 2018 in Apache Spark by code799
 • 125,317 views
0 votes
1 answer

What are the parameters in local[a,b,c] explains?

May 29, 2018 in Apache Spark by code799
 • 658 views
0 votes
1 answer

How to save and retrieve the Spark RDD from HDFS?

May 29, 2018 in Apache Spark by code799
 • 13,479 views
0 votes
1 answer

NameNode without any data

May 29, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,273 views
0 votes
1 answer

Is it possible to run Spark and Mesos along with Hadoop?

May 29, 2018 in Apache Spark by shams
 • 3,670 points • 785 views
0 votes
1 answer

What is Sliding Window?

May 28, 2018 in Apache Spark by shams
 • 3,670 points • 2,529 views
0 votes
1 answer

Spark 2.3? What is new in it?

May 28, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 775 views
0 votes
1 answer

How can I compare the elements of the RDD using MapReduce?

May 24, 2018 in Apache Spark by code799
 • 3,409 views
0 votes
3 answers

How to transpose Spark DataFrame?

May 24, 2018 in Apache Spark by anonymous
 • 19,812 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.