Recent questions tagged bigdata

0 votes
1 answer

How Namenode handles data node failures?

Jul 11, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 8,194 views
0 votes
1 answer

Not able to fetch messages from Kafka cluster

Jul 10, 2018 in Apache Kafka by coldcode
 • 2,090 points • 4,331 views
0 votes
1 answer

Re-balancing error while reading messages from Kafka.

Jul 10, 2018 in Apache Kafka by coldcode
 • 2,090 points • 4,275 views
0 votes
1 answer

Hive Precedence Order

Jul 9, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,877 views
0 votes
1 answer

Are there any Limitations of Pig?

Jul 6, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 2,883 views
+1 vote
2 answers

How can I convert Spark Dataframe to Spark RDD?

Jul 4, 2018 in Apache Spark by code799
 • 22,775 views
0 votes
1 answer

Difference between Spark ML & Spark MLlib package

Jul 4, 2018 in Apache Spark by code799
 • 3,626 views
0 votes
3 answers

Sorting rows in descending order in Spark SQL

Jul 4, 2018 in Apache Spark by code799
 • 18,570 views
0 votes
1 answer

Spark streaming with Kafka dependency error

Jul 4, 2018 in Apache Spark by code799
 • 2,334 views
+11 votes
52 answers

What could be the heights of smart homes in the future?

Jul 3, 2018 in Career Counselling by bug_seeker
 • 15,520 points • 18,863 views
0 votes
1 answer

Checkpointing in Hadoop

Jul 3, 2018 in Big Data Hadoop by shams
 • 3,670 points • 2,382 views
0 votes
1 answer

Hadoop Nodes for Multiple Disks

Jul 3, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 3,095 views
0 votes
1 answer

How to analyze block placement on datanodes and rebalancing data across Hadoop nodes?

Jun 21, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 2,067 views
0 votes
2 answers

What is the difference between the Smart Data Access of SAP HANA and SAP HANA Vora?

Jun 21, 2018 in Big Data Hadoop by shelly
 • 120 points • 2,730 views
0 votes
1 answer

Is there any way to setup Hadoop nodes (data nodes/namenodes) to use multiple volumes/disks?

Jun 20, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 2,139 views
0 votes
3 answers

Lineage Graph in Spark

Jun 19, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 14,362 views
0 votes
1 answer

Minimizing Data Transfers in Spark

Jun 19, 2018 in Apache Spark by shams
 • 3,670 points • 2,902 views
0 votes
1 answer

NameNode Status Check

Jun 18, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 3,305 views
0 votes
1 answer

What is Speculative Execution?

Jun 18, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,514 views
0 votes
1 answer

Is it mandatory to start Hadoop to run spark application?

Jun 14, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 1,869 views
0 votes
1 answer

Different Hadoop Modes

Jun 13, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 14,439 views
0 votes
1 answer

HDFS usage for small files

Jun 12, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,585 views
0 votes
1 answer

NameNode & DataNode memory

Jun 12, 2018 in Big Data Hadoop by shams
 • 3,670 points • 2,483 views
0 votes
1 answer

NAS and HDFS Comparison

Jun 11, 2018 in Big Data Hadoop by shams
 • 3,670 points • 2,667 views
0 votes
1 answer

Replication and Calculations

Jun 11, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,689 views
0 votes
1 answer

Persistence Levels in Spark

Jun 8, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 7,364 views
0 votes
1 answer

What is Shark?

Jun 8, 2018 in Apache Spark by shams
 • 3,670 points • 2,089 views
0 votes
1 answer

How to find the number of elements present in the array in a Spark DataFame column?

Jun 6, 2018 in Apache Spark by code799
 • 24,257 views
0 votes
3 answers

Filtering a row in Spark DataFrame based on matching values from a list

Jun 6, 2018 in Apache Spark by code799
 • 95,444 views
0 votes
1 answer

Convert the given Spar rdd object to Spark DataFrame.

Jun 6, 2018 in Apache Spark by code799
 • 2,213 views
0 votes
1 answer

JobTracker Task Scheduling

Jun 5, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,813 views
+5 votes
2 answers

Hive to HDFS transfer

Jun 5, 2018 in Big Data Hadoop by shams
 • 3,670 points • 5,348 views
0 votes
1 answer

Different Spark Ecosystem

Jun 4, 2018 in Apache Spark by shams
 • 3,670 points • 2,162 views
0 votes
1 answer

InputSplit vs HDFS Block

Jun 1, 2018 in Big Data Hadoop by shams
 • 3,670 points • 5,693 views
0 votes
1 answer

Hadoop mandatory for Spark?

Jun 1, 2018 in Apache Spark by shams
 • 3,670 points • 1,578 views
0 votes
1 answer

How to import the dependencies of Spark MLlib into eclipse project?

May 31, 2018 in Apache Spark by hack236
 • 3,275 views
0 votes
1 answer

Spark Machine Learning pipeline works fine in Spark 1.6, but it gives error when executed on Spark 2.x?

May 31, 2018 in Apache Spark by hack236
 • 2,058 views
0 votes
1 answer

Akka in Spark

May 31, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 3,079 views
0 votes
1 answer

Sqoop vs distCP

May 30, 2018 in Big Data Hadoop by shams
 • 3,670 points • 2,295 views
0 votes
2 answers

What is Shuffle Phase?

May 30, 2018 in Big Data Hadoop by shams
 • 3,670 points • 3,278 views
+1 vote
1 answer

How can I write a text file in HDFS not from an RDD, in Spark program?

May 29, 2018 in Apache Spark by code799
 • 10,426 views
0 votes
5 answers

How to change the spark Session configuration in Pyspark?

May 29, 2018 in Apache Spark by code799
 • 132,721 views
0 votes
1 answer

What are the parameters in local[a,b,c] explains?

May 29, 2018 in Apache Spark by code799
 • 1,697 views
0 votes
1 answer

How to save and retrieve the Spark RDD from HDFS?

May 29, 2018 in Apache Spark by code799
 • 15,595 views
0 votes
1 answer

NameNode without any data

May 29, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 2,326 views
0 votes
1 answer

Is it possible to run Spark and Mesos along with Hadoop?

May 29, 2018 in Apache Spark by shams
 • 3,670 points • 1,979 views
0 votes
1 answer

What is Sliding Window?

May 28, 2018 in Apache Spark by shams
 • 3,670 points • 3,580 views
0 votes
1 answer

Spark 2.3? What is new in it?

May 28, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 1,803 views
0 votes
1 answer

How can I compare the elements of the RDD using MapReduce?

May 24, 2018 in Apache Spark by code799
 • 4,571 views
0 votes
3 answers

How to transpose Spark DataFrame?

May 24, 2018 in Apache Spark by anonymous
 • 22,339 views
Page:

Most popular tags