Recent questions tagged rdd

+1 vote
0 answers

How to create a list of RDDs(or RDD of RDDs, if possible) from a single JavaRDD<List<Integers>> in Java?

Jan 11, 2020 in Apache Spark by itsroops
 • 130 points • 3,993 views
+1 vote
1 answer

How to extract record from one RDD using another RDD

Aug 23, 2019 in Apache Spark by anonymous
 • 3,410 views
0 votes
1 answer

Join in RDD using keys

Aug 2, 2019 in Apache Spark by Jishan
 • 9,284 views
0 votes
1 answer

Removing the header of a text file in SparkRDD

Jul 31, 2019 in Apache Spark by Jishan
 • 7,304 views
0 votes
1 answer

Why do we use sc.parallelize?

Jul 11, 2019 in Apache Spark by Sumit
 • 14,569 views
0 votes
1 answer

What is RDD in Apache spark?

Jul 1, 2019 in Apache Spark by Lila
 • 2,459 views
0 votes
1 answer

Spark Error: java.lang.IllegalStateException: Cannot call methods on a stopped SparkContext.

May 24, 2019 in Apache Spark by Paul
 • 12,226 views
0 votes
1 answer

Spark: Problem creating RDD

May 24, 2019 in Big Data Hadoop by Karan
 • 1,540 views
0 votes
1 answer

Difference between RDD as val and var

May 23, 2019 in Apache Spark by SHeen
 • 3,455 views
0 votes
1 answer

How to read data from S3 in a regular inetrval using Spark Scala

Oct 31, 2018 in AWS by findingbugs
 • 3,260 points • 6,912 views
0 votes
1 answer

How should I provide a URL for hdfs file system?

Sep 10, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 4,756 views
0 votes
1 answer

How to connect Amazon RedShift in Apache Spark?

Aug 22, 2018 in AWS by datageek
 • 2,540 points • 9,096 views
+1 vote
3 answers

What is the difference between rdd and dataframes in Apache Spark ?

Jul 27, 2018 in Apache Spark by shams
 • 3,670 points • 46,337 views
+1 vote
8 answers

How to print the contents of RDD in Apache Spark?

Jul 6, 2018 in Apache Spark by Shubham
 • 13,490 points • 67,037 views
+1 vote
2 answers

How can I convert Spark Dataframe to Spark RDD?

Jul 4, 2018 in Apache Spark by code799
 • 22,650 views
0 votes
1 answer

Convert the given Spar rdd object to Spark DataFrame.

Jun 6, 2018 in Apache Spark by code799
 • 2,161 views
+1 vote
1 answer

How can I write a text file in HDFS not from an RDD, in Spark program?

May 29, 2018 in Apache Spark by code799
 • 10,306 views
0 votes
1 answer

How to save and retrieve the Spark RDD from HDFS?

May 29, 2018 in Apache Spark by code799
 • 15,493 views
0 votes
1 answer

How can I compare the elements of the RDD using MapReduce?

May 24, 2018 in Apache Spark by code799
 • 4,502 views
+1 vote
1 answer

Can anyone explain what is RDD in Spark?

May 24, 2018 in Apache Spark by coder_jazz
 • 3,985 views

Most popular tags