How to create a list of RDDs or RDD of RDDs if possible from a single JavaRDD List Integers in Java

+1 vote
Hi,

I have the input RDD as a list of integers like [2,1,2,8,2,4.....100 integers],

                                                                   [3,1,2,5,..........100 integers],

                                                                  ------------------------------------------

                                                                   10000 items are present in the input RDD.

My aim is to create RDD of  RDDs  or List of RDDs for each column of the 10000 items. That means from a single RDD, I have to map so that I can get 100 RDDs each with 10000 items in it. Can Please help me write the mapping function or the code for the same in Java

Thank you
Jan 11, 2020 in Apache Spark by itsroops
• 130 points
1,670 views
shg/rdd keya he

No answer to this question. Be the first to respond.

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.

Related Questions In Apache Spark

0 votes
1 answer

How to create RDD from parallelized collection in scala?

Hi, You can check this example in your ...READ MORE

answered Jul 3, 2019 in Apache Spark by Gitika
• 65,870 points
697 views
0 votes
1 answer

How to create RDD from existing RDD in scala?

scala> val rdd1 = sc.parallelize(List(1,2,3,4,5))                           -  Creating ...READ MORE

answered Feb 28, 2020 in Apache Spark by anonymous
389 views
0 votes
1 answer

How to create RDD from an external file source in scala?

Hi, To create an RDD from external file ...READ MORE

answered Jul 3, 2019 in Apache Spark by Gitika
• 65,870 points
633 views
0 votes
1 answer
+1 vote
2 answers
0 votes
1 answer

Moving files in Hadoop using the Java API?

I would recommend you to use FileSystem.rename(). ...READ MORE

answered Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,480 points
1,707 views
0 votes
1 answer

Hadoop giving java.io.IOException, in mkdir Java code.

I am not sure about the issue. ...READ MORE

answered May 3, 2018 in Big Data Hadoop by Shubham
• 13,480 points
1,257 views
0 votes
1 answer

Convert the given Spar rdd object to Spark DataFrame.

You can create a DataFrame from the ...READ MORE

answered Jun 5, 2018 in Apache Spark by Shubham
• 13,480 points
341 views