How to create RDD from parallelized collection in scala

Question

Can anyone explain how can I create RDD from parallelized collection in Scala?

Answer 1

Hi,

You can check this example in your scala shell to create RDD from parallelized collection:

scala>sc .parallelize(1 to 100,5) . collect

Parallelize is a method used to create the parallel collection of RDD and this method is spark context parallized method  to create parallelize collection. So, Collect as action to start the process.

Example below:

Hope this helps!

If you need to know more about Scala, join Apache Spark course today and become the expert.

Thanks!!