Scala 30 error value partitions is not a member of String

Question

val emp_data =spark.sparkContext.textFile("dataset");

val emp_header=emp_data.first()

val emp_data_without_header =emp_header.filter(x=>(!x.equals(emp_header)))

println("No.ofpartition="+emp_data_without_header.partitions.size)

30: error: value partitions is not a member of String emp_data_without_header.partitions.size ^

How to check the partitions for the above statement?

Answer 1

Try this code:

val rdd= sc.textFile (“file.txt”, 5)

rdd.partitions.size

Output = 5

Hope it helps!

If you want to know more about Apache Spark Scala, It's highly recommended to go for Apache Spark certification course today.

Thanks!!