Spark Scala Load custom delimited file

Question

I have a DAT file, which is pipe(|) delimited. How can I load the custom delimited file into the dataframe?

Answer 1

You can load a DAT file into a dataframe using the below command:

val sqlContext = sqlContext.read.format("csv").option("delimiter","|").load("emp_pipeline.DAT)

Hope this helps!

To know more about Spark Scala, It's recommended to join Spark training online today.

Thanks!!