How to read a data from text file in Spark

Question

Can someone give a code sample how to read a data from text file in Spark?

Answer 1

Hey,

You can try this:

from pyspark import SparkContext
SparkContext.stop(sc)
sc = SparkContext(“local”,”besant”) sqlContext = SQLContext(sc)
sc.textFile(filename)