Enable encryption for local Input and Output

Question

How can I set encryption for local disk Input and Output?

Answer 1

You can enable local I/O encryption like this:

val sc = new SparkContext(new SparkConf())

./bin/spark-submit <all your existing options> --spark.io.encryption.enabled=true

It supports all modes except Mesos.