How to change encryption key value for local I O

Question

Hi. I have enabled encryption for local disk I/O by enabling this property: spark.io.encryption.enabled. By default it is using 128 bit encryption. How can I change it to 256?

Answer 1

There another property where you can set the key size bit. The property is spark.io.encryption.keySizeBits. I don't know how you have enabled encryption, you can use the same method to set this also. But for the sake of other members, I'll show how this can be done dynamically:

val sc = new SparkContext(new SparkConf())

./bin/spark-submit <all your existing options> --spark.io.encryption.keySizeBits=256