Set Spark executable for R scripts

Question

I am running Spark in cluster mode and I want to change the executable that executes the R script on driver and workers. The default executable is Rscript. How can I change this?

Answer 1

To change the default executable, assign the new executable to the spark.r.command property. Try this:

val sc = new SparkContext(new SparkConf())

./bin/spark-submit <all your existing options> --spark.r.command= <new executable>