How to authenticate Spark internal connections using a secret key

0 votes
I have enabled Spark authentication for internal connections in Spark. Now instead of normal authentication, I want the authentication to be done using a secret key. How can I do this?
Mar 13, 2019 in Apache Spark by Zaheer
1,190 views

1 answer to this question.

0 votes

You need to set the secret key that you want to use for authentication. After you have enabled authentication, set the secret key as follows:

val sc = new SparkContext(new SparkConf())
./bin/spark-submit <all your existing options> --spark.authenticate.secret= <secret key>
answered Mar 13, 2019 by Venu

Related Questions In Apache Spark

+1 vote
1 answer
0 votes
1 answer
0 votes
1 answer

How to restrict a group to only view in Spark?

You can do it dynamically be setting ...READ MORE

answered Mar 15, 2019 in Apache Spark by Raj
266 views
0 votes
1 answer

How to access private key password with Spark?

Spark allows you to retrieve the key ...READ MORE

answered Mar 15, 2019 in Apache Spark by Karan
1,145 views
+1 vote
2 answers
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
9,348 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
1,713 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
86,549 views
0 votes
1 answer

How to get ID of a map task in Spark?

you can access task information using TaskContext: import org.apache.spark.TaskContext sc.parallelize(Seq[Int](), ...READ MORE

answered Nov 20, 2018 in Apache Spark by Frankie
• 9,830 points
2,528 views
0 votes
1 answer

Authenticate internal connections in Spark

To make Spark authenticate internal connections, you ...READ MORE

answered Mar 13, 2019 in Apache Spark by Venu
202 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP