How do spark extra listeners work?

0 votes
Hi. I have read that we can use extra listeners for Spark. Can you tell me more about how this works?
Feb 23 in Apache Spark by Jimmy
152 views

1 answer to this question.

0 votes

Yes. You can use extra listeners by setting it in the spark.extraListeners property. The spark.extraListeners is a comma-separated list of classes that implement SparkListener. when initializing SparkContext, instances of these classes will be created and registered with Spark's listener bus. 

To add extra listeners to Spark, you can set this property while using the spark submit command. Example:

./bin/spark-submit --conf spark.extraListereners <Comma-separated list of listener classes>
answered Feb 23 by Rishi

Related Questions In Apache Spark

0 votes
1 answer

How does partitioning work in Spark?

By default a partition is created for ...READ MORE

answered May 31, 2018 in Apache Spark by nitinrawat895
• 9,990 points
39 views
0 votes
1 answer

How to set extra JVM options for Spark application?

You cans set extra JVM options that ...READ MORE

answered Mar 28 in Apache Spark by Raj
146 views
0 votes
1 answer

How do I turn off INFO Logging in Spark?

Execute this command in the spark directory: cp ...READ MORE

answered 3 days ago in Apache Spark by ravikiran
• 3,320 points
17 views
0 votes
1 answer

How to stop messages from being displayed on spark console?

In your log4j.properties file you need to ...READ MORE

answered Apr 24, 2018 in Apache Spark by kurt_cobain
• 9,240 points
840 views
0 votes
1 answer

How to get Spark dataset metadata?

There are a bunch of functions that ...READ MORE

answered Apr 26, 2018 in Apache Spark by kurt_cobain
• 9,240 points
272 views
0 votes
1 answer

How is Apache Spark different from the Hadoop approach?

In Hadoop MapReduce the input data is ...READ MORE

answered May 7, 2018 in Apache Spark by BD Master
60 views
0 votes
0 answers
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 9,990 points
2,025 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 9,990 points
188 views
0 votes
10 answers

hadoop fs -put command?

copy command can be used to copy files ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Sujay
10,227 views