Spark event log location

0 votes
Hi. Need urgent help. I need to know to the location where spark event logs are stored to find the logs of an event. Thanks in advance.
Mar 6, 2019 in Apache Spark by Prateek
62 views

1 answer to this question.

0 votes

Unless and until you have not changed any configurations, you should find the logs in the following path:

file:///tmp/spark-events

There will a sub-directory for the application whose logs you are looking for. You will find the logs inside this directory. 

answered Mar 6, 2019 by Rohit

Related Questions In Apache Spark

0 votes
1 answer

Log every block update in Spark

By default, Spark does not log all ...READ MORE

answered Mar 6, 2019 in Apache Spark by Rohit
104 views
0 votes
1 answer

How to enable Spark event logging?

To make Spark store the event logs, ...READ MORE

answered Mar 6, 2019 in Apache Spark by Rohit
1,075 views
0 votes
1 answer

How to increase Spark listener bus event queue capacity?

The default capacity of listener bus is ...READ MORE

answered Mar 11, 2019 in Apache Spark by Raj
1,658 views
0 votes
1 answer

Changing Column position in spark dataframe

Yes, you can reorder the dataframe elements. You need ...READ MORE

answered Apr 19, 2018 in Apache Spark by Ashish
• 2,650 points
9,110 views
+1 vote
2 answers
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,950 points
6,352 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,950 points
984 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyF ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
41,893 views
0 votes
1 answer

How to change the location of Spark event logs?

You can change the location where you ...READ MORE

answered Mar 6, 2019 in Apache Spark by Rohit
1,412 views
0 votes
1 answer

Invalid syntax in spark

There's a problem with your syntax. There ...READ MORE

answered Jan 31, 2019 in Apache Spark by Omkar
• 69,030 points
343 views