Re: How to detect when a JavaSparkContext gets stopped

You can look into the SparkListener interface to get some of those messages. Losing the master though is pretty fatal to all apps. On Mon, Sep 5, 2016 at 7:30 AM, Hough, Stephen C wrote: > I have a long running application, configured to be HA, whereby only the >

How to detect when a JavaSparkContext gets stopped

I have a long running application, configured to be HA, whereby only the designated leader will acquire a JavaSparkContext, listen for requests and push jobs onto this context. The problem I have is, whenever my AWS instances running workers die (either a time to live expires or I cancel those