Github user ArtRand commented on the issue: https://github.com/apache/spark/pull/13143 Hello @devaraj-kavali. Yes. I've been playing around with this because it's inconvenient to clean up ZK whenever you uninstall/reinstall the Dispatcher. The problem is that the only signal of a re-install vs. a failover is when Mesos gives you a `DRIVER_ABORTED` error (signals a re-install). I think a solution will involve having different methods to starting `SchedulerDrivers` for Spark Drivers (applications) and the Dispatcher because they inherently have different requirements with respect to state.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org