Jesper Lundgren created SPARK-9008: -------------------------------------- Summary: Stop and remove driver from supervised mode in spark-master interface Key: SPARK-9008 URL: https://issues.apache.org/jira/browse/SPARK-9008 Project: Spark Issue Type: New Feature Reporter: Jesper Lundgren
The cluster will automatically restart failing drivers when launched in supervised cluster mode. However there is no official way for a operation team to stop and remove a driver from restarting in case it is malfunctioning. I know there is "bin/spark-class org.apache.spark.deploy.Client kill" but this is undocumented and does not always work so well. It would be great if there was a way to remove supervised mode to allow kill -9 to work on a driver program. The documentation surrounding this could also see some improvements. It would be nice to have some best practice examples on how to work with supervised mode, how to manage graceful shutdown and catch TERM signals. (TERM signal will end with wrong exit code and trigger restart when using supervised mode unless you change the exit code in the application logic) -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org