Weizhong created SPARK-9519: ------------------------------- Summary: Confirm stop sc successfully when application was killed Key: SPARK-9519 URL: https://issues.apache.org/jira/browse/SPARK-9519 Project: Spark Issue Type: Improvement Components: YARN Reporter: Weizhong Priority: Minor
Currently, when we kill application on Yarn, then will call sc.stop() at Yarn application state monitor thread, then in YarnClientSchedulerBackend.stop() will call interrupt this will cause SparkContext not stop fully as we will wait executor to exit. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org