[ https://issues.apache.org/jira/browse/SPARK-31246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiao Li updated SPARK-31246: ---------------------------- Priority: Major (was: Blocker) > GracefulShutdown does not work when application is terminated from > RestSubmissionClient or YarnClient > ----------------------------------------------------------------------------------------------------- > > Key: SPARK-31246 > URL: https://issues.apache.org/jira/browse/SPARK-31246 > Project: Spark > Issue Type: Bug > Components: Java API > Affects Versions: 2.4.3 > Environment: spark-2.4.3 > Reporter: Gajanan Hebbar > Priority: Major > > While starting the Spark Application > "*spark.streaming.stopGracefullyOnShutdown*" is set to true > try to terminate the application programatically using JAVA API > 1 using RestSubmissionClient client = new RestSubmissionClient(masterUrl); > SubmitRestProtocolResponse statusResponse = > client.killSubmission(submissionId); > > 2. using getYarnClient().killApplication(appId); > > In both the cases Application dose not stop gracefully > > But killing the Application using > > Kill -SIGTERM <pid> will shutdown the application gracefully. > Expected : Application should have terminated gracefully in all cases when > spark.streaming.stopGracefullyOnShutdown is set -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org