Gajanan Hebbar created SPARK-31246: -------------------------------------- Summary: GracefulShutdown does not work when application is terminated from RestSubmissionClient or YarnClient Key: SPARK-31246 URL: https://issues.apache.org/jira/browse/SPARK-31246 Project: Spark Issue Type: Bug Components: Java API Affects Versions: 2.4.3 Environment: spark-2.4.3 Reporter: Gajanan Hebbar
While starting the Spark Application "*spark.streaming.stopGracefullyOnShutdown*" is set to true try to terminate the application programatically using JAVA API 1 using RestSubmissionClient client = new RestSubmissionClient(masterUrl); SubmitRestProtocolResponse statusResponse = client.killSubmission(submissionId); 2. using getYarnClient().killApplication(appId); In both the cases Application dose not stop gracefully But killing the Application using Kill -SIGTERM <pid> will shutdown the application gracefully. Expected : Application should have terminated gracefully in all cases when spark.streaming.stopGracefullyOnShutdown is set -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org