Michael Allman created SPARK-20843:
--------------------------------------
Summary: Cannot gracefully kill drivers which take longer than 10
seconds to die
Key: SPARK-20843
URL: https://issues.apache.org/jira/browse/SPARK-20843
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.1.1
Reporter: Michael Allman
Commit
https://github.com/apache/spark/commit/1c9a386c6b6812a3931f3fb0004249894a01f657
changed the behavior of driver process termination. Whereas before
`Process.destroyForcibly` was never called, now it is called (on Java VM's
supporting that API) if the driver process does not die within 10 seconds.
This prevents apps which take longer than 10 seconds to shutdown gracefully
from shutting down gracefully. For example, streaming apps with a large batch
duration (say, 30 seconds+) can take minutes to shutdown.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
