Hi Y’all, I’ve got a K8s graceful decom PR ( https://github.com/apache/spark/pull/26440 ) I’d love to try and get in for Spark 3, but I don’t want to push on it if folks don’t think it’s worth it. I’ve been working on it since 2017 and it was really close in November but then I had the crash and had to step back for awhile.
It’s effectiveness is behind a feature flag and it’s been outstanding for awhile so those points are in its favour. It does however change things in core which is not great. Cheers, Holden -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
