Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/7786#issuecomment-162965678 Jerry: do you know when YARN visits this decisions about having things pre-emptible? That is: if you are given a warning dos that mean the container will go any time in the next 60s? hour? As the longer the window is, the less useful it is avoiding scheduling work âyou lose too much. Or is this really a warning that YARN wants the container back and that you should just release it gracefully? If that's the case, then graceful shutdown of work is exactly what's needed
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org