Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/3783#issuecomment-69284237 > Can you explain how (1) is related to SPARK-4951? It seems to me that (2) is sufficient in triggering the issue. The original implementation will mark an exeuctor idle when receiving `SparkListenerBlockManagerAdded`. So if `SparkListenerTaskStart` is received before `SparkListenerBlockManagerAdded`, when receiving `SparkListenerBlockManagerAdded`, the executor will be marked idle even if there is a task running in it. Therefore, the executor will be killed when it's expired. That's why I said it's related. Of cause, we can also say (1) is a special case of (2).
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org