[ https://issues.apache.org/jira/browse/SPARK-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647286#comment-14647286 ]
Apache Spark commented on SPARK-9468: ------------------------------------- User 'jerryshao' has created a pull request for this issue: https://github.com/apache/spark/pull/7786 > Avoid scheduling tasks on preemption executors > ---------------------------------------------- > > Key: SPARK-9468 > URL: https://issues.apache.org/jira/browse/SPARK-9468 > Project: Spark > Issue Type: Improvement > Components: Spark Core, YARN > Reporter: Saisai Shao > Priority: Minor > > Currently Spark SchedulerBackend has no mechanism to be notified of > preemption of executors by cluster manager, this will make SchedulerBackend > keep scheduling tasks on the to-be-preempted executors and finally be failed. > Also this cumulative failure will possibly lead to job failure. > So Spark SchedulerBackend should be notified and avoid scheduling tasks on > preemption nodes to avoid unnecessary failure. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org