[ https://issues.apache.org/jira/browse/SPARK-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Marcelo Vanzin resolved SPARK-9468. ----------------------------------- Resolution: Won't Fix See discussion in PR. > Avoid scheduling tasks on preemption executors > ---------------------------------------------- > > Key: SPARK-9468 > URL: https://issues.apache.org/jira/browse/SPARK-9468 > Project: Spark > Issue Type: Improvement > Components: Spark Core, YARN > Reporter: Saisai Shao > Priority: Minor > > Currently Spark SchedulerBackend has no mechanism to be notified of > preemption of executors by cluster manager, this will make SchedulerBackend > keep scheduling tasks on the to-be-preempted executors and finally be failed. > Also this cumulative failure will possibly lead to job failure. > So Spark SchedulerBackend should be notified and avoid scheduling tasks on > preemption nodes to avoid unnecessary failure. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org