Saisai Shao created SPARK-9468:
----------------------------------
Summary: Avoid scheduling tasks on preemption executors
Key: SPARK-9468
URL: https://issues.apache.org/jira/browse/SPARK-9468
Project: Spark
Issue Type: Improvement
Components: Spark Core, YARN
Reporter: Saisai Shao
Priority: Minor
Currently Spark SchedulerBackend has no mechanism to be notified of preemption
of executors by cluster manager, this will make SchedulerBackend keep
scheduling tasks on the to-be-preempted executors and finally be failed. Also
this cumulative failure will possibly lead to job failure.
So Spark SchedulerBackend should be notified and avoid scheduling tasks on
preemption nodes to avoid unnecessary failure.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
