[
https://issues.apache.org/jira/browse/SPARK-17519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-17519:
---------------------------------
Labels: bulk-closed (was: )
> [MESOS] Enhance robustness when ExternalShuffleService is broken
> ----------------------------------------------------------------
>
> Key: SPARK-17519
> URL: https://issues.apache.org/jira/browse/SPARK-17519
> Project: Spark
> Issue Type: Improvement
> Components: Mesos
> Affects Versions: 2.0.0
> Reporter: Sun Rui
> Priority: Major
> Labels: bulk-closed
>
> This is intended to be a complement to SPARK-17370 which addressed Standalone
> mode only.
> For Mesos, it seems we could enhance MesosExternalShuffleClient to detect if
> any of the external shuffle services is lost when sending heartbeats. In such
> case, the MesosCoarseGrainedSchedulerBackend can notify ExecutorLost with
> workerlost=true. Also it can put the slave where the external shuffle service
> run to the blacklist, preventing launching tasks further on it.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
