[ https://issues.apache.org/jira/browse/SPARK-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Or updated SPARK-10192: ------------------------------ Component/s: (was: Spark Core) Scheduler > Test for fetch failure in a shared dependency for "skipped" stages > ------------------------------------------------------------------ > > Key: SPARK-10192 > URL: https://issues.apache.org/jira/browse/SPARK-10192 > Project: Spark > Issue Type: Sub-task > Components: Scheduler, Tests > Reporter: Imran Rashid > Assignee: Imran Rashid > > One confusing corner case of the DAGScheduler is when there is a shared > shuffle dependency, a job might "skip" the stage associated with that shuffle > dependency, since its already been created as part of a different stage. > This means if there is a fetch failure, the retry will technically happen as > part of a different {{Stage}} instance. > This already works, but is lacking tests, so I just plan on adding a simple > test case. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org