[
https://issues.apache.org/jira/browse/SPARK-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-864.
-----------------------------
Resolution: Cannot Reproduce
Closing as it looks exceptionally stale at this point and haven't seen similar
reports
> DAGScheduler Exception if A Node is Added then Deleted
> ------------------------------------------------------
>
> Key: SPARK-864
> URL: https://issues.apache.org/jira/browse/SPARK-864
> Project: Spark
> Issue Type: Bug
> Components: Scheduler
> Affects Versions: 0.8.0
> Reporter: Patrick Cogan
> Assignee: xiajunluan
>
> According to [~markhamstra], if you run the UI tester locally and remove a
> slave, then add another slave, everything freezes. UPDATE: This appears to be
> caused by the DAGScheduler:
> {code}
> Exception in thread "DAGScheduler" java.util.NoSuchElementException: key not
> found: 2
> at scala.collection.MapLike$class.default(MapLike.scala:225)
> at scala.collection.mutable.HashMap.default(HashMap.scala:45)
> at scala.collection.MapLike$class.apply(MapLike.scala:135)
> at scala.collection.mutable.HashMap.apply(HashMap.scala:45)
> at
> spark.scheduler.DAGScheduler.spark$scheduler$DAGScheduler$$submitMissingTasks(DAGScheduler.scala:515)
> at
> spark.scheduler.DAGScheduler.spark$scheduler$DAGScheduler$$submitStage(DAGScheduler.scala:481)
> at
> spark.scheduler.DAGScheduler$$anonfun$resubmitFailedStages$3.apply(DAGScheduler.scala:383)
> at
> spark.scheduler.DAGScheduler$$anonfun$resubmitFailedStages$3.apply(DAGScheduler.scala:382)
> at
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:34)
> at scala.collection.mutable.ArrayOps.foreach(ArrayOps.scala:38)
> at
> spark.scheduler.DAGScheduler.resubmitFailedStages(DAGScheduler.scala:382)
> at
> spark.scheduler.DAGScheduler.spark$scheduler$DAGScheduler$$run(DAGScheduler.scala:433)
> at spark.scheduler.DAGScheduler$$anon$1.run(DAGScheduler.scala:135)
> {code}
> This code is related to the FairScheduler change. Hey [~andrew xia] - could
> you take a look at this?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
