I’m investigating this issue and left some comments on the proposed fix: https://github.com/apache/spark/pull/3345#issuecomment-68014353
To summarize, I agree with your description of the problem but think that the right fix may be a bit more involved than what’s proposed in that PR (that PR’s fix shouldn’t actually work, as far as I can tell). - Josh On December 19, 2014 at 10:57:41 AM, thlee ([email protected]) wrote: any comments? -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Confirming-race-condition-in-DagScheduler-NoSuchElementException-tp9798p9855.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
