This code has been modified since you reported this so you may want to try the current master.
- Patrick On Mon, Jan 20, 2014 at 4:22 AM, guojc <guoj...@gmail.com> wrote: > Hi, > I'm tring out lastest master branch of spark for the exciting external > hashmap feature. I have a code that is running correctly at spark 0.8.1 and > I only make a change for its easily to be spilled to disk. However, I > encounter a few task failure of > java.util.NoSuchElementException (java.util.NoSuchElementException) > org.apache.spark.util.collection.ExternalAppendOnlyMap$ExternalIterator.next(ExternalAppendOnlyMap.scala:277)org.apache.spark.util.collection.ExternalAppendOnlyMap$ExternalIterator.next(ExternalAppendOnlyMap.scala:212)org.apache.spark.InterruptibleIterator.next(InterruptibleIterator.scala:29) > And the job seems to fail to recover. > Can anyone give some suggestion on how to investigate the issue? > Thanks,Jiacheng Guo
