Hi Jim, this is definitley strange. It sure sounds like a bug, but it also is a very commonly used code path, so it at the very least you must be hitting a corner case. Could you share a little more info with us? What version of spark are you using? How big is the object you are trying to broadcast? Can you share more of the logs from before the exception?
It is not too surprising this shows up in mesos but not in local mode. Local mode never exercises the part of the code that needs to deserialize the blocks of a broadcast variables (though it actually does serialize the data into blocks). So I doubt its mesos specific, more likely it would happen in any cluster mode -- yarn, standalone, or even local-cluster (a pseudo-cluster just for testing). Imran On Tue, May 19, 2015 at 3:56 PM, Jim Carroll <jimfcarr...@gmail.com> wrote: > I'm seeing the following exception ONLY when I run on a Mesos cluster. If I > run the exact same code with master set to "local[N]" I have no problem: > > 2015-05-19 16:45:43,484 [task-result-getter-0] WARN TaskSetManager - Lost > task 0.0 in stage 0.0 (TID 0, 10.253.1.101): java.io.EOFException > at > > org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:142) > at > > org.apache.spark.broadcast.TorrentBroadcast$.unBlockifyObject(TorrentBroadcast.scala:216) > at > > org.apache.spark.broadcast.TorrentBroadcast$$anonfun$readBroadcastBlock$1.apply(TorrentBroadcast.scala:177) > at org.apache.spark.util.Utils$.tryOrIOException(Utils.scala:1153) > at > > org.apache.spark.broadcast.TorrentBroadcast.readBroadcastBlock(TorrentBroadcast.scala:164) > at > > org.apache.spark.broadcast.TorrentBroadcast._value$lzycompute(TorrentBroadcast.scala:64) > at > > org.apache.spark.broadcast.TorrentBroadcast._value(TorrentBroadcast.scala:64) > at > > org.apache.spark.broadcast.TorrentBroadcast.getValue(TorrentBroadcast.scala:87) > at org.apache.spark.broadcast.Broadcast.value(Broadcast.scala:70) > at > org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:58) > at org.apache.spark.scheduler.Task.run(Task.scala:64) > at > org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203) > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > KryoSerializer explicitly throws an EOFException. The comment says: > > // DeserializationStream uses the EOF exception to indicate stopping > condition. > > Apparently this isn't what TorrentBroadcast expects. > > Any suggestions? Thanks. > > Jim > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/EOFException-using-KryoSerializer-tp22948.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
