[
https://issues.apache.org/jira/browse/FLINK-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319835#comment-14319835
]
Stephan Ewen commented on FLINK-1531:
-------------------------------------
[~jkirsch] Exceptions are used rarely, only at the end of jobs and at the end
of supersteps. That is a handful of times within a job and should be okay.
We are using a java interface that uses EOFException to signal the last record,
so we need to do this until we get rid of that interface.
BTW: I think exceptions became much faster since that answer (6 years ago),
since stack traces are filled in lazily now.
> Custom Kryo Serializer fails in itertation scenario
> ---------------------------------------------------
>
> Key: FLINK-1531
> URL: https://issues.apache.org/jira/browse/FLINK-1531
> Project: Flink
> Issue Type: Bug
> Components: Iterations
> Affects Versions: 0.9
> Reporter: Johannes
> Priority: Minor
> Fix For: 0.9, 0.8.1
>
> Attachments: TestKryoIterationSerializer.java
>
>
> When using iterations with a custom serializer for a domain object, the
> iteration will fail.
> {code:java}
> org.apache.flink.runtime.client.JobExecutionException:
> com.esotericsoftware.kryo.KryoException: Buffer underflow
> at
> org.apache.flink.api.java.typeutils.runtime.NoFetchingInput.require(NoFetchingInput.java:76)
> at com.esotericsoftware.kryo.io.Input.readVarInt(Input.java:355)
> at
> com.esotericsoftware.kryo.util.DefaultClassResolver.readClass(DefaultClassResolver.java:109)
> at com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:641)
> at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:752)
> at
> org.apache.flink.api.java.typeutils.runtime.KryoSerializer.deserialize(KryoSerializer.java:198)
> at
> org.apache.flink.api.java.typeutils.runtime.KryoSerializer.deserialize(KryoSerializer.java:203)
> at
> org.apache.flink.runtime.io.disk.InputViewIterator.next(InputViewIterator.java:43)
> at
> org.apache.flink.runtime.iterative.task.IterationHeadPactTask.streamOutFinalOutputBulk(IterationHeadPactTask.java:404)
> at
> org.apache.flink.runtime.iterative.task.IterationHeadPactTask.run(IterationHeadPactTask.java:377)
> at
> org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:360)
> at
> org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:204)
> at java.lang.Thread.run(Thread.java:745)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
