Cyrille Chépélov created FLINK-13097:
----------------------------------------

             Summary: Buffer depletion in SimpleCollectingOutputView throws 
non-obvious EOFException 
                 Key: FLINK-13097
                 URL: https://issues.apache.org/jira/browse/FLINK-13097
             Project: Flink
          Issue Type: Improvement
    Affects Versions: 1.8.0, 1.7.2
         Environment: SCIO + BEAM + Flink under scala 2.12, java 8

            Reporter: Cyrille Chépélov


When SimpleCollectingOutputView is used, records are collected into a 
pre-allocated MemorySegmentSource. 

In case of depletion, the SimpleCollectingOutputView#nextSegment method throws 
EOFException without a message.

This can be non-obvious to diagnose as a newcomer, as 
* the Java SDK documentation strongly suggests EOFException is related to an 
inability to read further (whereas in this context, the exception materializes 
an inability to _write_ further)
* awareness than pre-allocated, fixed-size buffers are in play may not 
necessarily be expected of a newcomer to flink.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to