[ https://issues.apache.org/jira/browse/AVRO-406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831160#action_12831160 ]
Doug Cutting commented on AVRO-406: ----------------------------------- > The disadvantage here of treating everything like an Iterable is that we > won't be able to check .size() ahead of time to set up the right size array > block, and we'll end up chunking all arrays in single-element blocks. BlockingBinaryEncoder solves this already this for small objects, buffering them until a block is full. And if an element is a large ByteBuffer, then it can be immediately written as a single-element block without copying and without significant overhead. > Support streaming RPC calls > --------------------------- > > Key: AVRO-406 > URL: https://issues.apache.org/jira/browse/AVRO-406 > Project: Avro > Issue Type: New Feature > Components: java, spec > Reporter: Todd Lipcon > > Avro nicely supports chunking of container types into multiple frames. We > need to expose this to RPC layer to facilitate use cases like the Hadoop > Datanode where a single "RPC" can yield far more data than should be buffered > in memory. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.