[
https://issues.apache.org/jira/browse/AVRO-406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831655#action_12831655
]
Doug Cutting commented on AVRO-406:
-----------------------------------
> Do we enforce that you can't start iterating blahs until chunks have been
> iterated?
I'm just exploring whether and how we might use a uniform, iterator-based API.
We might optimize the runtime in particular cases, and these optimizations
might result in runtime restrictions. These optimizations might be switchable
at runtime. So, tail-streamable might be enabled by default, and all others
would be fully buffered. But you might be able to call a
#setStreamNested(boolean) method that permits nested things to be streamed but
requires that datastructures be accessed in-order.
> Support streaming RPC calls
> ---------------------------
>
> Key: AVRO-406
> URL: https://issues.apache.org/jira/browse/AVRO-406
> Project: Avro
> Issue Type: New Feature
> Components: java, spec
> Reporter: Todd Lipcon
>
> Avro nicely supports chunking of container types into multiple frames. We
> need to expose this to RPC layer to facilitate use cases like the Hadoop
> Datanode where a single "RPC" can yield far more data than should be buffered
> in memory.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.