[
https://issues.apache.org/jira/browse/AVRO-406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12830361#action_12830361
]
Todd Lipcon commented on AVRO-406:
----------------------------------
Sending an RPC per chunk seems like a significant amount of overhead. A
streaming RPC response also makes good sense for scan or multiget APIs in HBase
- if you want to perform a scan of a few thousand rows with minimal latency,
it's best not to have to worry about sending 1000 separate RPCs and congealing
the responses. That would add up to a significant CPU overhead, and probably
transfer overhead as well - imagine a multiget where each cell is only a few
bytes, but you want several thousand of them.
> Support streaming RPC calls
> ---------------------------
>
> Key: AVRO-406
> URL: https://issues.apache.org/jira/browse/AVRO-406
> Project: Avro
> Issue Type: New Feature
> Components: java, spec
> Reporter: Todd Lipcon
>
> Avro nicely supports chunking of container types into multiple frames. We
> need to expose this to RPC layer to facilitate use cases like the Hadoop
> Datanode where a single "RPC" can yield far more data than should be buffered
> in memory.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
