[ 
https://issues.apache.org/jira/browse/HBASE-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13697258#comment-13697258
 ] 

Jesse Yates commented on HBASE-8737:
------------------------------------

I'm a little slow today... any chance we can figure out likely data sizes based 
on whether or not we are getting a SizedCellScanner? So, if its sized, then we 
should use that (agreeing with you above), but when do we not get that and can 
we make any assumptions about the size of the data? 

A 2x improvement is a pretty big jump... it might be worth doing (1) about 
instrumenting this a little bit so people can see if they should switch to 
using the counting and then (2) making the counting optional?

I may be trying to generalize too much though :)
                
> [replication] Change replication RPC to use cell blocks
> -------------------------------------------------------
>
>                 Key: HBASE-8737
>                 URL: https://issues.apache.org/jira/browse/HBASE-8737
>             Project: HBase
>          Issue Type: Improvement
>          Components: Replication
>            Reporter: Chris Trezzo
>            Assignee: stack
>            Priority: Critical
>             Fix For: 0.98.0, 0.95.2
>
>         Attachments: 
> 0001-HBASE-8737-replication-Change-replication-RPC-to-use.patch, 8737.txt, 
> 8737v3.txt, 8737v4.txt, 8737v5.txt
>
>
> Currently, the replication rpc that ships edits simply dumps the byte value 
> of WAL edit key/value pairs into a protobuf message.
> Modify the replication rpc mechanism to use cell blocks so it can leverage 
> encoding and compression.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to