[ https://issues.apache.org/jira/browse/HBASE-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13697258#comment-13697258 ]
Jesse Yates commented on HBASE-8737: ------------------------------------ I'm a little slow today... any chance we can figure out likely data sizes based on whether or not we are getting a SizedCellScanner? So, if its sized, then we should use that (agreeing with you above), but when do we not get that and can we make any assumptions about the size of the data? A 2x improvement is a pretty big jump... it might be worth doing (1) about instrumenting this a little bit so people can see if they should switch to using the counting and then (2) making the counting optional? I may be trying to generalize too much though :) > [replication] Change replication RPC to use cell blocks > ------------------------------------------------------- > > Key: HBASE-8737 > URL: https://issues.apache.org/jira/browse/HBASE-8737 > Project: HBase > Issue Type: Improvement > Components: Replication > Reporter: Chris Trezzo > Assignee: stack > Priority: Critical > Fix For: 0.98.0, 0.95.2 > > Attachments: > 0001-HBASE-8737-replication-Change-replication-RPC-to-use.patch, 8737.txt, > 8737v3.txt, 8737v4.txt, 8737v5.txt > > > Currently, the replication rpc that ships edits simply dumps the byte value > of WAL edit key/value pairs into a protobuf message. > Modify the replication rpc mechanism to use cell blocks so it can leverage > encoding and compression. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira