[ 
https://issues.apache.org/jira/browse/HBASE-5469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HBASE-5469:
-------------------------------

    Attachment: D2409.2.patch

mbautin updated the revision "[jira] [HBASE-5469] Add baseline compression 
efficiency to DataBlockEncodingTool".
Reviewers: JIRA, dhruba, tedyu, stack, heyongqiang

  Addressing Ted's comments.

REVISION DETAIL
  https://reviews.facebook.net/D2409

AFFECTED FILES
  
src/main/java/org/apache/hadoop/hbase/io/encoding/BufferedDataBlockEncoder.java
  src/main/java/org/apache/hadoop/hbase/io/encoding/CopyKeyDataBlockEncoder.java
  src/main/java/org/apache/hadoop/hbase/io/encoding/DataBlockEncoder.java
  src/main/java/org/apache/hadoop/hbase/io/encoding/DiffKeyDeltaEncoder.java
  src/main/java/org/apache/hadoop/hbase/io/encoding/EncodedDataBlock.java
  src/main/java/org/apache/hadoop/hbase/io/encoding/FastDiffDeltaEncoder.java
  src/main/java/org/apache/hadoop/hbase/io/encoding/PrefixKeyDeltaEncoder.java
  src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
  src/main/java/org/apache/hadoop/hbase/io/hfile/HFileDataBlockEncoderImpl.java
  src/test/java/org/apache/hadoop/hbase/io/encoding/TestDataBlockEncoders.java
  src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlock.java
  src/test/java/org/apache/hadoop/hbase/regionserver/DataBlockEncodingTool.java
  
src/test/java/org/apache/hadoop/hbase/regionserver/EncodedSeekPerformanceTest.java

                
> Add baseline compression efficiency to DataBlockEncodingTool
> ------------------------------------------------------------
>
>                 Key: HBASE-5469
>                 URL: https://issues.apache.org/jira/browse/HBASE-5469
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Mikhail Bautin
>            Assignee: Mikhail Bautin
>            Priority: Minor
>         Attachments: D2409.1.patch, D2409.2.patch
>
>
> DataBlockEncodingTool currently does not provide baseline compression 
> efficiency, e.g. Hadoop compression codec applied to unencoded data. E.g. if 
> we are using LZO to compress blocks, we would like to have the following 
> columns in the report (possibly as percentages of raw data size).
> Baseline K+V in blockcache  |   Baseline K + V on disk  (LZO compressed)  | K 
> + V  DataBlockEncoded in block cache |   K + V DataBlockEncoded + 
> LZOCompressed (on disk)
> Background: we never store compressed blocks in cache, but we always store 
> encoded data blocks in cache if data block encoding is enabled for the column 
> family.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to