[jira] [Created] (ORC-91) Use hdfs v-blocks instead of zero-padding stripes

[Gopal V (JIRA)]

Gopal V created ORC-91:
--------------------------

             Summary: Use hdfs v-blocks instead of zero-padding stripes
                 Key: ORC-91
                 URL: https://issues.apache.org/jira/browse/ORC-91
             Project: Orc
          Issue Type: Improvement
            Reporter: Gopal V


HDFS-3689 added variable length blocks to HDFS as a core feature.

hsync(SyncFlag.END_BLOCK) 

can now end an HDFS block on disk without padding it out with zeros. 

The current space wasted in ORC to padding is 5%.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)