[
https://issues.apache.org/jira/browse/HIVE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12688606#action_12688606
]
He Yongqiang commented on HIVE-352:
-----------------------------------
Thank you for the advices, joydeep.
yeah,i am working on B2.2. And i am hoping i can finish a draft version in the
coming few days.
{quote}don't decompress all columns when we only want a few{quote}
Using the SequenceFile to implement B2.2( columnar storage in one record), if
we use RecordCompression, I think SequenceFile will decompress the whole value
part thus all the data. It is really tough, since decompression needs to touch
all the data, and if no compression at all then one advantage of columnar
storage will lost. Even without compression, SequenceFile still needs to read
the whole value part into memory, and disallow skipping data (Hadoop-5553).
So i guess i may need to discard SequenceFile, which can support skipping data
and compression.
Any comments?
> Make Hive support column based storage
> --------------------------------------
>
> Key: HIVE-352
> URL: https://issues.apache.org/jira/browse/HIVE-352
> Project: Hadoop Hive
> Issue Type: New Feature
> Reporter: He Yongqiang
>
> column based storage has been proven a better storage layout for OLAP.
> Hive does a great job on raw row oriented storage. In this issue, we will
> enhance hive to support column based storage.
> Acctually we have done some work on column based storage on top of hdfs, i
> think it will need some review and refactoring to port it to Hive.
> Any thoughts?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
