[
https://issues.apache.org/jira/browse/PARQUET-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15954269#comment-15954269
]
Lars Volker commented on PARQUET-922:
-------------------------------------
The design doc for this feature can be found here:
https://docs.google.com/document/d/1sBACp8Lbutuj1Zxdowvsrlm8ku4BFxf8U_Do5K2wSO4/edit?usp=sharing
> Define Index pages when a Parquet file is sorted
> ------------------------------------------------
>
> Key: PARQUET-922
> URL: https://issues.apache.org/jira/browse/PARQUET-922
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-format
> Reporter: Julien Le Dem
> Assignee: Marcel Kornacker
>
> When a Parquet file is sorted we can define an index consisting of the
> boundary values for the pages of the columns sorted on as well as the offsets
> and length of said pages in the file.
> The goal is to optimize lookup and range scan type queries, using this to
> read only the pages containing data matching the filter.
> We'd require the pages to be aligned accross columns.
> [~marcelk] will add a link to the google doc to discuss the spec
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
