[
https://issues.apache.org/jira/browse/HIVE-17006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126595#comment-16126595
]
Gunther Hagleitner commented on HIVE-17006:
-------------------------------------------
can you create follow ups for the major todos? a) Uncopify
ParquetMetadataCacheImpl, BB put for FileMetadataCache, Parquet impl in LlapIo
impl...
The error handling in LlapCacheAwareFs should be done before commit it seems,
that can leave a leak?
> LLAP: Parquet caching
> ---------------------
>
> Key: HIVE-17006
> URL: https://issues.apache.org/jira/browse/HIVE-17006
> Project: Hive
> Issue Type: Bug
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Attachments: HIVE-17006.01.patch, HIVE-17006.02.patch,
> HIVE-17006.patch, HIVE-17006.WIP.patch
>
>
> There are multiple options to do Parquet caching in LLAP:
> 1) Full elevator (too intrusive for now).
> 2) Page based cache like ORC (requires some changes to Parquet or
> copy-pasted).
> 3) Cache disk data on column chunk level as is.
> Given that Parquet reads at column chunk granularity, (2) is not as useful as
> for ORC, but still a good idea. I messaged the dev list about it but didn't
> get a response, we may follow up later.
> For now, do (3).
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
