[
https://issues.apache.org/jira/browse/PARQUET-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14051132#comment-14051132
]
Dmitriy V. Ryaboy commented on PARQUET-11:
------------------------------------------
Please see discussion in
https://github.com/apache/incubator-parquet-format/pull/2
> Reduce memory pressure when reading footers
> -------------------------------------------
>
> Key: PARQUET-11
> URL: https://issues.apache.org/jira/browse/PARQUET-11
> Project: Parquet
> Issue Type: Bug
> Reporter: Dmitriy V. Ryaboy
>
> I encountered OOMs reading metadata for a dataset with 500+ columns, many of
> them quite sparse.
> We can reduce memory utilization significantly.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
