[
https://issues.apache.org/jira/browse/PARQUET-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16016458#comment-16016458
]
Ryan Blue commented on PARQUET-41:
----------------------------------
[~junjie] & [~Ferd], it would be great to get a bit more data on these use
cases, like the number of distinct values in each column. I know you probably
can't share the data, but I'd like to understand how large the space is where
bloom filters will make a difference. We will also have to solve the problem of
tuning bloom filters, which become useless quickly with the wrong config.
> Add bloom filters to parquet statistics
> ---------------------------------------
>
> Key: PARQUET-41
> URL: https://issues.apache.org/jira/browse/PARQUET-41
> Project: Parquet
> Issue Type: New Feature
> Components: parquet-format, parquet-mr
> Reporter: Alex Levenson
> Assignee: Ferdinand Xu
> Labels: filter2
>
> For row groups with no dictionary, we could still produce a bloom filter.
> This could be very useful in filtering entire row groups.
> Pull request:
> https://github.com/apache/parquet-mr/pull/215
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
