[
https://issues.apache.org/jira/browse/PARQUET-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16095614#comment-16095614
]
Ferdinand Xu commented on PARQUET-41:
-------------------------------------
Thanks [~jbapple] for the suggestions.
{noformat}
As a result, I have seen speedups of 50% to 500% (depending on the operation
and filter size) over the fastest other general-purpose Bloom filter I know of.
{noformat}
Is there any benchmark or reference about this number?
> Add bloom filters to parquet statistics
> ---------------------------------------
>
> Key: PARQUET-41
> URL: https://issues.apache.org/jira/browse/PARQUET-41
> Project: Parquet
> Issue Type: New Feature
> Components: parquet-format, parquet-mr
> Reporter: Alex Levenson
> Assignee: Ferdinand Xu
> Labels: filter2
>
> For row groups with no dictionary, we could still produce a bloom filter.
> This could be very useful in filtering entire row groups.
> Pull request:
> https://github.com/apache/parquet-mr/pull/215
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
