[
https://issues.apache.org/jira/browse/PARQUET-250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491385#comment-14491385
]
Cheng Lian commented on PARQUET-250:
------------------------------------
Yeah, we need to bump Parquet version used in Spark to fix this. However, the
official 1.6.0 release hasn't been out yet. You may track SPARK-5463 for this.
> StatisticsFilter "And"'s semantic error
> ---------------------------------------
>
> Key: PARQUET-250
> URL: https://issues.apache.org/jira/browse/PARQUET-250
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
> Affects Versions: 1.6.0
> Reporter: Yijie Shen
> Labels: easyfix
>
> {code}
> public Boolean visit(And and) {
> return and.getLeft().accept(this) && and.getRight().accept(this);
> }
> {code}
> visit(And and) is used to determine whether a row group "canDrop", therefore,
> in "And" situation, either left "canDrop" or right "canDrop" would lead the
> row group "canDrop", so we need a "||" here to make the choice.
> Therefore, it should be:
> {code}
> public Boolean visit(And and) {
> return and.getLeft().accept(this) || and.getRight().accept(this);
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
