vishnuprakaz opened a new pull request, #17431:
URL: https://github.com/apache/iceberg/pull/17431
`ParquetMetricsRowGroupFilter` defers variant and nested types to post-scan
evaluation in
`eq`/`in`/`notNull` #14081, #14279 those columns have no primitive
row-group stats keyed
by the field id, so they can't be evaluated against stats. The ordered
predicates
`lt`/`ltEq`/`gt`/`gtEq` were missed: a variant/nested reference falls
through to
`valueCount == null -> ROWS_CANNOT_MATCH` and the row group is skipped,
which would
incorrectly drop matching rows.
This applies the same guard to the four ordered comparisons, mirroring
#14279.
Tested with `testVariantFieldLt/LtEq/Gt/GtEq`, which mirror the existing
variant `eq`/`in`
tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
