Dandandan commented on PR #9574: URL: https://github.com/apache/arrow-rs/pull/9574#issuecomment-4092847608
> Is this similar to > > * [parquet: decoder-level dictionary filter pushdown for Parquet reader #9464](https://github.com/apache/arrow-rs/pull/9464) > Is this similar to > > * [parquet: decoder-level dictionary filter pushdown for Parquet reader #9464](https://github.com/apache/arrow-rs/pull/9464) No - this PR applies it to the dictionary (which is small thus fast) and avoids decompressing / decoding the data pages. The linked PR https://github.com/apache/arrow-rs/pull/9464 as far as I see tries to reuse the booleans from the predicate by gathering them back onto the rows. I think in case you only need to apply the rowfilter (and don't need the values) it could save materializing the values. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
