alamb opened a new pull request, #25422: URL: https://github.com/apache/datafusion/pull/25422
## Which issue does this PR close? - Related to https://github.com/apache/arrow-rs/pull/10852 - Related to https://github.com/apache/arrow-rs/issues/10776 **DO NOT MERGE**: this PR exists only to run the DataFusion benchmarks against a pre-release arrow-rs branch. ## Rationale for this change https://github.com/apache/arrow-rs/pull/10852 changes how the parquet reader builds `RowSelection`s under the `Auto` row selection policy when predicate results are scattered. I want to measure its effect on ClickBench with `pushdown_filters` enabled. ## What changes are included in this PR? Based on #25335 (arrow/parquet 60.0.0), plus a `[patch.crates-io]` section pinning all arrow/parquet crates to https://github.com/alamb/arrow-rs/tree/adaptive-selector-60.0.0, which is the 60.0.0 tag with the four commits from apache/arrow-rs#10852 cherry-picked on top (commit `d4079008`). ## What is the testing strategy for this PR? Benchmarks only. Local results for ClickBench q24 with `datafusion.execution.parquet.pushdown_filters = true` (5 runs x 15 executions each, `profiling` profile) are in the review at https://github.com/apache/arrow-rs/pull/10852#pullrequestreview-5237237099: roughly 10% faster with the arrow-rs change. ## Are there any user-facing changes? No. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
