asubiotto opened a new pull request, #12070: URL: https://github.com/apache/arrow-rs/pull/12070
# Which issue does this PR close? - Part of apache/arrow-rs#12069 # Rationale for this change No IPC reader benchmark covers streams with many dictionary batches, where the reader looks up each dictionary's field in the schema. Per [CONTRIBUTING.md](https://github.com/apache/arrow-rs/blob/main/CONTRIBUTING.md#performance-improvements), this lands ahead of the optimization so it can run on the benchmark runner. # What changes are included in this PR? Adds `StreamReader/dictionaries_1000/{flat,nested}`: a stream with one batch of 1000 dictionary columns, either top-level or as `List` items. # Are these changes tested? Benchmark only. # Are there any significant user-facing changes? No. The benchmark was written with AI assistance (Claude) and reviewed by me. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
