neilconway opened a new pull request, #22070: URL: https://github.com/apache/datafusion/pull/22070
## Which issue does this PR close? - Closes #21880. ## Rationale for this change Now that `NullBuffer::union_many` has landed in arrow-rs 58.2, we can use it to simplify and speedup various places in DataFusion that were union'ing together > 2 null buffers. In such cases, `union_many` avoids the intermediate allocations that are done by repeated `union` calls. ## What changes are included in this PR? * Adopt `NullBuffer::union_many` throughout the codebase * Along the way, clean up `compute_null_mask` in the Spark crate to be more readable and avoid needlessly padding scalars out to arrays just to compute the null mask ## Are these changes tested? Yes, covered by existing tests. ## Are there any user-facing changes? No. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
