crepererum opened a new pull request, #16783: URL: https://github.com/apache/datafusion/pull/16783
## Which issue does this PR close? \- ## Rationale for this change There are valid cases where files are pre-sorted on nullable columns. Arrow and DataFusion have proper semantic for that. ## What changes are included in this PR? Removes an exception / special-handling for nullable columns. The Arrow row encoder that is used in the respective code fully supports nullable columns (or at least it will cleanly fail if it doesn't), INCLUDING nulls-first&last. ## Are these changes tested? Regression test (added in 1st commit, fixed in 2nd commit) ## Are there any user-facing changes? Some queries are now faster. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
