sam-1112 commented on PR #5802: URL: https://github.com/apache/datafusion-comet/pull/5802#issuecomment-6892052814
After #6110 merged, I commit 0a13f5572 to reflect the separation between JVM columnar shuffle and native expression support. JVM columnar shuffle remains eligible independently of the MapSort dispatcher setting. I added `auto`-mode coverage for both dispatcher settings, including exact Spark partition-ID parity checks, and updated the documentation and benchmark descriptions accordingly. I also opened [#7632](https://github.com/apache/datafusion-comet/issues/7632) as a follow-up for implementing MapSort directly in Rust for struct and array map keys. That native implementation can proceed independently of this PR, which provides the opt-in JVM codegen dispatcher route. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
