YutaLin opened a new pull request, #4398: URL: https://github.com/apache/datafusion-comet/pull/4398
## Which issue does this PR close? Closes #4396. ## Rationale for this change Support shuffle for TimeType, include native and JVM columnar ## What changes are included in this PR? * Add TimeType supported in `CometShuffleExchangeExec.scala`, so the planner will offload a shuffle carrying a TimeType column instead of fallback * Add Time64(Nanosecond) arms to the hasher, hasing as i64, in `hash_funcs/utils.rs` * Add Time64(Nanosecond) handling at UnsafeRow -> Arrow Dispatch sites in `spark_unsafe/row.rs`, `spark_unsafe/list.rs` * Add `shuffle_time.sql` for test shuffle only(no aggregate) ## How are these changes tested? run sql test in spark4.1, spark4.2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
