andygrove opened a new issue, #2649: URL: https://github.com/apache/datafusion-comet/issues/2649
### Describe the bug PR https://github.com/apache/datafusion-comet/pull/2634 fixed some bugs with `trunc`/`date_trunc`, but I found another bug with the new tests added as part of this PR. The tests pass when the Spark sessions timezone is `UTC`, but fail for other timezones. When reading from DataFrame: ``` org.apache.comet.CometNativeException: Fail to process Arrow array with reason: Invalid argument error: RowConverter column schema mismatch, expected Timestamp(Microsecond, Some("America/Denver")) got Timestamp(Microsecond, Some("UTC")). ``` When reading from Parquet: ``` == Results == !== Correct Answer - 1000 == == Spark Answer - 1000 == struct<c0:timestamp,date_trunc(quarter, c0):timestamp> struct<c0:timestamp,date_trunc(quarter, c0):timestamp> ![3332-12-03 10:00:59.158,3332-09-30 23:00:00.0] [3332-12-03 10:00:59.158,3332-10-01 00:00:00.0] ![3332-12-03 10:04:41.722,3332-09-30 23:00:00.0] [3332-12-03 10:04:41.722,3332-10-01 00:00:00.0] ![3332-12-03 10:26:05.153,3332-09-30 23:00:00.0] [3332-12-03 10:26:05.153,3332-10-01 00:00:00.0] ``` ### Steps to reproduce _No response_ ### Expected behavior _No response_ ### Additional context _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
