felipepessoto opened a new pull request, #12967: URL: https://github.com/apache/gluten/pull/12967
## What changes are proposed in this pull request? Enable native `TIMESTAMP_NTZ` aggregation in the Velox backend: - Allow aggregate and shuffle operators, plus the projection expressions used by Delta statistics collection, through the `TIMESTAMP_NTZ` fallback validator. - Accept `TimestampNTZType` aggregate buffers. - Preserve `TIMESTAMP_NTZ` as a distinct `tsntz` function-signature type and as Substrait `PrecisionTimestamp`. - Add native min/max and Delta statistics regression coverage, including nested `TIMESTAMP_NTZ` columns. This prevents Delta's local statistics `SortAggregateExec` from falling back to a vanilla Spark plan and addresses the `TIMESTAMP_NTZ` failure described in #12538. This change is independent of #12966. ## How was this patch tested? - `cpp/build/velox/tests/velox_plan_conversion_test --gtest_filter='VeloxSubstraitSignatureTest.*:VeloxToSubstraitTypeTest.*:VeloxSubstraitRoundTripTest.minMaxTimestampUtc'` - `./build/mvn test -Pspark-ut -Pbackends-velox -Pspark-4.1 -Pscala-2.13 -Pjava-17 -Pdelta -DwildcardSuites=org.apache.spark.sql.GlutenTimestampNtzAggregateSuite` - `./build/mvn test -Pspark-ut -Pbackends-velox -Pspark-4.1 -Pscala-2.13 -Pjava-17 -Pdelta -DwildcardSuites=org.apache.spark.sql.delta.GlutenDeltaStatsSuite` - `./build/mvn test -Pspark-ut -Pbackends-velox -Pspark-3.5 -Pscala-2.12 -Pjava-17 -Pdelta -DwildcardSuites=org.apache.spark.sql.delta.GlutenDeltaStatsSuite` - `./build/mvn test -Pspark-ut -Pbackends-velox -Pspark-3.5 -Pscala-2.12 -Pjava-17 -Pdelta -DwildcardSuites=org.apache.gluten.functions.DateFunctionsValidateSuite` ## Was this patch authored or co-authored using generative AI tooling? Generated-by: GitHub Copilot CLI 1.0.82 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
