andygrove opened a new issue, #4966: URL: https://github.com/apache/datafusion-comet/issues/4966
Spark 4.2 (SPARK-57298) makes `collect_set` normalize `NaN` and `-0.0` for floating-point types. Comet's native `collect_set` aggregate does not perform this normalization, so results differ from Spark. Failing Spark SQL test (currently marked `IgnoreComet` in `dev/diffs/4.2.0.diff`): - `DataFrameAggregateSuite`: "SPARK-57298: collect_set normalizes NaN and -0.0 for floating-point types" Note: the array-expression normalization path (`array_distinct` / `array_except`) is already handled; this issue tracks the aggregate `collect_set` path. Part of #4142 (Track Spark 4.2 test failures). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
