rdtr opened a new pull request, #59407: URL: https://github.com/apache/spark/pull/59407
### What changes were proposed in this pull request? This PR adds an entry to the "Upgrading from Spark SQL 4.2 to 4.3" section of the SQL migration guide for https://github.com/apache/spark/pull/58030. Since that change, `corr` returns NULL instead of failing with `DIVIDE_BY_ZERO` in ANSI mode when either input column has zero variance over two or more rows. ### Why are the changes needed? https://github.com/apache/spark/pull/58030 is a user-facing change in ANSI mode, but the migration guide doesn't mention it. It is in branch-4.3, so it would be good to have the entry there as well before 4.3.0 is released. We noticed it in Apache Gluten, whose native engine (Velox) already returns NULL in this case: in ANSI mode, the results match Spark 4.3 but differ from Spark 4.2 and earlier. If you think the migration guide doesn't need this entry, please feel free to close this PR. ### Does this PR introduce _any_ user-facing change? No. Documentation only. ### How was this patch tested? Not tested. This PR only adds one line to the migration guide. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Code (Claude Opus 5.5) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
