HeartSaVioR opened a new pull request, #55214: URL: https://github.com/apache/spark/pull/55214
### What changes were proposed in this pull request? This PR proposes to provide better error with additional logging on NPE in stream-stream join. We have captured several places which could throw NPE - this PR provides the better error for users which is less cryptic and gives a quick mitigation if they are willing to tolerate losing some data to keep the query running. For devs, this PR leaves the context to the log, so that when users come to devs with the error, devs can at least know where to start looking into. ### Why are the changes needed? Throwing NPE does not help anything for users and devs. For users, NPE is mostly cryptic error and they know nothing what to do to mitigate the issue. There is no information around context, so debugging is almost impossible for devs when this happens. ### Does this PR introduce _any_ user-facing change? Yes, users would no longer get NPE from stream-stream join for known places on potential NPE, and will get better exception with the guidance for quick mitigation (toleration of data loss). ### How was this patch tested? Modified test ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude 4.6 Opus -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
