Alwaysgaurav1 opened a new pull request, #57292: URL: https://github.com/apache/spark/pull/57292
### What changes were proposed in this pull request? This PR standardizes the PySpark Pandas and Arrow UDF row-count mismatch errors to use the consolidation error class `RESULT_ROWS_MISMATCH` instead of the UDF-specific `SCHEMA_MISMATCH_FOR_PANDAS_UDF`. Specifically, the changes: 1. Migrate verification checks in `worker.py` to use `RESULT_ROWS_MISMATCH` with input/output length parameters. 2. Retain the old error message format in the raised exception string to ensure backward-compatibility for user code verifying exception text. 3. Update `error-conditions.json`, development debugging documentation, and associated unit tests. ### Why are the changes needed? To consolidate and standardize PySpark's internal error class definitions under a unified system. ### Does this PR introduce _any_ user-facing change? No. The error class structure is updated, but the raised exception's string representation retains backward-compatible messaging. ### How was this patch tested? Updated and executed unit tests in `python/pyspark/sql/tests/pandas/test_pandas_udf_scalar.py`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
