baibaichen opened a new pull request, #11908:
URL: https://github.com/apache/gluten/pull/11908
### What changes were proposed in this pull request?
Enable Python-related test suites and fix issues for Spark 4.1:
**ArrowEvalPythonExecSuite** — Remove `testWithMaxSparkVersion("4.0")`
restriction on 3 `arrow_udf` tests. The underlying issues have been resolved.
**GlutenRowQueueSuite** — Enable (spark41-only, 7/7 passed).
**GlutenPythonUDFSuite** — Enable with `testGluten` override for
`SPARK-48706`. The original test uses `this.getClass.getSimpleName` in
`ExpectedContext` pattern which returns `GlutenPythonUDFSuite` but the actual
`callSite` records `PythonUDFSuite`. The `testGluten` fixes the pattern.
**GlutenPythonDataSourceSuite** — Enable. All 23 tests cancel via
`assume(shouldTestPythonUDFs)` when Python is not available (no CI failure).
**GlutenPythonUDTFSuite** — Fix to properly extend `PythonUDTFSuite` (was an
empty class). Enable. Tests cancel without Python.
### How was this patch tested?
- GlutenRowQueueSuite verified on spark41 (7/7 passed)
- GlutenPythonUDFSuite verified on spark41 (7 passed, 1 excluded with
testGluten replacement, 2 canceled)
- Other suites cancel gracefully without Python environment
Related issue: #11550
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
