This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new 38258a5695bb [SPARK-52077][PYTHON][CONNECT][TEST] Skip
ArrowUDTFParityTests in Spark Connect compatibility test
38258a5695bb is described below
commit 38258a5695bb7e6ba548b0aacc8a9553feee80ab
Author: Hyukjin Kwon <gurwls...@apache.org>
AuthorDate: Mon May 12 18:28:08 2025 +0900
[SPARK-52077][PYTHON][CONNECT][TEST] Skip ArrowUDTFParityTests in Spark
Connect compatibility test
### What changes were proposed in this pull request?
This PR proposes to skip ArrowUDTFParityTests in Spark Connect
compatibility test for now.
### Why are the changes needed?
After https://github.com/apache/spark/pull/50099, the compatibility test
fails https://github.com/apache/spark/actions/runs/14959668798/job/42019945629
In fact, UDTF with Arrow is still under development so we can skip the
tests for now
### Does this PR introduce _any_ user-facing change?
No, test-only.
### How was this patch tested?
Will monitor the build.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #50856 from HyukjinKwon/SPARK-44856-followup.
Authored-by: Hyukjin Kwon <gurwls...@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls...@apache.org>
(cherry picked from commit dfc817502dfb89d70ee6757622e6cff8a2cb769f)
Signed-off-by: Hyukjin Kwon <gurwls...@apache.org>
---
python/pyspark/sql/tests/connect/test_parity_udtf.py | 4 ++++
1 file changed, 4 insertions(+)
diff --git a/python/pyspark/sql/tests/connect/test_parity_udtf.py
b/python/pyspark/sql/tests/connect/test_parity_udtf.py
index ebf7692a20cd..e8397fe58e65 100644
--- a/python/pyspark/sql/tests/connect/test_parity_udtf.py
+++ b/python/pyspark/sql/tests/connect/test_parity_udtf.py
@@ -132,6 +132,10 @@ class UDTFParityTests(BaseUDTFTestsMixin,
ReusedConnectTestCase):
super(UDTFParityTests, self).test_udtf_with_wrong_num_input()
+@unittest.skipIf(
+ os.environ.get("SPARK_SKIP_CONNECT_COMPAT_TESTS") == "1",
+ "Python UDTF with Arrow is still under development.",
+)
class ArrowUDTFParityTests(UDTFArrowTestsMixin, UDTFParityTests):
@classmethod
def setUpClass(cls):
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
