This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new d272a1b4367e [SPARK-47724][PYTHON][TESTS] Add an environment variable
for testing remote pure Python library
d272a1b4367e is described below
commit d272a1b4367edac03ba1de91551573c8903dd8d8
Author: Hyukjin Kwon <gurwls...@apache.org>
AuthorDate: Thu Apr 4 12:15:11 2024 +0900
[SPARK-47724][PYTHON][TESTS] Add an environment variable for testing remote
pure Python library
### What changes were proposed in this pull request?
This PR proposes to add an environment variable called
`SPARK_CONNECT_TESTING_REMOTE` to set `remote` URL.
### Why are the changes needed?
In order to test pure Python library with a remote server.
### Does this PR introduce _any_ user-facing change?
No, test-only.
### How was this patch tested?
Manually tested.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #45868 from HyukjinKwon/SPARK-47724.
Authored-by: Hyukjin Kwon <gurwls...@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls...@apache.org>
---
python/pyspark/testing/connectutils.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/python/pyspark/testing/connectutils.py
b/python/pyspark/testing/connectutils.py
index bfe54b33f569..da6b861e925a 100644
--- a/python/pyspark/testing/connectutils.py
+++ b/python/pyspark/testing/connectutils.py
@@ -174,7 +174,7 @@ class ReusedConnectTestCase(unittest.TestCase,
SQLTestUtils, PySparkErrorTestUti
@classmethod
def master(cls):
- return "local[4]"
+ return os.environ.get("SPARK_CONNECT_TESTING_REMOTE", "local[4]")
@classmethod
def setUpClass(cls):
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
