Re: [PR] PySpark worker pool crash resilience [spark]

2024-03-25 Thread via GitHub
HyukjinKwon commented on PR #45635: URL: https://github.com/apache/spark/pull/45635#issuecomment-2019204500 Apache Spark uses the GitHub Actions in your forked repository so the builds have to be found in https://github.com/sebastianhillig-db/spark/actions . The GitHub Actions would have to

Re: [PR] PySpark worker pool crash resilience [spark]

2024-03-25 Thread via GitHub
HyukjinKwon commented on code in PR #45635: URL: https://github.com/apache/spark/pull/45635#discussion_r1538459016 ## python/pyspark/tests/test_worker.py: ## @@ -256,6 +257,20 @@ def conf(cls): return _conf +class WorkerPoolCrashTest(PySparkTestCase): +def test_

Re: [PR] PySpark worker pool crash resilience [spark]

2024-03-25 Thread via GitHub
HyukjinKwon commented on PR #45635: URL: https://github.com/apache/spark/pull/45635#issuecomment-2019202983 Let's file a JIRA, see https://spark.apache.org/contributing.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] PySpark worker pool crash resilience [spark]

2024-03-25 Thread via GitHub
sebastianhillig-db commented on PR #45635: URL: https://github.com/apache/spark/pull/45635#issuecomment-2018302912 @ueshin @HyukjinKwon can you take a look here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL