[PR] [SPARK-47199][PYTHON][TESTS] Add prefix into TemporaryDirectory to avoid flakiness [spark]

2024-02-27 Thread via GitHub
HyukjinKwon opened a new pull request, #45298: URL: https://github.com/apache/spark/pull/45298 ### What changes were proposed in this pull request? This PR proposes to set `prefix` for `TemporaryDirectory` to deflake the tests. Sometimes the test fail because the temporary directory n

Re: [PR] [SPARK-47199][PYTHON][TESTS] Add prefix into TemporaryDirectory to avoid flakiness [spark]

2024-02-27 Thread via GitHub
ueshin commented on code in PR #45298: URL: https://github.com/apache/spark/pull/45298#discussion_r1505232292 ## python/pyspark/sql/readwriter.py: ## @@ -400,7 +400,8 @@ def json( Example 2: Read JSON from multiple files in a directory >>> import tempfile -

Re: [PR] [SPARK-47199][PYTHON][TESTS] Add prefix into TemporaryDirectory to avoid flakiness [spark]

2024-02-27 Thread via GitHub
dongjoon-hyun closed pull request #45298: [SPARK-47199][PYTHON][TESTS] Add prefix into TemporaryDirectory to avoid flakiness URL: https://github.com/apache/spark/pull/45298 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [SPARK-47199][PYTHON][TESTS] Add prefix into TemporaryDirectory to avoid flakiness [spark]

2024-02-27 Thread via GitHub
dongjoon-hyun commented on PR #45298: URL: https://github.com/apache/spark/pull/45298#issuecomment-1968364450 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen