This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 77aab6edb7c [SPARK-44557][INFRA] Clean up untracked/ignored files
before running pip packaging test in GitHub Actions
77aab6edb7c is described below
commit 77aab6edb7c2b7be54cb19d40c0eeeb2c699f0f7
Author: Hyukjin Kwon <gurwls...@apache.org>
AuthorDate: Thu Jul 27 14:08:09 2023 +0900
[SPARK-44557][INFRA] Clean up untracked/ignored files before running pip
packaging test in GitHub Actions
### What changes were proposed in this pull request?
This PR proposes to remove untracked/ignored files before running pip
packaging test in GitHub Actions.
### Why are the changes needed?
In order to fix the flakiness in the test such as:
```
...
creating dist
Creating tar archive
error: [Errno 28] No space left on device
Cleaning up temporary directory - /tmp/tmp.CvSzgB7Kyy
```
See also
https://github.com/apache/spark/actions/runs/5665869112/job/15351515539.
### Does this PR introduce _any_ user-facing change?
No, test-only.
### How was this patch tested?
GitHub Actions build in this PR.
Closes #42159 from HyukjinKwon/debug-ci-failure.
Lead-authored-by: Hyukjin Kwon <gurwls...@apache.org>
Co-authored-by: Hyukjin Kwon <gurwls...@gmail.com>
Signed-off-by: Hyukjin Kwon <gurwls...@apache.org>
---
dev/run-pip-tests | 7 +++++++
1 file changed, 7 insertions(+)
diff --git a/dev/run-pip-tests b/dev/run-pip-tests
index 5da231495a2..773611d9d92 100755
--- a/dev/run-pip-tests
+++ b/dev/run-pip-tests
@@ -25,6 +25,13 @@ shopt -s nullglob
FWDIR="$(cd "$(dirname "$0")"/..; pwd)"
cd "$FWDIR"
+# Clean ignored/untracked files that do not need
+# for pip packaging test. Machines in GitHub Action do not have
+# enough space, see also SPARK-44557.
+if [[ ! -z "${GITHUB_ACTIONS}" ]]; then
+ git clean -d -f -x -e assembly
+fi
+
echo "Constructing virtual env for testing"
VIRTUALENV_BASE=$(mktemp -d)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
