This is an automated email from the ASF dual-hosted git repository.
assignuser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new e34d4c9376 GH-36199: [Python][CI][Spark] Update spark versions used on
our nightly tests (#36347)
e34d4c9376 is described below
commit e34d4c93761d4761f0df2626114927c80a81a87f
Author: Raúl Cumplido <[email protected]>
AuthorDate: Wed Aug 2 00:20:00 2023 +0200
GH-36199: [Python][CI][Spark] Update spark versions used on our nightly
tests (#36347)
### Rationale for this change
We are currently testing with very old or deprecated spark versions.
### What changes are included in this PR?
Update the spark versions to be tested.
### Are these changes tested?
They will via archery
### Are there any user-facing changes?
No
* Closes: #36199
Authored-by: Raúl Cumplido <[email protected]>
Signed-off-by: Jacob Wujciak-Jens <[email protected]>
---
dev/tasks/tasks.yml | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
diff --git a/dev/tasks/tasks.yml b/dev/tasks/tasks.yml
index 25bda38809..73b793162d 100644
--- a/dev/tasks/tasks.yml
+++ b/dev/tasks/tasks.yml
@@ -1588,9 +1588,9 @@ tasks:
image: conda-python-hdfs
{% endfor %}
-{% for python_version, spark_version, test_pyarrow_only, numpy_version in
[("3.8", "v3.1.2", "false", "latest"),
-
("3.9", "v3.2.0", "false", "1.23"),
-
("3.10", "master", "false", "latest")] %}
+{% for python_version, spark_version, test_pyarrow_only, numpy_version in
[("3.8", "v3.4.1", "false", "latest"),
+
("3.10", "v3.4.1", "false", "1.23"),
+
("3.11", "master", "false", "latest")] %}
test-conda-python-{{ python_version }}-spark-{{ spark_version }}:
ci: github
template: docker-tests/github.linux.yml
