This is an automated email from the ASF dual-hosted git repository.
ruifengz pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 35e0e08acab1 [SPARK-51550][PYTHON][INFRA] Upgrade pyarrow to 19 for
PySpark on macOS
35e0e08acab1 is described below
commit 35e0e08acab1539f9984d1dbabe691fee07fbd98
Author: Ruifeng Zheng <ruife...@apache.org>
AuthorDate: Wed Mar 19 17:00:30 2025 +0800
[SPARK-51550][PYTHON][INFRA] Upgrade pyarrow to 19 for PySpark on macOS
### What changes were proposed in this pull request?
Upgrade pyarrow to 19 for PySpark on macOS
### Why are the changes needed?
to test against the latest pyarrow
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
ci and manually check in my local (macos)
### Was this patch authored or co-authored using generative AI tooling?
no
Closes #50322 from zhengruifeng/infra_macos_pyarrow.
Authored-by: Ruifeng Zheng <ruife...@apache.org>
Signed-off-by: Ruifeng Zheng <ruife...@apache.org>
---
.github/workflows/python_macos_test.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/.github/workflows/python_macos_test.yml
b/.github/workflows/python_macos_test.yml
index 2cffb68419e8..2cb3d8dd23b7 100644
--- a/.github/workflows/python_macos_test.yml
+++ b/.github/workflows/python_macos_test.yml
@@ -133,7 +133,7 @@ jobs:
run: |
python${{matrix.python}} -m pip install --ignore-installed
'blinker>=1.6.2'
python${{matrix.python}} -m pip install --ignore-installed
'six==1.16.0'
- python${{matrix.python}} -m pip install numpy 'pyarrow>=15.0.0'
'six==1.16.0' 'pandas==2.2.3' scipy 'plotly<6.0.0' 'mlflow>=2.8.1' coverage
matplotlib openpyxl 'memory-profiler>=0.61.0' 'scikit-learn>=1.3.2'
unittest-xml-reporting && \
+ python${{matrix.python}} -m pip install numpy 'pyarrow>=19.0.0'
'six==1.16.0' 'pandas==2.2.3' scipy 'plotly<6.0.0' 'mlflow>=2.8.1' coverage
matplotlib openpyxl 'memory-profiler>=0.61.0' 'scikit-learn>=1.3.2'
unittest-xml-reporting && \
python${{matrix.python}} -m pip install 'grpcio==1.67.0'
'grpcio-status==1.67.0' 'protobuf==5.29.1' 'googleapis-common-protos==1.65.0'
'graphviz==0.20.3' && \
python${{matrix.python}} -m pip cache purge
- name: List Python packages
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
