Ruifeng Zheng created SPARK-61327:
-------------------------------------
Summary: Install PyArrow in the Python 3.15 CI image
Key: SPARK-61327
URL: https://issues.apache.org/jira/browse/SPARK-61327
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 5.0.0
Reporter: Ruifeng Zheng
PyArrow 26.x now publishes CPython 3.15 Linux wheels, so Spark can install
PyArrow in its Python 3.15 CI image.
Add PyArrow to the image to enable Arrow-dependent test coverage and resolve
Python 3.15 CI failures caused by the missing PyArrow dependency. Pandas
remains excluded because the standard CI dependency groups require pandas 2.x.
The draft PR temporarily selects python-315 and python3.15 in
build_and_test.yml to validate the image. Restore the standard workflow
defaults before the PR is ready for review.
PR: https://github.com/apache/spark/pull/60237
Validation: the Python 3.15 image build passed in
https://github.com/zhengruifeng/spark/actions/runs/42609398311/job/129139730018
. This verifies the image build; it does not establish that every Spark test
passes.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]