[ 
https://issues.apache.org/jira/browse/SPARK-61327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruifeng Zheng reassigned SPARK-61327:
-------------------------------------

    Assignee: Ruifeng Zheng

> Install PyArrow in the Python 3.15 CI image
> -------------------------------------------
>
>                 Key: SPARK-61327
>                 URL: https://issues.apache.org/jira/browse/SPARK-61327
>             Project: Spark
>          Issue Type: Improvement
>          Components: Project Infra, PySpark
>    Affects Versions: 5.0.0
>            Reporter: Ruifeng Zheng
>            Assignee: Ruifeng Zheng
>            Priority: Major
>              Labels: pull-request-available
>
> PyArrow 26.x now publishes CPython 3.15 Linux wheels, so Spark can install 
> PyArrow in its Python 3.15 CI image.
> Add PyArrow to the image to enable Arrow-dependent test coverage and resolve 
> Python 3.15 CI failures caused by the missing PyArrow dependency. Pandas 
> remains excluded because the standard CI dependency groups require pandas 2.x.
> The draft PR temporarily selects python-315 and python3.15 in 
> build_and_test.yml to validate the image. Restore the standard workflow 
> defaults before the PR is ready for review.
> PR: https://github.com/apache/spark/pull/60237
> Validation: the Python 3.15 image build passed in 
> https://github.com/zhengruifeng/spark/actions/runs/42609398311/job/129139730018
>  . This verifies the image build; it does not establish that every Spark test 
> passes.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to