[
https://issues.apache.org/jira/browse/SPARK-35755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-35755:
---------------------------------
Description: We set the upperbound of PyArrow at SPARK-33190 that's fixed
in SPARK-33189. With PyArrow 4.x, all PySpark tests pass too. So it should
better test higher versions which more people use. (was: We set the upperbound
of PyArrow at SPARK-33190 that's fixed in SPARK-33189. With PyArrow 3.x, all
PySpark tests pass too. So it should better test higher versions which more
people use.)
> Use PyArrow 4.x in GitHub Actions build
> ---------------------------------------
>
> Key: SPARK-35755
> URL: https://issues.apache.org/jira/browse/SPARK-35755
> Project: Spark
> Issue Type: Test
> Components: PySpark
> Affects Versions: 3.2.0
> Reporter: Hyukjin Kwon
> Assignee: Hyukjin Kwon
> Priority: Major
>
> We set the upperbound of PyArrow at SPARK-33190 that's fixed in SPARK-33189.
> With PyArrow 4.x, all PySpark tests pass too. So it should better test higher
> versions which more people use.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
