[
https://issues.apache.org/jira/browse/SPARK-26566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler updated SPARK-26566:
---------------------------------
Description:
_This is just a placeholder for now to collect what needs to be fixed when we
upgrade next time_
Version 0.12.0 includes the following:
* pyarrow open_stream deprecated, use ipc.open_stream, ARROW-4098
was:
Version 0.10.0 will allow for the following improvements and bug fixes:
* Allow for adding BinaryType support ARROW-2141
* Bug fix related to array serialization ARROW-1973
* Python2 str will be made into an Arrow string instead of bytes ARROW-2101
* Python bytearrays are supported in as input to pyarrow ARROW-2141
* Java has common interface for reset to cleanup complex vectors in Spark
ArrowWriter ARROW-1962
* Cleanup pyarrow type equality checks ARROW-2423
* ArrowStreamWriter should not hold references to ArrowBlocks ARROW-2632,
ARROW-2645
* Improved low level handling of messages for RecordBatch ARROW-2704
> Upgrade apache/arrow to 0.12.0
> ------------------------------
>
> Key: SPARK-26566
> URL: https://issues.apache.org/jira/browse/SPARK-26566
> Project: Spark
> Issue Type: Improvement
> Components: PySpark
> Affects Versions: 2.4.0
> Reporter: Bryan Cutler
> Priority: Major
>
> _This is just a placeholder for now to collect what needs to be fixed when we
> upgrade next time_
> Version 0.12.0 includes the following:
> * pyarrow open_stream deprecated, use ipc.open_stream, ARROW-4098
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
