[
https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler updated SPARK-23874:
---------------------------------
Description:
Version 0.10.0 will allow for the following improvements and bug fixes:
* Allow for adding BinaryType support
* Bug fix related to array serialization
[ARROW-1973|https://issues.apache.org/jira/browse/ARROW-1973]
* Python2 str will be made into an Arrow string instead of bytes
[ARROW-2101|https://issues.apache.org/jira/browse/ARROW-2101]
* Python bytearrays are supported in as input to pyarrow
[ARROW-2141|https://issues.apache.org/jira/browse/ARROW-2141]
* Java has common interface for reset to cleanup complex vectors in Spark
ArrowWriter [ARROW-1962|https://issues.apache.org/jira/browse/ARROW-1962]
* Cleanup pyarrow type equality checks
[ARROW-2423|https://issues.apache.org/jira/browse/ARROW-2423]
was:
Version 0.9.0 of apache arrow comes with a bug fix related to array
serialization.
https://issues.apache.org/jira/browse/ARROW-1973
> Upgrade apache/arrow to 0.10.0
> ------------------------------
>
> Key: SPARK-23874
> URL: https://issues.apache.org/jira/browse/SPARK-23874
> Project: Spark
> Issue Type: Improvement
> Components: PySpark
> Affects Versions: 2.3.0
> Reporter: Xiao Li
> Assignee: Bryan Cutler
> Priority: Major
>
> Version 0.10.0 will allow for the following improvements and bug fixes:
> * Allow for adding BinaryType support
> * Bug fix related to array serialization
> [ARROW-1973|https://issues.apache.org/jira/browse/ARROW-1973]
> * Python2 str will be made into an Arrow string instead of bytes
> [ARROW-2101|https://issues.apache.org/jira/browse/ARROW-2101]
> * Python bytearrays are supported in as input to pyarrow
> [ARROW-2141|https://issues.apache.org/jira/browse/ARROW-2141]
> * Java has common interface for reset to cleanup complex vectors in Spark
> ArrowWriter [ARROW-1962|https://issues.apache.org/jira/browse/ARROW-1962]
> * Cleanup pyarrow type equality checks
> [ARROW-2423|https://issues.apache.org/jira/browse/ARROW-2423]
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
