[
https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16452666#comment-16452666
]
Bryan Cutler commented on SPARK-23874:
--------------------------------------
[~smilegator] the Arrow community decided to put their efforts towards a 0.10.0
release instead of 0.9.1. Yes, it's possible there could be a regression, but
its also possible that a bug was fixed that just hasn't surfaced yet. I'll
pick this up again after the release, do thorough testing, and we can decide it
we will do the upgrade then.
> Upgrade apache/arrow to 0.10.0
> ------------------------------
>
> Key: SPARK-23874
> URL: https://issues.apache.org/jira/browse/SPARK-23874
> Project: Spark
> Issue Type: Improvement
> Components: PySpark
> Affects Versions: 2.3.0
> Reporter: Xiao Li
> Assignee: Bryan Cutler
> Priority: Major
>
> Version 0.9.0 of apache arrow comes with a bug fix related to array
> serialization.
> https://issues.apache.org/jira/browse/ARROW-1973
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
