[ 
https://issues.apache.org/jira/browse/SPARK-29493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972833#comment-16972833
 ] 

Bryan Cutler commented on SPARK-29493:
--------------------------------------

[~jalpan.randeri] this depends on SPARK-29376 for a newer version of Arrow. I 
was planning on doing this after because it might be a little tricky. If you 
want to take a look at SPARK-25351, I think that would be more straightforward 
to add.

> Add MapType support for Arrow Java
> ----------------------------------
>
>                 Key: SPARK-29493
>                 URL: https://issues.apache.org/jira/browse/SPARK-29493
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Bryan Cutler
>            Priority: Major
>
> This will add MapType support for Arrow in Spark ArrowConverters. This can 
> happen after the Arrow 0.15.0 upgrade, but MapType is not available in 
> pyarrow yet, so pyspark and pandas_udf will come later.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to