[
https://issues.apache.org/jira/browse/SPARK-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14052035#comment-14052035
]
Michael Armbrust commented on SPARK-2010:
-----------------------------------------
I think probably the right thing to do here is use named tuples instead of
dictionaries as the python struct equivalent. Dictionaries can then be used for
maps. One issue here is that we will need to fix our pickling library used by
pyspark as it cannot serialize named tuples.
> Support for nested data in PySpark SQL
> --------------------------------------
>
> Key: SPARK-2010
> URL: https://issues.apache.org/jira/browse/SPARK-2010
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Michael Armbrust
> Assignee: Kan Zhang
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
