[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053917#comment-15053917
]
holdenk commented on SPARK-2870:
So this seems to be resolved in Spark 1.6 with `createDataFrame`
e.g.:
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053922#comment-15053922
]
holdenk commented on SPARK-2870:
Note: I discovered a related issue (namely schema inferance on a local
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053977#comment-15053977
]
Nicholas Chammas commented on SPARK-2870:
-
> Do you think its OK to close this issue?
I haven't
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053131#comment-15053131
]
Nicholas Chammas commented on SPARK-2870:
-
Go for it. I don't think anyone else is.
> Thorough
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053177#comment-15053177
]
holdenk commented on SPARK-2870:
Great :)
> Thorough schema inference directly on RDDs of Python
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15054024#comment-15054024
]
holdenk commented on SPARK-2870:
I think it will work fine (I mean schema inferance on RDD of dicts works
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051696#comment-15051696
]
holdenk commented on SPARK-2870:
I can take a crack at implementing this if no one else is planning too.
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539255#comment-14539255
]
Nicholas Chammas commented on SPARK-2870:
-
Another use case for this feature is
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537324#comment-14537324
]
Nicholas Chammas commented on SPARK-2870:
-
cc [~rxin] - Are we still targeting
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164342#comment-14164342
]
Davies Liu commented on SPARK-2870:
---
[~nchammas] There is something different from
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156904#comment-14156904
]
Nicholas Chammas commented on SPARK-2870:
-
[~marmbrus] - A related feature that I
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145192#comment-14145192
]
Michael Armbrust commented on SPARK-2870:
-
Yeah, though we might want to benchmark
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143720#comment-14143720
]
Nicholas Chammas commented on SPARK-2870:
-
[~marmbrus] - API-wise, how are you
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116868#comment-14116868
]
Nicholas Chammas commented on SPARK-2870:
-
[~marmbrus], [~davies], [~yhuai] - We
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116915#comment-14116915
]
Michael Armbrust commented on SPARK-2870:
-
Yeah, thanks for pinging me. I've
15 matches
Mail list logo
