[
https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103076#comment-15103076
]
Apache Spark commented on SPARK-10735:
--
User 'davies' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906862#comment-14906862
]
Thomas Graves commented on SPARK-10735:
---
The issue here appears to be that in spark 1.4.1 it would
[
https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906877#comment-14906877
]
Glenn Strycker commented on SPARK-10735:
This appears very similar to a problem I had earlier
[
https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906894#comment-14906894
]
Josh Rosen commented on SPARK-10735:
[~tgraves], Spark 1.5.0 is stricter in its enforcement of types
[
https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906870#comment-14906870
]
Thomas Graves commented on SPARK-10735:
---
[~joshrosen] it appears you did some of the refactoring
[
https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906931#comment-14906931
]
Thomas Graves commented on SPARK-10735:
---
They are using SQLContext.createDataFrame(RDD, Class)
[
https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906936#comment-14906936
]
Josh Rosen commented on SPARK-10735:
While UserDefinedType is currently exposed as {{@DeveloperAPI}}
[
https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907011#comment-14907011
]
Josh Rosen commented on SPARK-10735:
I would _not_ recommend using UserDefinedType. UDT was intended
[
https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907072#comment-14907072
]
Thomas Graves commented on SPARK-10735:
---
print schema for this shows:
|-- beaconIds: array
[
https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906962#comment-14906962
]
Thomas Graves commented on SPARK-10735:
---
It looks like there code created the dataframe but after
10 matches
Mail list logo