[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288423#comment-17288423
]
Sean R. Owen commented on SPARK-7768:
-
To be clear I just opened it. [~viirya] did much more actual
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288388#comment-17288388
]
Simeon H.K. Fitch commented on SPARK-7768:
--
[~srowen]Thanks so much for for all your excellent
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287739#comment-17287739
]
Patrick Grandjean commented on SPARK-7768:
--
Awesome! Thank you!!!
> Make user-defined type
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278094#comment-17278094
]
Apache Spark commented on SPARK-7768:
-
User 'srowen' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278093#comment-17278093
]
Apache Spark commented on SPARK-7768:
-
User 'srowen' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273955#comment-17273955
]
Patrick Grandjean commented on SPARK-7768:
--
Fine with me :) (y)
> Make user-defined type (UDT)
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273935#comment-17273935
]
Sean R. Owen commented on SPARK-7768:
-
I'm not aware of an argument against opening this up - just
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270256#comment-17270256
]
Simeon H.K. Fitch commented on SPARK-7768:
--
[~xkrogen] ♂️
> Make user-defined type (UDT)
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270235#comment-17270235
]
Erik Krogen commented on SPARK-7768:
[~metasim] you might want to start a discussion on
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270148#comment-17270148
]
Simeon H.K. Fitch commented on SPARK-7768:
--
Not being familiar with the Spark issue triage and
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269707#comment-17269707
]
Patrick Grandjean commented on SPARK-7768:
--
Sorry, but it is frustrating to see this ticket
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243847#comment-17243847
]
Hyukjin Kwon commented on SPARK-7768:
-
I am retargetting to 3.2.0.
> Make user-defined type (UDT)
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119054#comment-17119054
]
Erik Erlandson commented on SPARK-7768:
---
Are there any issues with making this kind of change on a
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610733#comment-16610733
]
Wenchen Fan commented on SPARK-7768:
I'm retargeting to 3.0. BTW is there any concerns about making
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592171#comment-16592171
]
Alexander commented on SPARK-7768:
--
Ah, looking at this SO post what I am asking about (i.e. accessing
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592128#comment-16592128
]
Alexander commented on SPARK-7768:
--
I've also noticed that there are some idiosyncracies in the
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592116#comment-16592116
]
Alexander commented on SPARK-7768:
--
[~pgrandjean], are you thinking of writing a library for that? :)
>
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590120#comment-16590120
]
Patrick Grandjean commented on SPARK-7768:
--
Thank you for sharing [~metasim] and [~eje]! It
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589151#comment-16589151
]
Alexander commented on SPARK-7768:
--
Spark Maintainers, [~viirya], [~jodersky], what do you think?
>
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589146#comment-16589146
]
Alexander commented on SPARK-7768:
--
Thanks [~eje] and [~metasim] for the awesome examples! I haven't
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588934#comment-16588934
]
Erik Erlandson commented on SPARK-7768:
---
We use `UserDefinedType`, for example here:
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588911#comment-16588911
]
Simeon H.K. Fitch commented on SPARK-7768:
--
Here's a synopsis of the issues with Encoder
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588906#comment-16588906
]
Simeon H.K. Fitch commented on SPARK-7768:
--
We use UDTs to great effect in
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588797#comment-16588797
]
Patrick Grandjean commented on SPARK-7768:
--
+1
> Make user-defined type (UDT) API public
>
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587928#comment-16587928
]
Alexander commented on SPARK-7768:
--
It's been a while since this had any activity. What is the
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036417#comment-16036417
]
Patrick Grandjean commented on SPARK-7768:
--
Thanks [~metasim]! This feature request was opened
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035356#comment-16035356
]
Simeon H.K. Fitch commented on SPARK-7768:
--
[~pgrandjean] Once a UDT is registered, the
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15999623#comment-15999623
]
Patrick Grandjean commented on SPARK-7768:
--
How does UDTRegistration interact with Encoders?
>
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842701#comment-15842701
]
Gregor Moehler commented on SPARK-7768:
---
+1 for UdtRegistration. Can we make it public for the next
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838812#comment-15838812
]
Randall Whitman commented on SPARK-7768:
OK, UserDefinedType with UdtRegistration should support
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15807248#comment-15807248
]
Liang-Chi Hsieh commented on SPARK-7768:
Hi Randall,
With the {{UDTRegistration}} added since
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806218#comment-15806218
]
Randall Whitman commented on SPARK-7768:
Would you mind commenting on how the updated UDT works
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806167#comment-15806167
]
Apache Spark commented on SPARK-7768:
-
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15797443#comment-15797443
]
Liang-Chi Hsieh commented on SPARK-7768:
I would like to push this forward and make
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303205#comment-15303205
]
Patrick Grandjean commented on SPARK-7768:
--
This seems promising:
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174807#comment-15174807
]
Jaka Jancar commented on SPARK-7768:
[~randallwhitman] UDT, not UDF:
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169380#comment-15169380
]
Randall Whitman commented on SPARK-7768:
Am I missing something?
As far as I can see, the
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168155#comment-15168155
]
Jakob Odersky commented on SPARK-7768:
--
[~marmbrus]
UDTs are public now (in Scala at least), can this
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949232#comment-14949232
]
John Muller commented on SPARK-7768:
Linking to other UDT enhancements
> Make user-defined type (UDT)
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612015#comment-14612015
]
Eron Wright commented on SPARK-7768:
-
Will this issue cover making VectorUDT public?
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612658#comment-14612658
]
Joseph K. Bradley commented on SPARK-7768:
--
Making VectorUDT public blocks on
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582871#comment-14582871
]
Patrick Grandjean commented on SPARK-7768:
--
Registering UDTs for existing classes
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555054#comment-14555054
]
Randall Whitman commented on SPARK-7768:
In looking into the current UDT developer
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555074#comment-14555074
]
Joseph K. Bradley commented on SPARK-7768:
--
Ideally, we would go a little a
[
https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555151#comment-14555151
]
Justin Uang commented on SPARK-7768:
Agreed. For example, we wanted to add a
45 matches
Mail list logo
