[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288388#comment-17288388 ] Simeon H.K. Fitch commented on SPARK-7768: -- [~srowen]Thanks so much for for all your excellent

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270256#comment-17270256 ] Simeon H.K. Fitch commented on SPARK-7768: -- [~xkrogen] ‍♂️ > Make user-defined type (UDT)

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270148#comment-17270148 ] Simeon H.K. Fitch commented on SPARK-7768: -- Not being familiar with the Spark issue triage and

[jira] [Commented] (SPARK-13802) Fields order in Row(**kwargs) is not consistent with Schema.toInternal method

[ https://issues.apache.org/jira/browse/SPARK-13802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942906#comment-16942906 ] Simeon H.K. Fitch commented on SPARK-13802: --- Is there a workaround to this problem? Ordering

[jira] [Commented] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844802#comment-16844802 ] Simeon H.K. Fitch commented on SPARK-12823: --- Hi [~hyukjin.kwon], is there a commit associated

[jira] [Commented] (SPARK-23696) StructType.fromString swallows exceptions from DataType.fromJson

[ https://issues.apache.org/jira/browse/SPARK-23696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844808#comment-16844808 ] Simeon H.K. Fitch commented on SPARK-23696: --- [~hyukjin.kwon] is there a commit associated with

[jira] [Comment Edited] (SPARK-7768) Make user-defined type (UDT) API public

[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588911#comment-16588911 ] Simeon H.K. Fitch edited comment on SPARK-7768 at 8/22/18 2:25 PM: ---

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588911#comment-16588911 ] Simeon H.K. Fitch commented on SPARK-7768: -- Here's a synopsis of the issues with Encoder

[jira] [Comment Edited] (SPARK-7768) Make user-defined type (UDT) API public

[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588906#comment-16588906 ] Simeon H.K. Fitch edited comment on SPARK-7768 at 8/22/18 2:21 PM: --- We

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588906#comment-16588906 ] Simeon H.K. Fitch commented on SPARK-7768: -- We use UDTs to great effect in

[jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566948#comment-16566948 ] Simeon H.K. Fitch commented on SPARK-14540: --- Congratulations! A long, difficult haul... Cheers

[jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566945#comment-16566945 ] Simeon H.K. Fitch commented on SPARK-14220: ---

[jira] [Issue Comment Deleted] (SPARK-14220) Build and test Spark against Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon H.K. Fitch updated SPARK-14220: -- Comment: was deleted (was: (flag)(*)(*r)(*g)(*b)(*y):D(*y)(*b)(*g)(*r)(*)(flag) Way

[jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566942#comment-16566942 ] Simeon H.K. Fitch commented on SPARK-14220: ---

[jira] [Updated] (SPARK-24649) SparkUDF.unapply is not backwards compatable

[ https://issues.apache.org/jira/browse/SPARK-24649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon H.K. Fitch updated SPARK-24649: -- Priority: Minor (was: Major) > SparkUDF.unapply is not backwards compatable >

[jira] [Updated] (SPARK-24649) SparkUDF.unapply is not backwards compatable

[ https://issues.apache.org/jira/browse/SPARK-24649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon H.K. Fitch updated SPARK-24649: -- Description: The shape of the `ScalaUDF` case class changed in 2.3.0. A secondary

[jira] [Created] (SPARK-24649) SparkUDF.unapply is not backwards compatable

Simeon H.K. Fitch created SPARK-24649: - Summary: SparkUDF.unapply is not backwards compatable Key: SPARK-24649 URL: https://issues.apache.org/jira/browse/SPARK-24649 Project: Spark Issue

[jira] [Commented] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422189#comment-16422189 ] Simeon H.K. Fitch commented on SPARK-12823: --- [~gbarna]Nice! Thanks for sharing! > Cannot

[jira] [Commented] (SPARK-23696) StructType.fromString swallows exceptions from DataType.fromJson

[ https://issues.apache.org/jira/browse/SPARK-23696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401979#comment-16401979 ] Simeon H.K. Fitch commented on SPARK-23696: --- Not sure what you mean by "we", but I'm just using

[jira] [Created] (SPARK-23696) StructType.fromString swallows exceptions from DataType.fromJson

Simeon H.K. Fitch created SPARK-23696: - Summary: StructType.fromString swallows exceptions from DataType.fromJson Key: SPARK-23696 URL: https://issues.apache.org/jira/browse/SPARK-23696 Project:

[jira] [Comment Edited] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173702#comment-16173702 ] Simeon H.K. Fitch edited comment on SPARK-12823 at 9/20/17 7:16 PM:

[jira] [Commented] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173702#comment-16173702 ] Simeon H.K. Fitch commented on SPARK-12823: --- As a coda, it's interesting to note that you can

[jira] [Commented] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171735#comment-16171735 ] Simeon H.K. Fitch commented on SPARK-12823: --- [~cloud_fan] If the intent is to *not* support

[jira] [Comment Edited] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171668#comment-16171668 ] Simeon H.K. Fitch edited comment on SPARK-12823 at 9/19/17 1:47 PM:

[jira] [Comment Edited] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171668#comment-16171668 ] Simeon H.K. Fitch edited comment on SPARK-12823 at 9/19/17 1:30 PM:

[jira] [Comment Edited] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171668#comment-16171668 ] Simeon H.K. Fitch edited comment on SPARK-12823 at 9/19/17 1:24 PM:

[jira] [Comment Edited] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171668#comment-16171668 ] Simeon H.K. Fitch edited comment on SPARK-12823 at 9/19/17 1:22 PM:

[jira] [Commented] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171668#comment-16171668 ] Simeon H.K. Fitch commented on SPARK-12823: --- Here is a combined, runnable example:

[jira] [Comment Edited] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171668#comment-16171668 ] Simeon H.K. Fitch edited comment on SPARK-12823 at 9/19/17 1:21 PM:

[jira] [Comment Edited] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171627#comment-16171627 ] Simeon H.K. Fitch edited comment on SPARK-12823 at 9/19/17 12:53 PM: -

[jira] [Comment Edited] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171627#comment-16171627 ] Simeon H.K. Fitch edited comment on SPARK-12823 at 9/19/17 12:52 PM: -

[jira] [Comment Edited] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171627#comment-16171627 ] Simeon H.K. Fitch edited comment on SPARK-12823 at 9/19/17 12:52 PM: -

[jira] [Commented] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171627#comment-16171627 ] Simeon H.K. Fitch commented on SPARK-12823: --- When you say "Row", do you mean

[jira] [Comment Edited] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170540#comment-16170540 ] Simeon H.K. Fitch edited comment on SPARK-12823 at 9/18/17 7:33 PM:

[jira] [Commented] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170540#comment-16170540 ] Simeon H.K. Fitch commented on SPARK-12823: --- My suspicion is that the bug is

[jira] [Comment Edited] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170511#comment-16170511 ] Simeon H.K. Fitch edited comment on SPARK-12823 at 9/18/17 7:06 PM:

[jira] [Commented] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170511#comment-16170511 ] Simeon H.K. Fitch commented on SPARK-12823: --- Unfortunately, using a `TypedColumn` doesn't help

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035356#comment-16035356 ] Simeon H.K. Fitch commented on SPARK-7768: -- [~pgrandjean] Once a UDT is registered, the

[jira] [Updated] (SPARK-19515) `flat` property in `ExpressionEncoder` needs documentation

[ https://issues.apache.org/jira/browse/SPARK-19515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon H.K. Fitch updated SPARK-19515: -- Description: It would be helpful to understand the semantics of the `flat` property in

[jira] [Created] (SPARK-19515) `flat` property in `ExpressionEncoder` needs documentation

Simeon H.K. Fitch created SPARK-19515: - Summary: `flat` property in `ExpressionEncoder` needs documentation Key: SPARK-19515 URL: https://issues.apache.org/jira/browse/SPARK-19515 Project: Spark