[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-02-10 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r573821798 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/BaseScriptTransformationExec.scala ## @@ -47,7 +47,13 @@ trait

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-02-05 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r571034491 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/BaseScriptTransformationExec.scala ## @@ -220,6 +226,9 @@ trait

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-02-05 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r571032751 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/BaseScriptTransformationExec.scala ## @@ -47,7 +47,13 @@ trait

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-02-05 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r571030139 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/BaseScriptTransformationExec.scala ## @@ -47,7 +47,13 @@ trait

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-02-05 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r571029633 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/BaseScriptTransformationSuite.scala ## @@ -471,6 +473,126 @@ abstract class

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-02-05 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r570718578 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/CatalystTypeConverters.scala ## @@ -174,6 +174,7 @@ object CatalystTypeConverters

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-02-05 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r570776893 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/BaseScriptTransformationSuite.scala ## @@ -471,6 +473,126 @@ abstract class

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-02-04 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r570731954 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/BaseScriptTransformationExec.scala ## @@ -47,7 +47,13 @@ trait

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-02-04 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r570718578 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/CatalystTypeConverters.scala ## @@ -174,6 +174,7 @@ object CatalystTypeConverters

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-01-04 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r551742459 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkInspectors.scala ## @@ -0,0 +1,259 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-01-04 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r551742459 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkInspectors.scala ## @@ -0,0 +1,259 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-01-04 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r551738592 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/BaseScriptTransformationExec.scala ## @@ -329,14 +332,45 @@ case class

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2020-12-30 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r550228619 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/BaseScriptTransformationExec.scala ## @@ -329,14 +332,45 @@ case class

[GitHub] [spark] maropu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2020-12-30 Thread GitBox
maropu commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r550211324 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkInspectors.scala ## @@ -0,0 +1,259 @@ +/* + * Licensed to the Apache Software