[GitHub] spark issue #22708: [SPARK-21402] Fix java array/map of structs deserializat...

2018-10-16 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/22708 Please modify the PR title and description accordingly. Thanks. --- - To unsubscribe, e-mail:

[GitHub] spark issue #22708: [SPARK-21402] Fix java array/map of structs deserializat...

2018-10-15 Thread vofque
Github user vofque commented on the issue: https://github.com/apache/spark/pull/22708 In a nutshell: First we calculate field ordinals of array elements using java bean field information (which doesn't guarantee any particular field order). Then we apply these ordinals to the

[GitHub] spark issue #22708: [SPARK-21402] Fix java array/map of structs deserializat...

2018-10-15 Thread vofque
Github user vofque commented on the issue: https://github.com/apache/spark/pull/22708 The original problem is described here: https://issues.apache.org/jira/browse/SPARK-21402 I'll try to explain what happens in detail. Let's consider this data structure: root

[GitHub] spark issue #22708: [SPARK-21402] Fix java array/map of structs deserializat...

2018-10-14 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/22708 Can you explain how this happens? Why thhe fields of structs get mixed up? --- - To unsubscribe, e-mail:

[GitHub] spark issue #22708: [Spark 21402] Fix java array/map of structs deserializat...

2018-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22708 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22708: [Spark 21402] Fix java array/map of structs deserializat...

2018-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22708 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22708: [Spark 21402] Fix java array/map of structs deserializat...

2018-10-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22708 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional