[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850003#comment-16850003
]
Michael Heuer commented on SPARK-25588:
---
Note a fix for this issue has been merged upstream in
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761734#comment-16761734
]
Nandor Kollar commented on SPARK-25588:
---
[~rdakshin] the stacktrace you get is unrelated to this
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747343#comment-16747343
]
Dakshin Rajavel commented on SPARK-25588:
-
[~heuermh] - I upgraded spark to 2.4 since I wanted
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674689#comment-16674689
]
Wenchen Fan commented on SPARK-25588:
-
This looks like a parquet bug when it interacts with avro. I
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674066#comment-16674066
]
antonkulaga commented on SPARK-25588:
-
Any updates on this? This bug blocks ADAM library and hence
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659990#comment-16659990
]
Michael Heuer commented on SPARK-25588:
---
> Can you try to downgrade parquet and see if the problem
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654493#comment-16654493
]
Wenchen Fan commented on SPARK-25588:
-
sounds like the problem is caused by the parquet upgrade in
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654400#comment-16654400
]
Michael Heuer commented on SPARK-25588:
---
[~Gengliang.Wang] The unit test provided is only an
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651207#comment-16651207
]
Gengliang Wang commented on SPARK-25588:
[~heuermh] I checkout Spark code with tag v2.3.1, and
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651180#comment-16651180
]
Gengliang Wang commented on SPARK-25588:
Saw similar issue in Parquet 1.10:
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651152#comment-16651152
]
Gengliang Wang commented on SPARK-25588:
[~srowen] I tried the test case in branch-2.3, which
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651081#comment-16651081
]
Apache Spark commented on SPARK-25588:
--
User 'heuermh' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651080#comment-16651080
]
Michael Heuer commented on SPARK-25588:
---
Created pull request
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646027#comment-16646027
]
Michael Heuer commented on SPARK-25588:
---
Here is a generic unit test that demonstrates the issue.
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645919#comment-16645919
]
Sean Owen commented on SPARK-25588:
---
Is this likely due to the update from Avro 1.7.x to 1.8.x? I
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645867#comment-16645867
]
Wenchen Fan commented on SPARK-25588:
-
[~heuermh] is there a way to demonstrate the problem without
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645295#comment-16645295
]
Michael Heuer commented on SPARK-25588:
---
I've reported an issue against Parquet with additional
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645294#comment-16645294
]
Michael Heuer commented on SPARK-25588:
---
[~cloud_fan] I'm curious to how this issue should be
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642200#comment-16642200
]
Michael Heuer commented on SPARK-25588:
---
I moved the version back to 2.3.2, see
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638226#comment-16638226
]
Michael Heuer commented on SPARK-25588:
---
> Looking at the stack trace, it seems like we are using
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638151#comment-16638151
]
Wenchen Fan commented on SPARK-25588:
-
The code snippet is a little hard to understand without
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638155#comment-16638155
]
Wenchen Fan commented on SPARK-25588:
-
BTW is it possible that ADAM has some problem with avro
22 matches
Mail list logo
