[jira] [Commented] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

[ https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924573#comment-15924573 ] Nira Amit commented on SPARK-19424: --- [~hvanhovell] The solution would be to not ignore the "Unchecked

[jira] [Reopened] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

[ https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nira Amit reopened SPARK-19424: --- I managed to get my code to work, yes. The problem of the wrong type at runtime is not resolved,

[jira] [Reopened] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

[ https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nira Amit reopened SPARK-19424: --- Sean, I am not trying to piss you off but to investigate a problem. If your explanation is that it is

[jira] [Reopened] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

[ https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nira Amit reopened SPARK-19424: --- Re-opening this issue because throwing unexpected ClassCastExceptions is not an accepted behavior of a

[jira] [Commented] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896590#comment-15896590 ] Nira Amit commented on SPARK-19656: --- I will not, but please consider documenting the correct way to

[jira] [Commented] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896581#comment-15896581 ] Nira Amit commented on SPARK-19656: --- I found a problem in my schema and managed to load my custom type.

[jira] [Updated] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nira Amit updated SPARK-19656: -- Attachment: (was: datum2.png) > Can't load custom type from avro file to RDD with newAPIHadoopFile

[jira] [Issue Comment Deleted] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nira Amit updated SPARK-19656: -- Comment: was deleted (was: {code} public static class ABgoEventAvroReader extends

[jira] [Updated] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nira Amit updated SPARK-19656: -- Attachment: (was: datum.png) > Can't load custom type from avro file to RDD with newAPIHadoopFile

[jira] [Issue Comment Deleted] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nira Amit updated SPARK-19656: -- Comment: was deleted (was: [~srowen] Will you at least consider the possibility that I'm on to a real

[jira] [Updated] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nira Amit updated SPARK-19656: -- Attachment: datum2.png > Can't load custom type from avro file to RDD with newAPIHadoopFile >

[jira] [Updated] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nira Amit updated SPARK-19656: -- Attachment: datum.png {code} public static class ABgoEventAvroReader extends

[jira] [Reopened] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nira Amit reopened SPARK-19656: --- [~srowen] Will you at least consider the possibility that I'm on to a real problem here? I may be wrong

[jira] [Commented] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896314#comment-15896314 ] Nira Amit commented on SPARK-19656: --- And by the way, "what is in the file" is bytes. The question is

[jira] [Comment Edited] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896286#comment-15896286 ] Nira Amit edited comment on SPARK-19656 at 3/5/17 2:55 PM: --- But then why does

[jira] [Comment Edited] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896286#comment-15896286 ] Nira Amit edited comment on SPARK-19656 at 3/5/17 2:56 PM: --- But then why does

[jira] [Commented] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896286#comment-15896286 ] Nira Amit commented on SPARK-19656: --- But then why does the compiler accepts what newAPIHadoopFile

[jira] [Commented] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896277#comment-15896277 ] Nira Amit commented on SPARK-19656: --- The only reason my code sample doesn't compile is because it

[jira] [Commented] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896266#comment-15896266 ] Nira Amit commented on SPARK-19656: --- [~sowen] I have been trying this for weeks every way I could

[jira] [Commented] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896262#comment-15896262 ] Nira Amit commented on SPARK-19656: --- Thanks Eric, but my question is about RDDs. Is it correct that it

[jira] [Commented] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896179#comment-15896179 ] Nira Amit commented on SPARK-19656: --- Yes, I did, and answered him that it gives a compilation error in

[jira] [Commented] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896172#comment-15896172 ] Nira Amit commented on SPARK-19656: --- But if this is not possible to do in Java then it IS an actionable

[jira] [Commented] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896166#comment-15896166 ] Nira Amit commented on SPARK-19656: --- [~emaynard] There is no "asInstanceOf" method in the Java API. And

[jira] [Commented] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15873090#comment-15873090 ] Nira Amit commented on SPARK-19656: --- I also tried to do this without writing my own `AvroKey` and

[jira] [Created] (SPARK-19656) Can't load custom type from avro file to RDD with newAPIHadoopFile

Nira Amit created SPARK-19656: - Summary: Can't load custom type from avro file to RDD with newAPIHadoopFile Key: SPARK-19656 URL: https://issues.apache.org/jira/browse/SPARK-19656 Project: Spark

[jira] [Comment Edited] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

[ https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848981#comment-15848981 ] Nira Amit edited comment on SPARK-19424 at 2/1/17 11:04 PM: [~srowen] thanks

[jira] [Comment Edited] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

[ https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848981#comment-15848981 ] Nira Amit edited comment on SPARK-19424 at 2/1/17 11:03 PM: [~srowen] thanks

[jira] [Comment Edited] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

[ https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848981#comment-15848981 ] Nira Amit edited comment on SPARK-19424 at 2/1/17 11:00 PM: [~srowen] thanks

[jira] [Commented] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

[ https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848981#comment-15848981 ] Nira Amit commented on SPARK-19424: --- [~srowen] thanks for elaborating, but in that case I just can't

[jira] [Commented] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

[ https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848634#comment-15848634 ] Nira Amit commented on SPARK-19424: --- [~srowen] So shouldn't this give me a compilation error? I'm

[jira] [Commented] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

[ https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848478#comment-15848478 ] Nira Amit commented on SPARK-19424: --- I posted this question in StackOverflow with a workaround I'm

[jira] [Created] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

Nira Amit created SPARK-19424: - Summary: Wrong runtime type in RDD when reading from avro with custom serializer Key: SPARK-19424 URL: https://issues.apache.org/jira/browse/SPARK-19424 Project: Spark

[jira] [Comment Edited] (SPARK-18945) java.lang.ClassCastException when Tuple2 field is an array

[ https://issues.apache.org/jira/browse/SPARK-18945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15764163#comment-15764163 ] Nira Amit edited comment on SPARK-18945 at 12/20/16 1:03 PM: - There's a bug

[jira] [Closed] (SPARK-18945) java.lang.ClassCastException when Tuple2 field is an array

[ https://issues.apache.org/jira/browse/SPARK-18945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nira Amit closed SPARK-18945. - Resolution: Not A Problem There's a bug in my code > java.lang.ClassCastException when Tuple2 field is

[jira] [Created] (SPARK-18945) java.lang.ClassCastException when Tuple2 field is an array

Nira Amit created SPARK-18945: - Summary: java.lang.ClassCastException when Tuple2 field is an array Key: SPARK-18945 URL: https://issues.apache.org/jira/browse/SPARK-18945 Project: Spark Issue