Mohan, I don’t think this is a Spark issue, rather, I think the issue is coming from your serializer. Can you point us to the serializer that you are using? We have no problems serializing complex Avro (nested schemas with unions and arrays) when using this serializer. You may also want to look into using the Avro serializer in Twitter’s Chill.
Regards, Frank Austin Nothaft [email protected] [email protected] 202-340-0466 On Sep 18, 2014, at 7:34 AM, mohan.gadm <[email protected]> wrote: > Added some more info on this issue in the tracker Spark-3447 > https://issues.apache.org/jira/browse/SPARK-3447 > > > > ----- > Thanks & Regards, > Mohan > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Kryo-fails-with-avro-having-Arrays-and-unions-but-succeeds-with-simple-avro-tp14549p14557.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] >
