Hi Mohan, It’s a bit convoluted to follow in their source, but they essentially typedef KSerializer as being a KryoSerializer, and then their serializers all extend KSerializer. Spark should identify them properly as Kryo Serializers, but I haven’t tried it myself.
Regards, Frank Austin Nothaft [email protected] [email protected] 202-340-0466 On Sep 19, 2014, at 12:03 AM, mohan.gadm <[email protected]> wrote: > Thanks for the info frank. > Twitter's-chill avro serializer looks great. > But how does spark identifies it as serializer, as its not extending from > KryoSerializer. > (sorry scala is an alien lang for me). > > > > ----- > Thanks & Regards, > Mohan > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Kryo-fails-with-avro-having-Arrays-and-unions-but-succeeds-with-simple-avro-tp14549p14649.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] >
