Re: Serialization error

2015-04-28 Thread Josh Elser
Hi Madhvi, Thanks for posting this. I'm not super familiar, but my hunch is that Spark requires objects that it works with to implement the Java Serializable interface. Accumulo deals with Key (and Value) through Hadoop's Writable interface (technically WritableComparable, but still stems fr

Re: Serialization error

2015-04-28 Thread vaibhav thapliyal
Hi josh, We solved it using the kryo serializer library to serialise the key class. Thanks vaibhav On 28-Apr-2015 11:14 pm, "Josh Elser" wrote: > Hi Madhvi, > > Thanks for posting this. I'm not super familiar, but my hunch is that > Spark requires objects that it works with to implement the Jav

Re: Serialization error

2015-04-28 Thread Josh Elser
Thanks for the report back, Vaibhav. To clarify, did you have to write code to do the serialization with Kryo or was this something that Kryo could do automatically. If you could expand on the steps you took, that'd be awesome as I assume it will be extremely helpful in the mail archives for