You need to do few more things or you will eventually run into these issues
val conf = new SparkConf() .set("spark.serializer", "org.apache.spark.serializer.KryoSerializer") * .set("spark.kryoserializer.buffer.mb", arguments.get("buffersize").get)* * .set("spark.kryoserializer.buffer.max.mb", arguments.get("maxbuffersize").get)* .registerKryoClasses(Array(classOf[com.ebay.ep.poc.spark.reporting.process.model.dw.SpsLevelMetricSum])) -Deepak On Mon, Apr 13, 2015 at 1:19 PM, mehdisinger <mehdi.sin...@lampiris.be> wrote: > Hello, > > > > Thank you for your answer. > > > > I’m already registering my classes as you’re suggesting… > > > > Regards > > > > *De :* tsingfu [via Apache Spark User List] [mailto:ml-node+[hidden email] > <http:///user/SendEmail.jtp?type=node&node=22471&i=0>] > *Envoyé :* lundi 13 avril 2015 03:48 > *À :* Mehdi Singer > *Objet :* Re: Kryo exception : Encountered unregistered class ID: 13994 > > > > Hi, > error message is mentioned: > >com.esotericsoftware.kryo.KryoException: Encountered unregistered class > ID: 13994 > > So I think this is issue with kryo, You should use > `kryo.register(classOf[your_class_name])` in your app code. > > ------------------------------ > > *If you reply to this email, your message will be added to the discussion > below:* > > > http://apache-spark-user-list.1001560.n3.nabble.com/Kryo-exception-Encountered-unregistered-class-ID-13994-tp22437p22468.html > > To unsubscribe from Kryo exception : Encountered unregistered class ID: > 13994, click here. > NAML > <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > > ------------------------------ > View this message in context: RE: Kryo exception : Encountered > unregistered class ID: 13994 > <http://apache-spark-user-list.1001560.n3.nabble.com/Kryo-exception-Encountered-unregistered-class-ID-13994-tp22437p22471.html> > > Sent from the Apache Spark User List mailing list archive > <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com. > -- Deepak