You need to do few more things or you will eventually run into these issues

val conf = new SparkConf()
      .set("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
*      .set("spark.kryoserializer.buffer.mb",
arguments.get("buffersize").get)*
*      .set("spark.kryoserializer.buffer.max.mb",
arguments.get("maxbuffersize").get)*
.registerKryoClasses(Array(classOf[com.ebay.ep.poc.spark.reporting.process.model.dw.SpsLevelMetricSum]))

-Deepak

On Mon, Apr 13, 2015 at 1:19 PM, mehdisinger <mehdi.sin...@lampiris.be>
wrote:

>  Hello,
>
>
>
> Thank you for your answer.
>
>
>
> I’m already registering my classes as you’re suggesting…
>
>
>
> Regards
>
>
>
> *De :* tsingfu [via Apache Spark User List] [mailto:ml-node+[hidden email]
> <http:///user/SendEmail.jtp?type=node&node=22471&i=0>]
> *Envoyé :* lundi 13 avril 2015 03:48
> *À :* Mehdi Singer
> *Objet :* Re: Kryo exception : Encountered unregistered class ID: 13994
>
>
>
> Hi,
> error message is mentioned:
> >com.esotericsoftware.kryo.KryoException: Encountered unregistered class
> ID: 13994
>
> So I think this is issue with kryo, You should use
> `kryo.register(classOf[your_class_name])` in your app code.
>
>  ------------------------------
>
> *If you reply to this email, your message will be added to the discussion
> below:*
>
>
> http://apache-spark-user-list.1001560.n3.nabble.com/Kryo-exception-Encountered-unregistered-class-ID-13994-tp22437p22468.html
>
> To unsubscribe from Kryo exception : Encountered unregistered class ID:
> 13994, click here.
> NAML
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
> ------------------------------
> View this message in context: RE: Kryo exception : Encountered
> unregistered class ID: 13994
> <http://apache-spark-user-list.1001560.n3.nabble.com/Kryo-exception-Encountered-unregistered-class-ID-13994-tp22437p22471.html>
>
> Sent from the Apache Spark User List mailing list archive
> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
>



-- 
Deepak

Reply via email to