Kryo serialization of classes in additional jars

[Akshat Aranya]

Hi,

Is it possible to register kryo serialization for classes contained in jars
that are added with "spark.jars"?  In my experiment it doesn't seem to
work, likely because the class registration happens before the jar is
shipped to the executor and added to the classloader.  Here's the general
idea of what I want to do:

   val sparkConf = new SparkConf(true)
      .set("spark.jars", "foo.jar")
      .setAppName("foo")
      .set("spark.serializer", "org.apache.spark.serializer.KryoSerializer")

// register classes contained in foo.jar
    sparkConf.registerKryoClasses(Array(
      classOf[com.foo.Foo],
      classOf[com.foo.Bar]))