:* Thursday, Mar 26, 2015 3:23 PM
*To:* donhoff_h165612...@qq.com;
*Cc:* useruser@spark.apache.org;
*Subject: * Re: Serialization Problem in Spark Program
Try registering your MyObject[] with Kryo.
On 25 Mar 2015 13:17, donhoff_h 165612...@qq.com wrote:
Hi, experts
I wrote a very simple spark
Try registering your MyObject[] with Kryo.
On 25 Mar 2015 13:17, donhoff_h 165612...@qq.com wrote:
Hi, experts
I wrote a very simple spark program to test the KryoSerialization
function. The codes are as following:
object TestKryoSerialization {
def main(args: Array[String]) {
val
Hi, experts
I wrote a very simple spark program to test the KryoSerialization function. The
codes are as following:
object TestKryoSerialization {
def main(args: Array[String]) {
val conf = new SparkConf()
conf.set(spark.serializer, org.apache.spark.serializer.KryoSerializer)
you also need to register *array*s of MyObject. so change:
conf.registerKryoClasses(Array(classOf[MyObject]))
to
conf.registerKryoClasses(Array(classOf[MyObject], classOf[Array[MyObject]]))
On Wed, Mar 25, 2015 at 2:44 AM, donhoff_h 165612...@qq.com wrote:
Hi, experts
I wrote a very
