Lianhui Wang created SPARK-5470:
-----------------------------------
Summary: use defaultClassLoader of Serializer to load classes of
classesToRegister in KryoSerializer
Key: SPARK-5470
URL: https://issues.apache.org/jira/browse/SPARK-5470
Project: Spark
Issue Type: Bug
Components: Spark Core
Reporter: Lianhui Wang
Now KryoSerializer load classes of classesToRegister at the time of its
initialization. when we set spark.kryo.classesToRegister=class1, it will throw
SparkException("Failed to load class to register with Kryo".
because in KryoSerializer's initialization, classLoader cannot include class of
user's jars.
we need to use defaultClassLoader of Serializer in newKryo(), because executor
will reset defaultClassLoader of Serializer after Serializer's initialization.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
