[
https://issues.apache.org/jira/browse/SPARK-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967503#comment-14967503
]
Yuhang Chen commented on SPARK-9595:
------------------------------------
So you mean closures also support kryo? But I never add any kryo codes to them
and they worked just fine when kryo serializer was set in SparkConf, while the
receivers didn't. I got confused by that.
> Adding API to SparkConf for kryo serializers registration
> ---------------------------------------------------------
>
> Key: SPARK-9595
> URL: https://issues.apache.org/jira/browse/SPARK-9595
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.3.1, 1.4.1
> Reporter: Yuhang Chen
> Priority: Minor
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> Currently SparkConf has a registerKryoClasses API for kryo registration.
> However, this only works when you register classes. If you want to register
> customized kryo serializers, you'll have to extend the KryoSerializer class
> and write some codes.
> This is not only very inconvenient, but also require the registration to be
> done in compile-time, which is not always possible. Thus, I suggest another
> API to SparkConf for registering customized kryo serializers. It could be
> like this:
> def registerKryoSerializers(serializers: Map[Class[_], Serializer]): SparkConf
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
