yes, you should register all three. The truth is, you only *need* to register classes that will get serialized -- either via RDD caching or in a shuffle. So if a type is only used as an intermediate inside a stage, you don't need to register it. But the overhead of registering extra classes is pretty minimal, so as long as you do this within reason, I think you're OK.
Imran On Thu, Apr 30, 2015 at 12:34 AM, 邓刚[技术中心] <triones.d...@vipshop.com> wrote: > Hi all > > We know that spark support Kryo serialization, suppose there is a > map function which map C to K,V(here C,K,V are instance of class C,K,V), > when we register kryo serialization, should I register all of these three > class? > > > > Best Wishes > > > > Triones Deng > > > > > > 本电子邮件可能为保密文件。如果阁下非电子邮件所指定之收件人，谨请立即通知本人。敬请阁下不要使用、保存、复印、打印、散布本电子邮件及其内容，或将其用于其他任何目的或向任何人披露。谢谢您的合作！ > This communication is intended only for the addressee(s) and may contain > information that is privileged and confidential. You are hereby notified > that, if you are not an intended recipient listed above, or an authorized > employee or agent of an addressee of this communication responsible for > delivering e-mail messages to an intended recipient, any dissemination, > distribution or reproduction of this communication (including any > attachments hereto) is strictly prohibited. If you have received this > communication in error, please notify us immediately by a reply e-mail > addressed to the sender and permanently delete the original e-mail > communication and any attachments from all storage devices without making > or otherwise retaining a copy. >
