Re: implicit function in SparkStreaming

2015-04-29 Thread Tathagata Das
I believe that the implicit def is pulling in the enclosing class (in which the def is defined) in the closure which is not serializable. On Wed, Apr 29, 2015 at 4:20 AM, guoqing0...@yahoo.com.hk guoqing0...@yahoo.com.hk wrote: Hi guys, I`m puzzled why i cant use the implicit function in

Re: Re: implicit function in SparkStreaming

2015-04-29 Thread Tathagata Das
in the enclosing class ? *From:* Tathagata Das t...@databricks.com *Date:* 2015-04-30 07:00 *To:* guoqing0...@yahoo.com.hk *CC:* user user@spark.apache.org *Subject:* Re: implicit function in SparkStreaming I believe that the implicit def is pulling in the enclosing class (in which the def

Re: Re: implicit function in SparkStreaming

2015-04-29 Thread guoqing0...@yahoo.com.hk
Thank you for your pointers , it`s very helpful to me , in this scenario how can i use the implicit def in the enclosing class ? From: Tathagata Das Date: 2015-04-30 07:00 To: guoqing0...@yahoo.com.hk CC: user Subject: Re: implicit function in SparkStreaming I believe that the implicit def

Re: Re: implicit function in SparkStreaming

2015-04-29 Thread Lin Hao Xu
/xulinhao/sets From: guoqing0...@yahoo.com.hk guoqing0...@yahoo.com.hk To: Tathagata Das t...@databricks.com Cc: user user@spark.apache.org Date: 2015/04/30 11:17 Subject:Re: Re: implicit function in SparkStreaming Appreciate for your help , it works . i`m curious why

Re: Re: implicit function in SparkStreaming

2015-04-29 Thread guoqing0...@yahoo.com.hk
: Tathagata Das Date: 2015-04-30 09:30 To: guoqing0...@yahoo.com.hk CC: user Subject: Re: Re: implicit function in SparkStreaming Could you put the implicit def in an object? That should work, as objects are never serialized. On Wed, Apr 29, 2015 at 6:28 PM, guoqing0...@yahoo.com.hk guoqing0