Re: Do all classes involving RDD operation need to be registered?

2014-03-29 Thread anny9699
Thanks so much Sonal! I am much clearer now. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Do-all-classes-involving-RDD-operation-need-to-be-registered-tp3439p3472.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Do all classes involving RDD operation need to be registered?

2014-03-29 Thread Sonal Goyal
rote, and now I realized I neither extends > Serializable or register with Kyro and that's why it is not working. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Do-all-classes-involving-RDD-operation-need-to-be-registered-tp3439p3446.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >

Re: Do all classes involving RDD operation need to be registered?

2014-03-28 Thread anny9699
Thanks a lot Ognen! It's not a fancy class that I wrote, and now I realized I neither extends Serializable or register with Kyro and that's why it is not working. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Do-all-classes-involving-RDD-oper

Re: Do all classes involving RDD operation need to be registered?

2014-03-28 Thread Ognen Duzlevski
could recognize them? Thanks a lot! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Do-all-classes-involving-RDD-operation-need-to-be-registered-tp3439.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Do all classes involving RDD operation need to be registered?

2014-03-28 Thread Debasish Das
parameters, it will work fine. Is it true that all classes involving RDD operation should be registered so that SparkContext could recognize them? Thanks a lot! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Do-all-classes-involving-RDD-operation-need-to-be-

Do all classes involving RDD operation need to be registered?

2014-03-28 Thread anny9699
olving RDD operation should be registered so that SparkContext could recognize them? Thanks a lot! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Do-all-classes-involving-RDD-operation-need-to-be-registered-tp3439.html Sent from the Apache Spark User List ma