You should not be broadcasting an RDD. You also should not be passing an RDD in a lambda to another RDD. If you want, can call RDD.collect and then broadcast those values (of course you must be able to fit all those values in memory).
On Tue, Sep 9, 2014 at 6:34 AM, Blackeye <black...@iit.demokritos.gr> wrote: > In order to help anyone to answer i could say that i checked the > inactiveIDs.filter operation seperated, and I found that it doesn't return > null in any case. In addition i don't how to handle (or check) whether a > RDD > is null. I find the debugging to complicated to point the error. Any ideas > how to find the null pointer? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Filter-function-problem-tp13787p13789.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > -- Daniel Siegmann, Software Developer Velos Accelerating Machine Learning 440 NINTH AVENUE, 11TH FLOOR, NEW YORK, NY 10001 E: daniel.siegm...@velos.io W: www.velos.io
