Could you paste the NPE stack trace here? It will better to create a JIRA for it, thanks!
On Tue, Feb 10, 2015 at 10:42 AM, rok <rokros...@gmail.com> wrote: > I'm trying to use a broadcasted dictionary inside a map function and am > consistently getting Java null pointer exceptions. This is inside an IPython > session connected to a standalone spark cluster. I seem to recall being able > to do this before but at the moment I am at a loss as to what to try next. > Is there a limit to the size of broadcast variables? This one is rather > large (a few Gb dict). Thanks! > > Rok > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/pyspark-Java-null-pointer-exception-when-accessing-broadcast-variables-tp21580.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
