Re: pyspark EOFError after calling map

2016-04-22 Thread Pete Werner
Oh great, thank you for clearing that up. On Fri, Apr 22, 2016 at 5:15 PM, Davies Liu <dav...@databricks.com> wrote: > This exception is already handled well, just noisy, should be muted. > > On Wed, Apr 13, 2016 at 4:52 PM, Pete Werner <pwer...@freelancer.com> > wrote

pyspark EOFError after calling map

2016-04-13 Thread Pete Werner
uires interacting with the spark server When I call df2.count() it shows that [Stage xxx] prompt which is what I mean by it going to the spark server. Anything that triggers that seems to eventually end up giving the EOFError again when I do something with df2. It does not seem to happen with df