Re: A bug in Spark standalone? Worker registration and deregistration

2015-12-10 Thread Jacek Laskowski
On Thu, Dec 10, 2015 at 8:10 PM, Shixiong Zhu wrote: > Jacek, could you create a JIRA for it? I just reproduced it. It's a bug in > how Master handles the Worker disconnection. Hi Shixiong, I'm saved. Kept thinking I'm lost in the sources and see ghosts :-)

Re: A bug in Spark standalone? Worker registration and deregistration

2015-12-10 Thread Shixiong Zhu
Jacek, could you create a JIRA for it? I just reproduced it. It's a bug in how Master handles the Worker disconnection. Best Regards, Shixiong Zhu 2015-12-10 2:45 GMT-08:00 Jacek Laskowski : > Hi, > > I'm on yesterday's master HEAD. > > Pozdrawiam, > Jacek > > -- > Jacek

Re: A bug in Spark standalone? Worker registration and deregistration

2015-12-10 Thread Bryan Cutler
Hi Jacek, I also recently noticed those messages, and some others, and am wondering if there is an issue. I am also seeing the following when I have event logging enabled. The first application is submitted and executes fine, but all subsequent attempts produce an error log, but the master

A bug in Spark standalone? Worker registration and deregistration

2015-12-10 Thread Jacek Laskowski
Hi, While toying with Spark Standalone I've noticed the following messages in the logs of the master: INFO Master: Registering worker 192.168.1.6:59919 with 2 cores, 2.0 GB RAM INFO Master: localhost:59920 got disassociated, removing it. ... WARN Master: Removing

Re: A bug in Spark standalone? Worker registration and deregistration

2015-12-10 Thread Jacek Laskowski
Hi, I'm on yesterday's master HEAD. Pozdrawiam, Jacek -- Jacek Laskowski | https://medium.com/@jaceklaskowski/ | http://blog.jaceklaskowski.pl Mastering Spark https://jaceklaskowski.gitbooks.io/mastering-apache-spark/ Follow me at https://twitter.com/jaceklaskowski Upvote at