[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-11 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053450#comment-15053450 ] Shixiong Zhu commented on SPARK-12267: -- I just fixed NPE and verified my PR worked as your

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053041#comment-15053041 ] Marcelo Vanzin commented on SPARK-12267: You need this:

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-11 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053413#comment-15053413 ] Shixiong Zhu commented on SPARK-12267: -- This NPE issue was introduced by SPARK-11344. I tried Akka

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15054012#comment-15054012 ] Apache Spark commented on SPARK-12267: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051502#comment-15051502 ] Shixiong Zhu commented on SPARK-12267: -- cc [~vanzin] > Standalone master keeps references to

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051683#comment-15051683 ] Marcelo Vanzin commented on SPARK-12267: Pasting Shixiong's comments from github

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051700#comment-15051700 ] Marcelo Vanzin commented on SPARK-12267: [~shixi...@databricks.com] you're right but that's the

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051732#comment-15051732 ] Marcelo Vanzin commented on SPARK-12267: I think the following would work. The problem right now

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread dont_ping_this_account (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051757#comment-15051757 ] dont_ping_this_account commented on SPARK-12267: Sounds correct. But looks a lot changes

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051767#comment-15051767 ] Marcelo Vanzin commented on SPARK-12267: bq. I think we can just handle it in `NettyRpcHandler`

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051952#comment-15051952 ] Shixiong Zhu commented on SPARK-12267: -- Could you send a PR quickly so that we can get the fix into

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051953#comment-15051953 ] Shixiong Zhu commented on SPARK-12267: -- If you don't have time, I can do it. > Standalone master

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052085#comment-15052085 ] Marcelo Vanzin commented on SPARK-12267: Hi [~zsxwing], [~andrewor14], I uploaded my code to

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051995#comment-15051995 ] Marcelo Vanzin commented on SPARK-12267: My first approach was starting to get unwieldy, so I'm

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052169#comment-15052169 ] Shixiong Zhu commented on SPARK-12267: -- I saw the follow exception when following the steps: {code}