[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2022-06-28 Thread Lijie Wang (Jira)
Title: Message Title Lijie Wang commented

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-23 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375005#comment-16375005 ] Imran Rashid commented on SPARK-23485: -- {quote} I think this is because the general expectation is

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-23 Thread Anirudh Ramanathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374884#comment-16374884 ] Anirudh Ramanathan commented on SPARK-23485: Stavros - we [do currently

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-23 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374778#comment-16374778 ] Stavros Kontopoulos commented on SPARK-23485: - How about locality preferences + a hardware

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-23 Thread Yinan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374757#comment-16374757 ] Yinan Li commented on SPARK-23485: -- It's not that I'm too confident on the capability of Kubernetes to

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-23 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374748#comment-16374748 ] Imran Rashid commented on SPARK-23485: -- ok the missing jar was a bad example on kubernetes ... I

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-23 Thread Anirudh Ramanathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374745#comment-16374745 ] Anirudh Ramanathan commented on SPARK-23485: While mostly I think that K8s would be better

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-23 Thread Yinan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374708#comment-16374708 ] Yinan Li commented on SPARK-23485: -- In the Yarn case, yes, it's possible that a node is missing a jar

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-23 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374599#comment-16374599 ] Imran Rashid commented on SPARK-23485: -- Yeah I don't think its safe to assume that its kubernetes

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373652#comment-16373652 ] Stavros Kontopoulos commented on SPARK-23485: - Does the scheduler know all the reasons an app

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373634#comment-16373634 ] Stavros Kontopoulos commented on SPARK-23485: - [~liyinan926] I understand the default

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-22 Thread Yinan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373620#comment-16373620 ] Yinan Li commented on SPARK-23485: -- The Kubernetes scheduler backend simply creates executor pods

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373558#comment-16373558 ] Stavros Kontopoulos commented on SPARK-23485: - I guess everything is covered via

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-22 Thread Yinan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373544#comment-16373544 ] Yinan Li commented on SPARK-23485: -- I'm not sure if node blacklisting applies to Kubernetes. In the

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

2018-02-21 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372134#comment-16372134 ] Imran Rashid commented on SPARK-23485: -- Also related to SPARK-16630 ... if that is solved before