[jira] [Commented] (SPARK-36058) Support replicasets/job API

2021-07-09 Thread Klaus Ma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377895#comment-17377895 ] Klaus Ma commented on SPARK-36058: -- xref for volcano job example:

[jira] [Commented] (SPARK-36058) Support replicasets/job API

2021-07-09 Thread Klaus Ma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377893#comment-17377893 ] Klaus Ma commented on SPARK-36058: -- In Volcano, we have volcano job to run mpi/tensorflow job (the pods

[jira] [Commented] (SPARK-36058) Support replicasets/job API

2021-07-08 Thread Klaus Ma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377731#comment-17377731 ] Klaus Ma commented on SPARK-36058: -- Volcano already support all API in k8s upstream; PodGroup

[jira] [Commented] (SPARK-35623) Volcano resource manager for Spark on Kubernetes

2021-06-21 Thread Klaus Ma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366906#comment-17366906 ] Klaus Ma commented on SPARK-35623: -- That's interesting, I'd like to help on that :) > Volcano resource

[jira] [Created] (SPARK-28673) Failed to start executors for spark-sql-perf on kubernetes

2019-08-09 Thread Klaus Ma (JIRA)
Klaus Ma created SPARK-28673: Summary: Failed to start executors for spark-sql-perf on kubernetes Key: SPARK-28673 URL: https://issues.apache.org/jira/browse/SPARK-28673 Project: Spark Issue

[jira] [Created] (SPARK-27081) Support launching executors in existed Pods

2019-03-06 Thread Klaus Ma (JIRA)
Klaus Ma created SPARK-27081: Summary: Support launching executors in existed Pods Key: SPARK-27081 URL: https://issues.apache.org/jira/browse/SPARK-27081 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-11143) SparkMesosDispatcher can not launch driver in docker

2015-10-16 Thread Klaus Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960420#comment-14960420 ] Klaus Ma commented on SPARK-11143: -- I addressed the issue by a new docker image which is more

[jira] [Comment Edited] (SPARK-11143) SparkMesosDispatcher can not launch driver in docker

2015-10-16 Thread Klaus Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960420#comment-14960420 ] Klaus Ma edited comment on SPARK-11143 at 10/16/15 9:24 AM: I addressed the

[jira] [Commented] (SPARK-11143) SparkMesosDispatcher can not launch driver in docker

2015-10-15 Thread Klaus Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960119#comment-14960119 ] Klaus Ma commented on SPARK-11143: -- I also got a feedback from StackOverflow at

[jira] [Updated] (SPARK-11143) SparkMesosDispatcher can not launch driver in docker

2015-10-15 Thread Klaus Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Klaus Ma updated SPARK-11143: - Description: I'm working on integration between Mesos & Spark. For now, I can start

[jira] [Created] (SPARK-11143) SparkMesosDispatcher can not launch driver in docker

2015-10-15 Thread Klaus Ma (JIRA)
Klaus Ma created SPARK-11143: Summary: SparkMesosDispatcher can not launch driver in docker Key: SPARK-11143 URL: https://issues.apache.org/jira/browse/SPARK-11143 Project: Spark Issue Type: Bug