[
https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377893#comment-17377893
]
Klaus Ma commented on SPARK-36058:
----------------------------------
In Volcano, we have volcano job to run mpi/tensorflow job (the pods are created
by controller/operator); but for spark-job, the executor pod is created by
driver pod which is different. If spark pods (both driver and executor) can be
created by operator, we can use volcano job to make it simple :)
> Support replicasets/job API
> ---------------------------
>
> Key: SPARK-36058
> URL: https://issues.apache.org/jira/browse/SPARK-36058
> Project: Spark
> Issue Type: Sub-task
> Components: Kubernetes
> Affects Versions: 3.2.0
> Reporter: Holden Karau
> Priority: Major
>
> Volcano & Yunikorn both support scheduling invidual pods, but they also
> support higher level abstractions similar to the vanilla Kube replicasets
> which we can use to improve scheduling performance.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
