[
https://issues.apache.org/jira/browse/SPARK-36057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang updated SPARK-36057:
--------------------------------
Description:
This is an umbrella issue for tracking the work for supporting Volcano &
Yunikorn on Kubernetes. These schedulers provide more YARN like features (such
as queues and minimum resources before scheduling jobs) that many folks want on
Kubernetes.
Yunikorn is an ASF project & Volcano is a CNCF project (sig-batch).
They've taken slightly different approaches to solving the same problem, but
from Spark's point of view we should be able to share much of the code.
See the initial brainstorming discussion in SPARK-35623.
Google DOC:
[https://docs.google.com/document/d/1xgQGRpaHQX6-QH_J9YV2C2Dh6RpXefUpLM7KGkzL6Fg]
was:
This is an umbrella issue for tracking the work for supporting Volcano &
Yunikorn on Kubernetes. These schedulers provide more YARN like features (such
as queues and minimum resources before scheduling jobs) that many folks want on
Kubernetes.
Yunikorn is an ASF project & Volcano is a CNCF project (sig-batch).
They've taken slightly different approaches to solving the same problem, but
from Spark's point of view we should be able to share much of the code.
See the initial brainstorming discussion in SPARK-35623.
https://docs.google.com/document/d/1xgQGRpaHQX6-QH_J9YV2C2Dh6RpXefUpLM7KGkzL6Fg
> Support volcano/alternative schedulers
> --------------------------------------
>
> Key: SPARK-36057
> URL: https://issues.apache.org/jira/browse/SPARK-36057
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.2.0
> Reporter: Holden Karau
> Priority: Major
>
> This is an umbrella issue for tracking the work for supporting Volcano &
> Yunikorn on Kubernetes. These schedulers provide more YARN like features
> (such as queues and minimum resources before scheduling jobs) that many folks
> want on Kubernetes.
>
> Yunikorn is an ASF project & Volcano is a CNCF project (sig-batch).
>
> They've taken slightly different approaches to solving the same problem, but
> from Spark's point of view we should be able to share much of the code.
>
> See the initial brainstorming discussion in SPARK-35623.
>
> Google DOC:
> [https://docs.google.com/document/d/1xgQGRpaHQX6-QH_J9YV2C2Dh6RpXefUpLM7KGkzL6Fg]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
