[
https://issues.apache.org/jira/browse/SPARK-38397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-38397:
---------------------------------
Affects Version/s: 3.3.0
(was: 3.4.0)
> Support Kueue: K8s-native Job Queueing
> --------------------------------------
>
> Key: SPARK-38397
> URL: https://issues.apache.org/jira/browse/SPARK-38397
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.3.0
> Reporter: Dongjoon Hyun
> Priority: Major
>
> There are several ways to run Spark on K8s including vanilla `spark-submit`
> with built-in `KubernetesClusterManager`, `spark-submit` with custom
> `ExternalClusterManager`, CRD-based operators (like spark-on-k8s-operator),
> custom K8s `schedulers`, custom `standalone pod definitions`, and so on.
> This issue is tracking K8s-native Job Queueing related work.
> * [https://github.com/kubernetes-sigs/kueue]
> {code}
> metadata:
> generateName: sample-job-
> annotations:
> kueue.k8s.io/queue-name: main
> {code}
> The best case is Apache Spark users use it in the future via pod templates or
> existing configuration. In other words, we don't need to do anything and
> close this JIRA without any patches.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
