Sun BiaoBiao created SPARK-40350:
------------------------------------
Summary: Improve the configuration of volcano scheduler
Key: SPARK-40350
URL: https://issues.apache.org/jira/browse/SPARK-40350
Project: Spark
Issue Type: Improvement
Components: Kubernetes
Affects Versions: 3.3.0
Reporter: Sun BiaoBiao
Now we use volcano as our scheduler， we need specify the following
configuration options:
{code:java}
spark.kubernetes.scheduler.name=volcano
spark.kubernetes.scheduler.volcano.podGroupTemplateFile=/path/to/podgroup-template.yaml
spark.kubernetes.driver.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
spark.kubernetes.executor.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
{code}
we should use configMap to mount the /path/to/podgroup-template.yaml file
If we use spark config to specify the parameters of the podgroup, it will be
much more convenient, so that we can mount static files without using configmap
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
