[
https://issues.apache.org/jira/browse/SPARK-40350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sun BiaoBiao updated SPARK-40350:
---------------------------------
Description:
Now we use volcano as our scheduler， we need specify the following
configuration options:
{code:java}
spark.kubernetes.scheduler.name=volcano
spark.kubernetes.scheduler.volcano.podGroupTemplateFile=/path/to/podgroup-template.yaml
spark.kubernetes.driver.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
spark.kubernetes.executor.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
{code}
we should use configMap to mount the /path/to/podgroup-template.yaml file
If we use spark config to specify the parameters of the podgroup, it will be
much more convenient, so that we don't need configmap to mount static files
was:
Now we use volcano as our scheduler， we need specify the following
configuration options:
{code:java}
spark.kubernetes.scheduler.name=volcano
spark.kubernetes.scheduler.volcano.podGroupTemplateFile=/path/to/podgroup-template.yaml
spark.kubernetes.driver.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
spark.kubernetes.executor.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
{code}
we should use configMap to mount the /path/to/podgroup-template.yaml file
If we use spark config to specify the parameters of the podgroup, it will be
much more convenient, so that we can mount static files without using configmap
> Improve the configuration of volcano scheduler
> ----------------------------------------------
>
> Key: SPARK-40350
> URL: https://issues.apache.org/jira/browse/SPARK-40350
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.3.0
> Reporter: Sun BiaoBiao
> Priority: Major
>
> Now we use volcano as our scheduler， we need specify the following
> configuration options:
>
>
> {code:java}
> spark.kubernetes.scheduler.name=volcano
> spark.kubernetes.scheduler.volcano.podGroupTemplateFile=/path/to/podgroup-template.yaml
> spark.kubernetes.driver.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
> spark.kubernetes.executor.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
> {code}
>
>
> we should use configMap to mount the /path/to/podgroup-template.yaml file
>
> If we use spark config to specify the parameters of the podgroup, it will be
> much more convenient, so that we don't need configmap to mount static files
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
