[
https://issues.apache.org/jira/browse/SPARK-40350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sun BiaoBiao updated SPARK-40350:
---------------------------------
Description:
Now we use volcano as our scheduler， we need specify the following
configuration options:
{code:java}
spark.kubernetes.scheduler.name=volcano
spark.kubernetes.scheduler.volcano.podGroupTemplateFile=/path/to/podgroup-template.yaml
spark.kubernetes.driver.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
spark.kubernetes.executor.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
{code}
we should use configMap to mount the /path/to/podgroup-template.yaml file
If we use spark config to specify the parameters of the podgroup, it will be
much more convenient,we don't need configmap to mount static files
In our scenario, we need to dynamically specify the volcano queue, but it is
not convenient to create a static podgroup configuration file to mount
was:
Now we use volcano as our scheduler， we need specify the following
configuration options:
{code:java}
spark.kubernetes.scheduler.name=volcano
spark.kubernetes.scheduler.volcano.podGroupTemplateFile=/path/to/podgroup-template.yaml
spark.kubernetes.driver.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
spark.kubernetes.executor.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
{code}
we should use configMap to mount the /path/to/podgroup-template.yaml file
If we use spark config to specify the parameters of the podgroup, it will be
much more convenient,we don't need configmap to mount static files
> Improve the configuration of volcano scheduler
> ----------------------------------------------
>
> Key: SPARK-40350
> URL: https://issues.apache.org/jira/browse/SPARK-40350
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.3.0
> Reporter: Sun BiaoBiao
> Priority: Major
>
> Now we use volcano as our scheduler， we need specify the following
> configuration options:
>
>
> {code:java}
> spark.kubernetes.scheduler.name=volcano
> spark.kubernetes.scheduler.volcano.podGroupTemplateFile=/path/to/podgroup-template.yaml
> spark.kubernetes.driver.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
> spark.kubernetes.executor.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
> {code}
>
>
> we should use configMap to mount the /path/to/podgroup-template.yaml file
>
> If we use spark config to specify the parameters of the podgroup, it will be
> much more convenient,we don't need configmap to mount static files
>
> In our scenario, we need to dynamically specify the volcano queue, but it is
> not convenient to create a static podgroup configuration file to mount
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
