This is an automated email from the ASF dual-hosted git repository. chenyulin0719 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/yunikorn-site.git
The following commit(s) were added to refs/heads/master by this push: new 6720e9c418 [YUNIKORN-2462] incorrect gang annotations in example (#422) 6720e9c418 is described below commit 6720e9c4185ae979169389b961eacafda89847cb Author: steinsgateted <steinsgate...@gmail.com> AuthorDate: Thu Jun 6 14:11:30 2024 +0800 [YUNIKORN-2462] incorrect gang annotations in example (#422) Closes: #422 Signed-off-by: Yu-Lin Chen <chenyulin0...@apache.org> --- docs/user_guide/gang_scheduling.md | 49 ++++++++++++++++++-------------------- 1 file changed, 23 insertions(+), 26 deletions(-) diff --git a/docs/user_guide/gang_scheduling.md b/docs/user_guide/gang_scheduling.md index 1b8dd24bf2..f96bbe7996 100644 --- a/docs/user_guide/gang_scheduling.md +++ b/docs/user_guide/gang_scheduling.md @@ -180,32 +180,29 @@ Each Spark job runs 2 types of pods, driver and executor. Hence, we need to defi The annotations for the driver pod looks like: ```yaml -Annotations: - yunikorn.apache.org/schedulingPolicyParameters: “placeholderTimeoutSeconds=30” - yunikorn.apache.org/taskGroupName: “spark-driver” - yunikorn.apache.org/taskGroup: “ - TaskGroups: [ - { - Name: “spark-driver”, - minMember: 1, - minResource: { - Cpu: 1, - Memory: 2Gi - }, - Node-selector: ..., - Tolerations: ..., - Affinity: ... +annotations: + yunikorn.apache.org/schedulingPolicyParameters: "placeholderTimeoutInSeconds=30 gangSchedulingStyle=Hard" + yunikorn.apache.org/task-group-name: "spark-driver" + yunikorn.apache.org/task-groups: |- + [{ + "name": "spark-driver", + "minMember": 1, + "minResource": { + "cpu": "1", + "memory": "2Gi" + }, + "nodeSelector": {}, + "tolerations": [], + "affinity": {} }, - { - Name: “spark-executor”, - minMember: 10, - minResource: { - Cpu: 1, - Memory: 2Gi + { + "name": "spark-executor", + "minMember": 1, + "minResource": { + "cpu": "1", + "memory": "2Gi" } - } - ] - ” + }] ``` :::note @@ -216,10 +213,10 @@ See the [Spark documentation](https://spark.apache.org/docs/latest/configuration For all the executor pods, ```yaml -Annotations: +annotations: # the taskGroup name should match to the names # defined in the taskGroups field - yunikorn.apache.org/taskGroupName: “spark-executor” + yunikorn.apache.org/task-group-name: "spark-executor" ``` Once the job is submitted to the scheduler, the job won’t be scheduled immediately. --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@yunikorn.apache.org For additional commands, e-mail: issues-h...@yunikorn.apache.org