[
https://issues.apache.org/jira/browse/SPARK-56845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tongwei updated SPARK-56845:
----------------------------
Description:
When spark.app.name is very long (> ~222 chars), the derived
resourceNamePrefix plus a fixed suffix (-hadoop-config, -krb5-file,
-driver-podspec-conf-map) exceeds the Kubernetes DNS subdomain limit of
253 characters, and driver submission fails with "must be no more than
253 characters".
The existing KubernetesClientUtils.configMapName helper truncates
correctly but is hardcoded to the -conf-map suffix and unused by these
three call sites.
Add a configMapName(prefix, suffix) overload that falls back to
spark-<uniqueID><suffix> when prefix+suffix exceeds the limit, and
migrate the three sites to it.
was:
Symptom ： When spark.app.name is very long (> ~222 chars), the derived
resourceNamePrefix plus a fixed suffix (-hadoop-config, -krb5-file,
-driver-podspec-conf-map) exceeds the Kubernetes DNS subdomain limit of
253 characters, and driver submission fails with "must be no more than
253 characters".
The existing KubernetesClientUtils.configMapName helper truncates
correctly but is hardcoded to the -conf-map suffix and unused by these
three call sites.
Fix：Add a configMapName(prefix, suffix) overload that falls back to
spark-<uniqueID><suffix> when prefix+suffix exceeds the limit, and
migrate the three sites to it.
> Truncate ConfigMap names that exceed DNS subdomain limit
> --------------------------------------------------------
>
> Key: SPARK-56845
> URL: https://issues.apache.org/jira/browse/SPARK-56845
> Project: Spark
> Issue Type: Bug
> Components: Kubernetes
> Affects Versions: 4.1.1
> Reporter: Tongwei
> Priority: Major
>
> When spark.app.name is very long (> ~222 chars), the derived
> resourceNamePrefix plus a fixed suffix (-hadoop-config, -krb5-file,
> -driver-podspec-conf-map) exceeds the Kubernetes DNS subdomain limit of
> 253 characters, and driver submission fails with "must be no more than
> 253 characters".
> The existing KubernetesClientUtils.configMapName helper truncates
> correctly but is hardcoded to the -conf-map suffix and unused by these
> three call sites.
> Add a configMapName(prefix, suffix) overload that falls back to
> spark-<uniqueID><suffix> when prefix+suffix exceeds the limit, and
> migrate the three sites to it.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
