[
https://issues.apache.org/jira/browse/SPARK-56845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tongwei updated SPARK-56845:
----------------------------
Description:
h3. Symptom
When \{{spark.app.name}} is very long (> ~222 chars), the derived
\{{resourceNamePrefix}} plus a fixed suffix (\{{-hadoop-config}},
\{{-krb5-file}}, \{{-driver-podspec-conf-map}}) exceeds the Kubernetes DNS
subdomain limit of 253 characters, and driver submission fails with
\{{must be no more than 253 characters}}.
The existing \{{KubernetesClientUtils.configMapName}} helper truncates
correctly but is hardcoded to the \{{-conf-map}} suffix and unused by these
three call sites.
h3. Fix
Add a \{{configMapName(prefix, suffix)}} overload that falls back to
\{{spark-<uniqueID><suffix>}} when \{{prefix+suffix}} exceeds the limit, and
migrate the three sites to it.
> Truncate ConfigMap names that exceed DNS subdomain limit
> --------------------------------------------------------
>
> Key: SPARK-56845
> URL: https://issues.apache.org/jira/browse/SPARK-56845
> Project: Spark
> Issue Type: Bug
> Components: Kubernetes
> Affects Versions: 4.1.1
> Reporter: Tongwei
> Priority: Major
>
> h3. Symptom
> When \{{spark.app.name}} is very long (> ~222 chars), the derived
> \{{resourceNamePrefix}} plus a fixed suffix (\{{-hadoop-config}},
> \{{-krb5-file}}, \{{-driver-podspec-conf-map}}) exceeds the Kubernetes DNS
> subdomain limit of 253 characters, and driver submission fails with
> \{{must be no more than 253 characters}}.
> The existing \{{KubernetesClientUtils.configMapName}} helper truncates
> correctly but is hardcoded to the \{{-conf-map}} suffix and unused by these
> three call sites.
> h3. Fix
> Add a \{{configMapName(prefix, suffix)}} overload that falls back to
> \{{spark-<uniqueID><suffix>}} when \{{prefix+suffix}} exceeds the limit, and
> migrate the three sites to it.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
