wangxinyu created SPARK-54694:
---------------------------------
Summary: Fail app on ConfigMap size over limit
Key: SPARK-54694
URL: https://issues.apache.org/jira/browse/SPARK-54694
Project: Spark
Issue Type: Bug
Components: Kubernetes
Affects Versions: 4.2.0
Reporter: wangxinyu
Currently, when the combined size of configuration files exceeds the Kubernetes
ConfigMap size limit, Spark silently skips loading some files. This behavior is
problematic because it can lead to unexpected missing configurations,
potentially causing application failures or incorrect runtime behavior.
Furthermore, the current validation logic is incomplete and inconsistent:
# Only the size of driver conf map will be validated against the Kubernetes
limit.
# The size of the spark.properties file is NOT included in the size
calculation.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
