Nicolas Fraison created SPARK-56597:
---------------------------------------
Summary: Default enablement of spark.io.encryption.enabled in
spark apache operator leads to oom on spark jobs migrated from kubeflow one
Key: SPARK-56597
URL: https://issues.apache.org/jira/browse/SPARK-56597
Project: Spark
Issue Type: Question
Components: Kubernetes
Affects Versions: 0.8.0
Reporter: Nicolas Fraison
While migrating from kubeflow operator to spark kubernetes operator a subset of
our jobs are facing some OOM
The issue seems to be linked to the default enablement of the
[spark.io.encryption.enabled|https://github.com/apache/spark-kubernetes-operator/blob/f90db67f0f704d7b298e637bca4763420f4a323e/spark-submission-worker/src/main/java/org/apache/spark/k8s/operator/SparkAppSubmissionWorker.java#L169C38-L169C65]
[~dongjoon] would you be fine in adding capabilities to opt out this config?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]