Nicolas Fraison created SPARK-56597:
---------------------------------------

             Summary: Default enablement of spark.io.encryption.enabled in 
spark apache operator leads to oom on spark jobs migrated from kubeflow one
                 Key: SPARK-56597
                 URL: https://issues.apache.org/jira/browse/SPARK-56597
             Project: Spark
          Issue Type: Question
          Components: Kubernetes
    Affects Versions: 0.8.0
            Reporter: Nicolas Fraison


While migrating from kubeflow operator to spark kubernetes operator a subset of 
our jobs are facing some OOM

The issue seems to be linked to the default enablement of the 
[spark.io.encryption.enabled|https://github.com/apache/spark-kubernetes-operator/blob/f90db67f0f704d7b298e637bca4763420f4a323e/spark-submission-worker/src/main/java/org/apache/spark/k8s/operator/SparkAppSubmissionWorker.java#L169C38-L169C65]

[~dongjoon] would you be fine in adding capabilities to opt out this config?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to