Bryan Keller created SPARK-40505: ------------------------------------ Summary: Remove min heap setting in Kubernetes Dockerfile entrypoint Key: SPARK-40505 URL: https://issues.apache.org/jira/browse/SPARK-40505 Project: Spark Issue Type: Improvement Components: Kubernetes Affects Versions: 3.2.2, 3.3.0 Reporter: Bryan Keller
The entrypoint script for the Kubernetes Dockerfile sets the Java min heap setting (-Xms) to be the same as the max setting (-Xmx) for the executor process. This prevents the JVM from shrinking the heap and can lead to excessive memory usage in some scenarios. Removing the min heap setting is consistent with YARN executor startup. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org