Thomas Graves created SPARK-39363: ------------------------------------- Summary: fix spark.kubernetes.memoryOverheadFactor deprecation warning Key: SPARK-39363 URL: https://issues.apache.org/jira/browse/SPARK-39363 Project: Spark Issue Type: Bug Components: Kubernetes Affects Versions: 3.4.0 Reporter: Thomas Graves
see [https://github.com/apache/spark/pull/36744] for details. It looks like we deprecated {{spark.kubernetes.memoryOverheadFactor, but it has a default value which leads it to printing warnings all the time.}} {{}} {code:java} 22/06/01 23:53:49 WARN SparkConf: The configuration key 'spark.kubernetes.memoryOverheadFactor' has been deprecated as of Spark 3.3.0 and may be removed in the future. Please use spark.driver.memoryOverheadFactor and spark.executor.memoryOverheadFactor{code} {{}} {{We should remove the default value if possible. It should only be used as fallback but we should be able to use the default from }} spark.driver.memoryOverheadFactor. {{{}{}}}{{{}{}}} -- This message was sent by Atlassian Jira (v8.20.7#820007) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org