[ https://issues.apache.org/jira/browse/SPARK-39363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated SPARK-39363: ---------------------------------- Description: see [https://github.com/apache/spark/pull/36744] for details. It looks like we deprecated {{spark.kubernetes.memoryOverheadFactor, but it has a default value which leads it to printing warnings all the time.}} {{}} {code:java} 22/06/01 23:53:49 WARN SparkConf: The configuration key 'spark.kubernetes.memoryOverheadFactor' has been deprecated as of Spark 3.3.0 and may be removed in the future. Please use spark.driver.memoryOverheadFactor and spark.executor.memoryOverheadFactor{code} {{}} {{We should remove the default value if possible. It should only be used as fallback but we should be able to use the default from }}spark.driver.memoryOverheadFactor. was: see [https://github.com/apache/spark/pull/36744] for details. It looks like we deprecated {{spark.kubernetes.memoryOverheadFactor, but it has a default value which leads it to printing warnings all the time.}} {{}} {code:java} 22/06/01 23:53:49 WARN SparkConf: The configuration key 'spark.kubernetes.memoryOverheadFactor' has been deprecated as of Spark 3.3.0 and may be removed in the future. Please use spark.driver.memoryOverheadFactor and spark.executor.memoryOverheadFactor{code} {{}} {{We should remove the default value if possible. It should only be used as fallback but we should be able to use the default from }} spark.driver.memoryOverheadFactor. {{{}{}}}{{{}{}}} > fix spark.kubernetes.memoryOverheadFactor deprecation warning > ------------------------------------------------------------- > > Key: SPARK-39363 > URL: https://issues.apache.org/jira/browse/SPARK-39363 > Project: Spark > Issue Type: Bug > Components: Kubernetes > Affects Versions: 3.4.0 > Reporter: Thomas Graves > Priority: Major > > see [https://github.com/apache/spark/pull/36744] for details. > > It looks like we deprecated {{spark.kubernetes.memoryOverheadFactor, but it > has a default value which leads it to printing warnings all the time.}} > {{}} > {code:java} > 22/06/01 23:53:49 WARN SparkConf: The configuration key > 'spark.kubernetes.memoryOverheadFactor' has been deprecated as of Spark 3.3.0 > and may be removed in the future. Please use > spark.driver.memoryOverheadFactor and > spark.executor.memoryOverheadFactor{code} > {{}} > {{We should remove the default value if possible. It should only be used as > fallback but we should be able to use the default from > }}spark.driver.memoryOverheadFactor. > -- This message was sent by Atlassian Jira (v8.20.7#820007) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org