Alkis Evlogimenos created SPARK-42686:
-----------------------------------------
Summary: TaskMemoryManager debug logging is expensive
Key: SPARK-42686
URL: https://issues.apache.org/jira/browse/SPARK-42686
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.3.2
Reporter: Alkis Evlogimenos
TaskMemoryManager debug logging is expensive mostly because formatting
operations are done eagerly and some of them are quite expensive (i.e.
humanized strings). This causes visible CPU usage in scan benchmarks for
example.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
