Luca Canali created SPARK-29654:
-----------------------------------
Summary: Add configuration to allow disabling registration of
static sources to the metrics system
Key: SPARK-29654
URL: https://issues.apache.org/jira/browse/SPARK-29654
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.0.0
Reporter: Luca Canali
The Spark metrics system produces many different metrics and not all of them
are used at the same time. This proposes to introduce a configuration parameter
to allow disabling the registration of metrics in the "static sources"
category, in other to reduce the load and clutter on the sink, in the cases
when the metrics in question are not needed. The metrics registerd as "static
sources" are under the namespaces CodeGenerator and HiveExternalCatalog and can
produce a significant amount of data, as they are registered for the driver and
executors.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
