[
https://issues.apache.org/jira/browse/SPARK-32026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-32026:
---------------------------------------
Description:
This Jira aims to be added _PrometheusServletSuite_.
*Note:* This jira was created to propose _Prometheus_ driver metric format
change to be consistent with executor metric format. However, currently,
_PrometheusServlet_ follows _Spark 3.0 JMX Sink + Prometheus JMX Exporter_
format so this Jira coverage has been converted to just
_PrometheusServletSuite_ in the light of discussion on
https://github.com/apache/spark/pull/28865.
was:
Spark 3.0 introduces native Prometheus Sink for both driver and executor
metrics. However, they need consistency on format (e.g: `applicationId`).
Currently, driver covers `applicationId` in metric name. If this can extract as
executor metric format, this can also support consistency and help to query.
*Driver*
{code:java}
metrics_local_1592242896665_driver_BlockManager_memory_memUsed_MB_Value{type="gauges"}
0{code}
*Executor*
{code:java}
metrics_executor_memoryUsed_bytes{application_id="local-1592242896665",
application_name="apache-spark-fundamentals", executor_id="driver"} 24356{code}
*Proposed Driver Format*
{code:java}
metrics_driver_BlockManager_memory_memUsed_MB_Value{application_id="local-1592242896665",
type="gauges"} 0{code}
> Add PrometheusServletSuite
> --------------------------
>
> Key: SPARK-32026
> URL: https://issues.apache.org/jira/browse/SPARK-32026
> Project: Spark
> Issue Type: Task
> Components: Spark Core
> Affects Versions: 3.0.1
> Reporter: Eren Avsarogullari
> Priority: Major
>
> This Jira aims to be added _PrometheusServletSuite_.
> *Note:* This jira was created to propose _Prometheus_ driver metric format
> change to be consistent with executor metric format. However, currently,
> _PrometheusServlet_ follows _Spark 3.0 JMX Sink + Prometheus JMX Exporter_
> format so this Jira coverage has been converted to just
> _PrometheusServletSuite_ in the light of discussion on
> https://github.com/apache/spark/pull/28865.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
