[jira] [Updated] (SPARK-39619) PrometheusServlet: add "TYPE" comment to exposed metrics

[Eric Barault (Jira)]

Title: Message Title

Eric Barault updated an issue   Spark / SPARK-39619 PrometheusServlet: add "TYPE" comment to exposed metrics Change By: Eric Barault The PrometheusServlet sink does not include the usual comments when exposing the metrics in the prometheus format e.g. `# TYPE nginx_ingress_controller_ingress_upstream_latency_seconds summary` which prevents some client/integrations that depend on them to assess the metric type to work properly. For example the AWS cloudwatch agent prometheus plugin attempts to get the metric type from the TYPE comment and considers any metric with no type as unsuported and hence drops it.  As a result the cloudwatch agent prometheus drops all the metrics exposer exposed by the PrometheusServlet. [ https://github.com/aws/amazon-cloudwatch-agent/blob/1f654cf69c1269073673ba2f636738c556248a31/plugins/inputs/prometheus_scraper/metrics_type_handler.go#L190 ]   This would be solved by adding the TYPE comments to the metrics exposed by the PrometheusServlet sink.   _*references:*_ - [ https://dzlab.github.io/bigdata/2020/07/03/spark3-monitoring-1/ ] - [ https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/metrics/sink/PrometheusServlet.scala ] Add Comment   This message was sent by Atlassian Jira (v8.20.10#820010-sha1:ace47f9)