Executor metrics are missing on prometheus sink
Setting up prometheus sink in this way:
-c spark.ui.prometheus.enabled=true
-c spark.executor.processTreeMetrics.enabled=true
-c spark.metrics.conf=/spark/conf/metric.properties
*metric.properties:*{}
*.sink.prometheusServlet.class=org.apache.spark.metrics.sink.PrometheusServlet
*.sink.prometheusServlet.path=/metrics/prometheus
Result:
Both of these endpoints have some metrics
:4040/metrics/prometheus
:4040/metrics/executors/prometheus
But the executor one misses metrics under the executor namespace described
here:
https://spark.apache.org/docs/latest/monitoring.html#component-instance--executor
*How to expose executor metrics on spark exeuctors pod?*
*Any help will be appreciated.*
--
Regards,
Qian Sun
Jira Account for Contributions
Hi, I'm wanting to start contributing to the Spark project, do I need a Jira account at https://issues.apache.org/jira/projects/SPARK/summary before I'm able to do this? If so can one please be created with this email address? Thank you
