[
https://issues.apache.org/jira/browse/SPARK-25394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-25394:
----------------------------------------
Description: ApplicationListener in Spark core captures useful metrics like
job duration which are exposed via the spark rest api (available both at the
driver's ui and the history server ui) only. From a devops perspective and
especially on k8s where metrics scrapping is often done via the prometheus jmx
exporter it would be good to have all metrics in one place, avoidn scraping the
metrics rest api. (was: ApplicationListener in Spark core captures useful
metrics like job duration which are exposed via the spark rest api (available
both at the driver's ui and the history server ui) only. From a devops
perspective and especially on k8s where metrics scrapping is often done via the
prometheus jmx exporter it would be good to have all metrics in one place.)
> Expose App status metrics as Source
> -----------------------------------
>
> Key: SPARK-25394
> URL: https://issues.apache.org/jira/browse/SPARK-25394
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.4.0
> Reporter: Stavros Kontopoulos
> Priority: Major
>
> ApplicationListener in Spark core captures useful metrics like job duration
> which are exposed via the spark rest api (available both at the driver's ui
> and the history server ui) only. From a devops perspective and especially on
> k8s where metrics scrapping is often done via the prometheus jmx exporter it
> would be good to have all metrics in one place, avoidn scraping the metrics
> rest api.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
