[ https://issues.apache.org/jira/browse/SPARK-25394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stavros Kontopoulos updated SPARK-25394: ---------------------------------------- Description: ApplicationListener in Spark core captures useful metrics like job duration which are exposed via the spark rest api (available both at the driver's ui and the history server ui) only. From a devops perspective and especially on k8s where metrics scrapping is often done via the prometheus jmx exporter it would be good to have all metrics in one place, avoidn scraping the metrics rest api. (was: ApplicationListener in Spark core captures useful metrics like job duration which are exposed via the spark rest api (available both at the driver's ui and the history server ui) only. From a devops perspective and especially on k8s where metrics scrapping is often done via the prometheus jmx exporter it would be good to have all metrics in one place.) > Expose App status metrics as Source > ----------------------------------- > > Key: SPARK-25394 > URL: https://issues.apache.org/jira/browse/SPARK-25394 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Affects Versions: 2.4.0 > Reporter: Stavros Kontopoulos > Priority: Major > > ApplicationListener in Spark core captures useful metrics like job duration > which are exposed via the spark rest api (available both at the driver's ui > and the history server ui) only. From a devops perspective and especially on > k8s where metrics scrapping is often done via the prometheus jmx exporter it > would be good to have all metrics in one place, avoidn scraping the metrics > rest api. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org