Luca Canali created SPARK-22190: ----------------------------------- Summary: Add Spark executor task metrics to Dropwizard metrics Key: SPARK-22190 URL: https://issues.apache.org/jira/browse/SPARK-22190 Project: Spark Issue Type: Improvement Components: Spark Core Affects Versions: 2.2.0 Reporter: Luca Canali Priority: Minor
I would like to propose to expose Spark executor task metrics using the Dropwizard metrics. I have developed a simple implementation and run a few tests using Graphite sink and Grafana visualization and this appears to me a good source of information for monitoring and troubleshooting the progress of Spark jobs. I attach a screenshot of an example graph generated with Grafana. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org