Re: [METRICS] Metrics names inconsistent between executions

2019-05-07 Thread Stavros Kontopoulos
Hi, With jmx_exporter and Prometheus you can always re-write the metrics patterns on the fly. Btw if you use Grafana its easy to filter things even without the re-write. If this is a custom dashboard you can always group metrics based on the

[METRICS] Metrics names inconsistent between executions

2019-05-06 Thread Anton Kirillov
Hi everyone! We are currently working on building a unified monitoring/alerting solution for Spark and would like to rely on Spark's own metrics to avoid divergence from the upstream. One of the challenges is to support metrics coming from multiple Spark applications running on a cluster: