Re: Flink Promethues Metricsreporter Question

2020-08-06 Thread Chesnay Schepler

The PrometheusReporter acts as a scraping target for a single process.
If you already have setup something in the Flink cluster that allows 
Prometheus/ServiceMonitor to scrape (Flink) metrics, then it shouldn't 
be necessary.
It doesn't coordinate with other services in any way; it just has access 
to Flink metrics and waits for someone to scrape them.


On 05/08/2020 23:28, Avijit Saha wrote:

Hi,

Have a general question about Flink support for Prometheus metrics. We 
already have a Prometheus setup in our cluster with ServiceMonitor-s 
monitoring ports like 8080 etc. for scraping metrics.


In a setup like this, if we deploy Flink Job managers/Task managers in 
the cluster, is there any need to have the PrometheusReporter 
configured as well? How does that coordinate with existing 
Prometheus ServiceMonitors if present?


Is the PrometheusReporter based on "pull" model so that it can pull 
metrics from Flink and send to some Prometheus host system?


Thanks
Avijit





Flink Promethues Metricsreporter Question

2020-08-05 Thread Avijit Saha
Hi,

Have a general question about Flink support for Prometheus metrics. We
already have a Prometheus setup in our cluster with ServiceMonitor-s
monitoring ports like 8080 etc. for scraping metrics.

In a setup like this, if we deploy Flink Job managers/Task managers in the
cluster, is there any need to have the PrometheusReporter configured as
well? How does that coordinate with existing Prometheus ServiceMonitors if
present?

Is the  PrometheusReporter based on "pull" model so that it can pull
metrics from Flink and send to some Prometheus host system?

Thanks
Avijit