Re: [prometheus-developers] Re: auto discover of targets in Prometheus

2021-02-19 Thread Ben Kochie
Prometheus absolutely does do dynamic discovery. See the scrape_config section of the docs: https://prometheus.io/docs/prometheus/latest/configuration/configuration/#scrape_config There are 16 available XXX_sd_configs options there. If your source of truth isn't listed, you can either write your

Re: [prometheus-developers] Re: auto discover of targets in Prometheus

2021-02-19 Thread Stuart Clark
On 19/02/2021 22:19, Gajendra Ambi wrote: Hi, I too just discovered that it does not do dynamic discovery. I have to tell prometheus to see it by using file based discovery in prometheus. This is very unfortunate where we have 100s of nodes and growing and each group of devs who own them get t

Re: [prometheus-developers] Re: auto discover of targets in Prometheus

2021-02-19 Thread Gajendra Ambi
Hi, I too just discovered that it does not do dynamic discovery. I have to tell prometheus to see it by using file based discovery in prometheus. This is very unfortunate where we have 100s of nodes and growing and each group of devs who own them get to add them when they want. Currently it seem

Re: [prometheus-developers] Re: auto discover of targets in Prometheus

2021-02-19 Thread Julien Pivotto
On 19 Feb 14:00, Gajendra Ambi wrote: > Everyone gives the same link > https://prometheus.io/docs/prometheus/latest/configuration/configuration when > asked about auto discovery of physical nodes but the entire page has only 2 > occurences of the word auto-discovery. > We have 700+ physical ser

[prometheus-developers] Re: auto discover of targets in Prometheus

2021-02-19 Thread Gajendra Ambi
Everyone gives the same link https://prometheus.io/docs/prometheus/latest/configuration/configuration when asked about auto discovery of physical nodes but the entire page has only 2 occurences of the word auto-discovery. We have 700+ physical servers and Prometheus is running on k8s (targets a

Re: [prometheus-developers] [RFC] Splitting Prometheus configuration in multiple files

2021-02-19 Thread Tom Wilkie
Why you no use jsonnet? Or Cue? ...but seriously, I think this is a good next step. LGTM On Thu, Feb 18, 2021 at 9:46 PM Julien Pivotto wrote: > Hello, > > I have put together a design doc to split the prometheus configuration, > as per dev summit 2020/4 > > > https://docs.google.com/document