I have prometheus server installed in each environment. Say, I have 5 environments. I have one federated prometheus which scrapes specific metric from all those 5 prometheus servers. I have retention period of metrics as 10 days in each individual prometheus servers, while the federated prometheus has the retention period of 1 year.
Let the individual prometheus servers name be: 1) Prometheus-1 2) Prometheus-2 3) Prometheus-3 4) Prometheus-4 5) Prometheus-5 Till a date, say 01/02/2021, I have all those metrics visible in my federated cluster. Let the metric value as of 01/02/2021 be "x" from all the 5 prometheus servers. Now one of the 5 prometheus servers, say prometheus-3 server, has lost all its data on 02/02/2021, due to some reasons and the prometheus server itself has got stopped. Below are the doubts I have 1) If I query for a metric in federated prometheus, before the prometheus-3 server becomes active, will I get any data of prometheus-3 server? 2) As I mentioned , prometheus-3 server has lost all its data, now if the prometheus-3 server becomes active on 03/02/2021 with metric value "y"(which will be very less, since all historical data are lost) and when I query data of prometheus-3 in federated cluster, what will be the metric value I will be getting? Will it be x+y or just y? Thanks R.Natarajan -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/f725be4b-bd04-4c76-ae2f-48dce2d6e9aen%40googlegroups.com.
