I faced this issue in the design phase too, found this https://github.com/beorn-/highlander but it looks a bit dead now... else you can push duplicated metrics to thanos (while setting a unique label for every prometheus instance) and then configure thanos querier to deduplicate when serving metrics On Friday, November 4, 2022 at 3:40:29 PM UTC+1 Julien Pivotto wrote:
> You would need additional tools like corosync or keepalived to achieve > this. In prometheus terms, all the prometheis servers are active and > deduplication is done at the remote write end if needed. > > On 04 Nov 07:24, Navid Shakibapour wrote: > > Is there a way to set up multiple Prometheus servers in an > active/passive > > way? Meaning only 1 server scrapes targets at a time and other ones only > > scrape if the active one doesn't "work" after x seconds/minutes. > > > > On Friday, November 4, 2022 at 3:00:15 AM UTC-4 sup...@gmail.com wrote: > > > > > There is no option without using a single instance. If your 3rd party > > > solution does not handle HA, you can not use HA. > > > > > > On Fri, Nov 4, 2022 at 7:57 AM Navid Shakibapour < > navid.sh...@gmail.com> > > > wrote: > > > > > >> We are evaluating using Prometheus agent mode in a highly available > > >> manner to forward metrics to a 3rd party remote storage using remote > write > > >> API. > > >> We need to have multiple shards and multiple replicas per shard. Our > 3rd > > >> party remote storage does not handle deduplication on their side. > > >> > > >> Could someone point me to different options for metrics deduplication > on > > >> ingestion? > > >> > > >> > > >> -- > > >> You received this message because you are subscribed to the Google > Groups > > >> "Prometheus Users" group. > > >> To unsubscribe from this group and stop receiving emails from it, > send an > > >> email to prometheus-use...@googlegroups.com. > > >> To view this discussion on the web visit > > >> > https://groups.google.com/d/msgid/prometheus-users/1b274d3d-77a9-4de3-9b63-61a533b84140n%40googlegroups.com > > > >> < > https://groups.google.com/d/msgid/prometheus-users/1b274d3d-77a9-4de3-9b63-61a533b84140n%40googlegroups.com?utm_medium=email&utm_source=footer > > > > >> . > > >> > > > > > > > -- > > You received this message because you are subscribed to the Google > Groups "Prometheus Users" group. > > To unsubscribe from this group and stop receiving emails from it, send > an email to prometheus-use...@googlegroups.com. > > To view this discussion on the web visit > https://groups.google.com/d/msgid/prometheus-users/91c8b0d4-67e2-40d3-8314-bd58409cf937n%40googlegroups.com > . > > > -- > Julien Pivotto > @roidelapluie > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/5cfbf874-6449-4215-bcdd-3c856fa68e7dn%40googlegroups.com.
