Hi, We have a scenario where Prometheus and Alert Manager are running in HA mode.
We have 2 instances of Prometheus running on 2 nodes and 2 alert managers configured for each of the Prometheus instances. When an alert is getting raised, one of the Alertmanager forwards an alert first. Subsequently, when the alert is getting cleared, the second alert manager raises and clears the same alert. Alertmanager 1 => raises alert After some time, when Alertmanager 1 => clears alert, then Alertmanager 2 => raises the same alert Alertmanager 2 => clears alert Expectation: We want one alarm to be raised and cleared for one particular alert. Also, we would like to know the reason why the second Alertmanager sends and clears the alert when the first alert manager clears the alert. We enabled debug logs for the Alertmanager, but we didn't find anything related to this. Please let us know where we can find more logs related to this. Prometheus Version: 2.11.1 Alertmanager Version: 0.16.2 -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/9a809dfd-4eca-464b-87ab-7cc9c6140a75%40googlegroups.com.
