Hi Kedar! What evidence do you have that the alert was triggered outside of prometheus, and how far can you follow it back? We could start there.
You can turn on debug logging for both prometheus and alertmanager and that may tell you more, --log.level=debug Sally On Wednesday, May 27, 2020 at 11:53:55 AM UTC-7, kedar sirshikar wrote: > > Hi all, > > We have seen an alert getting triggered couple of days ago and it got > resolved after 5 seconds. > > After checking container logs & grafana screenshots, no evidence was seen > in support of the alert which was created and resolved. > > System does not show any symptom relevant to the particular alert since > last week. > > So wanted to know if there is anything which can be tracked from > prometheus side to know why alert was generated? > > Please let me know if someone has any inputs about these kind of > suspicious alerts. > > Thanks. > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/73ca94ac-124b-44ba-9c90-96c8e8203fc1%40googlegroups.com.

