[Wikidata-bugs] [Maniphest] T350255: Repeated Wikidata Grafana alerts due to "failed to query data"

2023-11-01 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE closed this task as a duplicate of T348831: [SW] [WD-ORG] [TECH] Max Lag alerts misfire with a DataSource error. TASK DETAIL https://phabricator.wikimedia.org/T350255 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To:

[Wikidata-bugs] [Maniphest] T350255: Repeated Wikidata Grafana alerts due to "failed to query data"

2023-11-01 Thread fgiunchedi
fgiunchedi added a comment. Thank you for reaching out @Lucas_Werkmeister_WMDE ! Yes indeed known issue, we (o11y) recommend turning off notifications for datasource errors (full rationale in https://phabricator.wikimedia.org/T347221#9264101) and the instructions being at

[Wikidata-bugs] [Maniphest] T350255: Repeated Wikidata Grafana alerts due to "failed to query data"

2023-11-01 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE created this task. Lucas_Werkmeister_WMDE added projects: Wikidata, Grafana, Observability-Alerting, wmde-wikidata-tech. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION We keep getting alerts like the following: > **Labels** > > alertname =