[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

bking moved this task from In Progress to Done on the Data-Platform-SRE (2024.05.27 - 2024.06.16) board. bking closed this task as "Resolved". bking added a comment. We've merged the above patches, so the alerts are now active. Closing... TASK DETAIL https://phabricator.wikimedia.org/T36111

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

gerritbot added a comment. Change #1038454 **merged** by jenkins-bot: [operations/alerts@master] data-platform: add alert for WDQS MaxLag https://gerrit.wikimedia.org/r/1038454 TASK DETAIL https://phabricator.wikimedia.org/T361114 EMAIL PREFERENCES https://phabricator.wikimedia.

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

gerritbot added a comment. Change #1038454 had a related patch set uploaded (by Bking; author: Bking): [operations/alerts@master] data-platform: add alert for WDQS MaxLag https://gerrit.wikimedia.org/r/1038454 TASK DETAIL https://phabricator.wikimedia.org/T361114 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T361114 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, gerritbot Cc: Lucas_Werkmeister_WMDE, dcausse, Aklapper, bking, Danny_Benjafield_WMDE, Isabellad

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

gerritbot added a comment. Change #1037602 had a related patch set uploaded (by Bking; author: Bking): [operations/puppet@production] wdqs: Add alert for maxlag https://gerrit.wikimedia.org/r/1037602 TASK DETAIL https://phabricator.wikimedia.org/T361114 EMAIL PREFERENCES https:/

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

Gehel edited projects, added Data-Platform-SRE (2024.05.27 - 2024.06.16); removed Data-Platform-SRE (2024.05.06 - 2024.05.26). Gehel moved this task from Backlog to In Progress on the Data-Platform-SRE (2024.05.27 - 2024.06.16) board. TASK DETAIL https://phabricator.wikimedia.org/T361114 WORK

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

bking lowered the priority of this task from "High" to "Medium". bking claimed this task. bking updated Other Assignee, added: RKemper. TASK DETAIL https://phabricator.wikimedia.org/T361114 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking Cc: Luc

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

Gehel edited projects, added Data-Platform-SRE (2024.05.06 - 2024.05.26); removed Data-Platform-SRE (2024.04.15 - 2024.05.05). TASK DETAIL https://phabricator.wikimedia.org/T361114 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Lucas_Werkm

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

Gehel removed a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T361114 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Lucas_Werkmeister_WMDE, dcausse, Aklapper, bking, Danny_Benjafield_WMDE, S832141

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

Gehel edited projects, added Data-Platform-SRE (2024.04.15 - 2024.05.05); removed Data-Platform-SRE (2024.03.25 - 2024.04.14). TASK DETAIL https://phabricator.wikimedia.org/T361114 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Lucas_Werkm

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

dr0ptp4kt set the point value for this task to "2". TASK DETAIL https://phabricator.wikimedia.org/T361114 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dr0ptp4kt Cc: Lucas_Werkmeister_WMDE, dcausse, Aklapper, bking, Danny_Benjafield_WMDE, S8321414,

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

bking added a comment. @Lucas_Werkmeister_WMDE @dcausse I should be able to help out with this one within the next 2 weeks. Typically we would create the alerts in the alerts repo . Our AlertManager implementation requires a distin

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

dcausse added a comment. Thanks! I'm not very familiar with alerts being set from grafana neither, I'll try to get more info on this, worst case we can always set up a new one directly in alertmanager just for the wdqs lag and sent to the search team using the same formula used by updateQuer

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

Lucas_Werkmeister_WMDE added a comment. I’m not sure – I can see a Notifications section when editing the alert , but it has “team” set to “wikidata”, and I’m not very familiar with AlertManager

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

dcausse removed dcausse as the assignee of this task. dcausse added a comment. @Lucas_Werkmeister_WMDE thanks! Do you know where we could update this to include our alert email for such alerts? TASK DETAIL https://phabricator.wikimedia.org/T361114 EMAIL PREFERENCES https://phabricator.wi

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

Lucas_Werkmeister_WMDE added a comment. +1, probably makes sense to add you to the maxlag alert in particular. (The other ones are probably not relevant to Search Platform.) TASK DETAIL https://phabricator.wikimedia.org/T361114 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

Gehel moved this task from Incoming to 2024.03.25 - 2024.04.14 on the Data-Platform-SRE board. Gehel edited projects, added Data-Platform-SRE (2024.03.25 - 2024.04.14); removed Data-Platform-SRE. TASK DETAIL https://phabricator.wikimedia.org/T361114 WORKBOARD https://phabricator.wikimedia.o

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T361114 WORKBOARD https://phabricator.wikimedia.org/project/board/6524/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: dcausse, Aklapper,

[Wikidata-bugs] [Maniphest] T361114: Alert Search Platform and/or DPE SRE when Wikidata is lagged

bking created this task. bking added projects: Wikidata-Query-Service, Discovery-Search (Current work), Wikidata, Patch-For-Review, Data-Platform-SRE. Restricted Application removed a project: Patch-For-Review. TASK DESCRIPTION Per parent ticket, our inaccurate MaxLag calculation caused throttl