[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2024-03-26 Thread dcausse
dcausse removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hoo, dcausse Cc: Lucas_Werkmeister_WMDE, Aklapper, ItamarWMDE, dcausse, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2024-03-26 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hoo, gerritbot Cc: Lucas_Werkmeister_WMDE, Aklapper, ItamarWMDE, dcausse, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2024-03-26 Thread gerritbot
gerritbot added a comment. Change #1014580 had a related patch set uploaded (by DCausse; author: DCausse): [mediawiki/extensions/Wikidata.org@master] updateQueryServiceLag: add an option to tune the query rate https://gerrit.wikimedia.org/r/1014580 TASK DETAIL

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-07-27 Thread ItamarWMDE
ItamarWMDE closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hoo, ItamarWMDE Cc: Lucas_Werkmeister_WMDE, Aklapper, ItamarWMDE, dcausse, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-07-27 Thread ItamarWMDE
ItamarWMDE added a comment. Wow! this is such an improvement of the Query lag calculation, and it greatly reduces the complexity here. Thank you @hoo and nice find on the `topk`. TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-07-11 Thread Maintenance_bot
Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hoo, Maintenance_bot Cc: Lucas_Werkmeister_WMDE, Aklapper, ItamarWMDE, dcausse, Astuthiodit_1,

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-07-11 Thread gerritbot
gerritbot added a comment. Change 936052 **merged** by jenkins-bot: [mediawiki/extensions/Wikidata.org@master] Use new Prometheus query in updateQueryServiceLag https://gerrit.wikimedia.org/r/936052 TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-07-06 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hoo, gerritbot Cc: Lucas_Werkmeister_WMDE, Aklapper, ItamarWMDE, dcausse, Isabelladantes1983,

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-07-06 Thread gerritbot
gerritbot added a comment. Change 936052 had a related patch set uploaded (by Hoo man; author: Hoo man): [mediawiki/extensions/Wikidata.org@master] Use new Prometheus query in updateQueryServiceLag https://gerrit.wikimedia.org/r/936052 TASK DETAIL

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-07-05 Thread dcausse
dcausse added a comment. @hoo using `topk` sounds good to me! I used `max` to graph the maxlag on a single timeseries in grafana but hadn't thought about your usecase. TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-07-04 Thread hoo
hoo added a comment. I found that I can re-write the query to use `topk` (with k=1) instead of `max`, which should do the very same as max, except that it also returns all original fields (please correct me if I'm wrong @dcausse): bottomk(1, time() -

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-07-04 Thread hoo
hoo added a comment. One problem encountered while migrating the maintenance script to the new format is, that we can no longer report which server is the most lagged. TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-06-29 Thread hoo
hoo claimed this task. hoo moved this task from Todo/Backlog to Doing on the Wikidata Dev Team (Sprint-∞) board. TASK DETAIL https://phabricator.wikimedia.org/T336352 WORKBOARD https://phabricator.wikimedia.org/project/board/6017/ EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-06-28 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE moved this task from Parents/Waiting to Todo/Backlog on the Wikidata Dev Team (Sprint-∞) board. Lucas_Werkmeister_WMDE added a comment. Notes from task breakdown: - At some point during development or review, someone should verify that the updated URL returns

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-06-28 Thread Michael
Michael updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Michael Cc: Aklapper, ItamarWMDE, dcausse, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, maantietaja,

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-06-28 Thread karapayneWMDE
karapayneWMDE moved this task from Unified prioritized backlog to Sprint-∞ on the Wikidata Dev Team board. karapayneWMDE edited projects, added Wikidata Dev Team (Sprint-∞); removed Wikidata Dev Team. TASK DETAIL https://phabricator.wikimedia.org/T336352 WORKBOARD

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-06-28 Thread karapayneWMDE
karapayneWMDE set the point value for this task to "5". TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: karapayneWMDE Cc: Aklapper, ItamarWMDE, dcausse, Astuthiodit_1, AWesterinen, karapayneWMDE,

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-06-28 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lucas_Werkmeister_WMDE Cc: Aklapper, ItamarWMDE, dcausse, Astuthiodit_1, AWesterinen,

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-05-10 Thread ItamarWMDE
ItamarWMDE renamed this task from "[SW] Update maxlag calculation maintenance script to reflect new prometheus queries" to "Update maxlag calculation maintenance script to reflect new prometheus queries". TASK DETAIL https://phabricator.wikimedia.org/T336352 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-05-10 Thread ItamarWMDE
ItamarWMDE added a comment. Prioritzation meeting notes from parent task: **Task Review**: - This may produce false positive alerts when switching over data centers, which adds overhead to an already stressful situation. - The scope of the task for the Wikidata team is to replace

[Wikidata-bugs] [Maniphest] T336352: Update maxlag calculation maintenance script to reflect new prometheus queries

2023-05-10 Thread ItamarWMDE
ItamarWMDE created this task. ItamarWMDE added projects: Wikidata, Wikidata-Query-Service, Wikidata.org, wmde-wikidata-tech, Wikidata Dev Team. TASK DESCRIPTION **Problem:** In T331405: [SW] Query service maxlag calculation should exclude datacenters that don't receive traffic and where