[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2024-01-09 Thread bking
bking closed subtask T336577: Update WDQS Runbook following update lag incident as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking Cc: karapayneWMDE, bking, Aklapper, Bugreporter

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-08-14 Thread bking
bking closed subtask T337801: WDQS: Document procedure for switching between Kubernetes and Yarn Streaming Updater as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking Cc: karapayn

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-08-11 Thread bking
bking added a subtask: T337801: WDQS: Document procedure for switching between Kubernetes and Yarn Streaming Updater. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking Cc: karapayneWMDE, bking

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-06-09 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, Gehel Cc: karapayneWMDE, bking, Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, Invadibot, Zabe, MPh

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-12 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, Gehel Cc: bking, Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, Zabe, MPham

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-12 Thread Gehel
Gehel added a subtask: T270614: Automatically depool wdqs servers that are "lagged". TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, Gehel Cc: bking, Aklapper, Bugreporter, Astuthiodit_1, A

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-12 Thread Gehel
Gehel added a subtask: T336574: Review alerting around Wikidata Query Service update pipeline. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, Gehel Cc: bking, Aklapper, Bugreporter, Astuth

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-12 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, Gehel Cc: bking, Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, Zabe, MPham

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-12 Thread Bugreporter
Bugreporter added a project: Wikimedia-Incident. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, Bugreporter Cc: bking, Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, karapayneWMDE, Inv

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-12 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, Gehel Cc: bking, Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, MPhamWMF, m

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-12 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, Gehel Cc: bking, Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, MPhamWMF, m

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-11 Thread bking
bking updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking Cc: bking, Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, MPhamWMF, maantiet

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-11 Thread Maintenance_bot
Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, Maintenance_bot Cc: bking, Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, karapayneWM

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-11 Thread gerritbot
gerritbot added a comment. Change 917935 **merged** by jenkins-bot: [operations/deployment-charts@master] rdf-streaming-updater: Increase task manager memory alloc https://gerrit.wikimedia.org/r/917935 TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES http

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-11 Thread dcausse
dcausse updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, dcausse Cc: bking, Aklapper, Bugreporter, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, As

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-10 Thread dcausse
dcausse lowered the priority of this task from "Unbreak Now!" to "High". dcausse updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, dcausse Cc: bking, Aklapper, Bu

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-09 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, gerritbot Cc: bking, Aklapper, Bugreporter, Themindcoder, Adamm71, Jersione, Hellket777, LisafBi

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-09 Thread gerritbot
gerritbot added a comment. Change 917935 had a related patch set uploaded (by Bking; author: Bking): [operations/deployment-charts@master] rdf-streaming-updater: Increase task manager memory alloc https://gerrit.wikimedia.org/r/917935 TASK DETAIL https://phabricator.wikimedia.org/

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-09 Thread Maintenance_bot
Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, Maintenance_bot Cc: bking, Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, karapayneWM

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-09 Thread gerritbot
gerritbot added a comment. Change 917820 **merged** by jenkins-bot: [operations/deployment-charts@master] flink-session-cluster: enable rocksdb metrics and increase jvm heap https://gerrit.wikimedia.org/r/917820 TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFEREN

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-09 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, gerritbot Cc: bking, Aklapper, Bugreporter, Themindcoder, Adamm71, Jersione, Hellket777, LisafBi

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-09 Thread gerritbot
gerritbot added a comment. Change 917820 had a related patch set uploaded (by DCausse; author: DCausse): [operations/deployment-charts@master] flink-session-cluster: enable rocksdb metrics and increase jvm heap https://gerrit.wikimedia.org/r/917820 TASK DETAIL https://phabricator.

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-08 Thread ops-monitoring-bot
ops-monitoring-bot added a comment. Host rebooted by bking@cumin1001 with reason: None TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, ops-monitoring-bot Cc: bking, Aklapper, Bugreporter

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-08 Thread ops-monitoring-bot
ops-monitoring-bot added a comment. Host rebooted by bking@cumin1001 with reason: None TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, ops-monitoring-bot Cc: bking, Aklapper, Bugreporter

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-08 Thread ops-monitoring-bot
ops-monitoring-bot added a comment. Host rebooted by bking@cumin1001 with reason: None TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, ops-monitoring-bot Cc: bking, Aklapper, Bugreporter

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-08 Thread ops-monitoring-bot
ops-monitoring-bot added a comment. Icinga downtime and Alertmanager silence (ID=40727833-628f-4d74-8179-b284df022778) set by bking@cumin1001 for 4:00:00 on 1 host(s) and their services with reason: rebooting to help with lag wdqs2006.codfw.wmnet TASK DETAIL https://phabricator.wiki

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-08 Thread ops-monitoring-bot
ops-monitoring-bot added a comment. Icinga downtime and Alertmanager silence (ID=8eda2109-041e-49e8-9896-a24bb9b2645e) set by bking@cumin1001 for 4:00:00 on 1 host(s) and their services with reason: rebooting to help with lag wdqs1004.eqiad.wmnet TASK DETAIL https://phabricator.wiki

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-08 Thread ops-monitoring-bot
ops-monitoring-bot added a comment. Icinga downtime and Alertmanager silence (ID=d5700f27-224a-464e-878a-4a5780b823f5) set by bking@cumin1001 for 4:00:00 on 19 host(s) and their services with reason: rebooting to help with lag wdqs[2004-2022].codfw.wmnet TASK DETAIL https://phabrica

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-08 Thread bking
bking claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking Cc: bking, Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, MPhamWMF, maantietaja, Itamar

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-08 Thread Gehel
Gehel updated the task description. Gehel set the point value for this task to "5". TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, kara

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-08 Thread Gehel
Gehel moved this task from Incoming to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T336134 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES https://p

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-07 Thread Bugreporter
Bugreporter triaged this task as "Unbreak Now!" priority. TASK DETAIL https://phabricator.wikimedia.org/T336134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Bugreporter Cc: Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibo

[Wikidata-bugs] [Maniphest] T336134: wdqs2*** lagged for more than one day

2023-05-07 Thread Bugreporter
Bugreporter created this task. Bugreporter added projects: Wikidata-Query-Service, Wikidata. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION See https://grafana.wikimedia.org/d/00489/wikidata-query-service?orgId=1&refresh=1m TASK DETAIL https://phabricator.wikimedia