[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2024-01-09 Thread bking 
bking closed this task as "Resolved".
bking moved this task from Backlog to Done on the Data-Platform-SRE (2023/24 Q3 
Milestone 1) board.
bking claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

WORKBOARD
  https://phabricator.wikimedia.org/project/board/6881/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking
Cc: bking, dcausse, Gehel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, 
AWesterinen, BTullis, karapayneWMDE, Invadibot, Zabe, LSobanski, maantietaja, 
lmata, ItamarWMDE, Akuckartz, PatsagornY, DannyS712, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
KimKelting, merbst, LawExplorer, elukey, _jensen, rosalieper, Scott_WUaS, 
Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Bawolff, Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, 
akosiaris, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2024-01-09 Thread bking 
bking added a comment.


  Based on a quick read of the linked documentation and a small addition, I 
believe we have satisfied the requirements. Closing...

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking
Cc: bking, dcausse, Gehel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, 
AWesterinen, BTullis, karapayneWMDE, Invadibot, Zabe, LSobanski, maantietaja, 
lmata, ItamarWMDE, Akuckartz, PatsagornY, DannyS712, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
KimKelting, merbst, LawExplorer, elukey, _jensen, rosalieper, Scott_WUaS, 
Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Bawolff, Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, 
akosiaris, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-12-20 Thread Gehel 
Gehel moved this task from Incidents / Follow up to 23/24 Q3 Milestone 1 on the 
Data-Platform-SRE board.
Gehel edited projects, added Data-Platform-SRE (23/24 Q3 Milestone 1); removed 
Data-Platform-SRE.

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

WORKBOARD
  https://phabricator.wikimedia.org/project/board/6524/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking, Gehel
Cc: bking, dcausse, Gehel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, 
AWesterinen, BTullis, karapayneWMDE, Invadibot, Zabe, LSobanski, maantietaja, 
lmata, ItamarWMDE, Akuckartz, PatsagornY, DannyS712, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, 
Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, akosiaris, 
fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-12-20 Thread Gehel 
Gehel removed bking as the assignee of this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: bking, dcausse, Gehel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, 
AWesterinen, BTullis, karapayneWMDE, Invadibot, Zabe, LSobanski, maantietaja, 
lmata, ItamarWMDE, Akuckartz, PatsagornY, DannyS712, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, 
Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, akosiaris, 
fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-06-27 Thread Gehel 
Gehel triaged this task as "High" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

WORKBOARD
  https://phabricator.wikimedia.org/project/board/6524/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking, Gehel
Cc: bking, dcausse, Gehel, Aklapper, Astuthiodit_1, AWesterinen, BTullis, 
karapayneWMDE, Invadibot, Zabe, LSobanski, maantietaja, lmata, ItamarWMDE, 
Akuckartz, PatsagornY, DannyS712, Nandana, Namenlos314, jijiki, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, 
Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-06-13 Thread Gehel 
Gehel added a project: Data-Platform-SRE.

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking, Gehel
Cc: bking, dcausse, Gehel, Aklapper, Astuthiodit_1, AWesterinen, BTullis, 
karapayneWMDE, Invadibot, Zabe, MPhamWMF, LSobanski, maantietaja, lmata, 
ItamarWMDE, Akuckartz, PatsagornY, DannyS712, Nandana, Namenlos314, jijiki, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, 
Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-05-30 Thread bking 
bking added projects: Sustainability, SRE-OnFire.

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking
Cc: bking, dcausse, Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, Zabe, MPhamWMF, LSobanski, maantietaja, lmata, ItamarWMDE, 
Akuckartz, PatsagornY, DannyS712, Nandana, Namenlos314, jijiki, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, 
Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-05-25 Thread bking 
bking added a comment.


  Other action items:
  
  - Add link to new WDQS superset dashboard to WDQS runbook page.
  - Fix dead logstash link on WDQS runbook page 

  - Better documentation of throttling behavior as described in rdf repo at 
`blazegraph/src/main/java/org/wikidata/query/rdf/blazegraph/throttling/ThrottlingFilter.java`
  - Learn if we have a "slow log" for SPARQL queries and how to quickly access 
it.

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking
Cc: bking, dcausse, Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, Zabe, MPhamWMF, maantietaja, lmata, ItamarWMDE, Akuckartz, 
PatsagornY, DannyS712, Nandana, Namenlos314, jijiki, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, 
Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-05-22 Thread bking 
bking claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking
Cc: bking, dcausse, Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, Zabe, MPhamWMF, maantietaja, lmata, ItamarWMDE, Akuckartz, 
PatsagornY, DannyS712, Nandana, Namenlos314, jijiki, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, 
Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-05-22 Thread bking 
bking added subscribers: dcausse, bking.
bking added a comment.


  Updated the Streaming Updater operations docs 

 after today's pairing session with @dcausse  . We'll continue to update the 
docs as we examine previous alerts in T336574 
 .

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking
Cc: bking, dcausse, Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, Zabe, MPhamWMF, maantietaja, lmata, ItamarWMDE, Akuckartz, 
PatsagornY, DannyS712, Nandana, Namenlos314, jijiki, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, 
Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-05-15 Thread RKemper 
RKemper updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, 
Zabe, MPhamWMF, maantietaja, lmata, ItamarWMDE, Akuckartz, PatsagornY, 
DannyS712, Nandana, Namenlos314, jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, elukey, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Bawolff, Manybubbles, ArielGlenn, He7d3r, 
Jdforrester-WMF, Mbch331, Jay8g, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-05-15 Thread MPhamWMF 
MPhamWMF set the point value for this task to "3".

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, 
Zabe, MPhamWMF, maantietaja, lmata, ItamarWMDE, Akuckartz, PatsagornY, 
DannyS712, Nandana, Namenlos314, jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, elukey, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Bawolff, Manybubbles, ArielGlenn, He7d3r, 
Jdforrester-WMF, Mbch331, Jay8g, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-05-15 Thread MPhamWMF 
MPhamWMF moved this task from Incoming to Current work on the 
Wikidata-Query-Service board.
MPhamWMF added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, 
Zabe, MPhamWMF, maantietaja, lmata, ItamarWMDE, Akuckartz, PatsagornY, 
DannyS712, Nandana, Namenlos314, jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, elukey, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Bawolff, Manybubbles, ArielGlenn, He7d3r, 
Jdforrester-WMF, Mbch331, Jay8g, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-05-12 Thread Gehel 
Gehel created this task.
Gehel added projects: Wikidata-Query-Service, Wikidata, Wikimedia-Incident.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  As part of recent incident (T336134 
) we identified that the 
documentation to diagnose and fix the issue needs improvement. A runbook 
explain the necessary steps to understand and mitigate an ongoing incident so 
that operators can act quickly to restore service.
  
  Note that the focus should be on restoring the service to our users. Some 
remediation steps that can be taken at a later date can wait for an expert to 
be available. In this case, we want to have the appropriate documentation 
needed to diagnose the issue (which dashboards to look at, how to interpret 
them, what logs might be expected, etc...). We might also want to have 
documentation on how to restart the WDQS Streaming Updater, how to redeploy it, 
how to change memory limits.
  
  AC:
  
  - documentation 
 is updated 
with the steps that were needed during this incident
- dashboards and logs used
- restart of the WDQS Streaming Updater
- memory configuration of the WDQS Streaming Updater

TASK DETAIL
  https://phabricator.wikimedia.org/T336577

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, 
Zabe, MPhamWMF, maantietaja, lmata, ItamarWMDE, Akuckartz, PatsagornY, 
DannyS712, Nandana, Namenlos314, jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, elukey, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Bawolff, Manybubbles, ArielGlenn, He7d3r, 
Jdforrester-WMF, Mbch331, Jay8g, akosiaris, RhinosF1
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org