subject:"\[Wikidata\-bugs\] \[Maniphest\] T290330\: Wikidata Query Service unstable in codfw"

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2022-06-06 Thread Maintenance_bot

Maintenance_bot removed a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Maintenance_bot
Cc: dcausse, RKemper, Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, 
Gehel, Ladsgroup, Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, 
karapayneWMDE, Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331, Fernandobacasegua34, 786, Suran38, Biggs657, Lalamarie69, Juan90264, 
Alter-paule, Beast1978, Un1tY, Hook696, Kent7301, joker88john, CucyNoiD, 
Gaboe420, Giuliamocci, Cpaulf30, Af420, Bsandipan, Lewizho99, Maathavan, 
Neuronton
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2022-06-06 Thread gerritbot

gerritbot added a comment.


  Change 803336 **merged** by Ryan Kemper:
  
  [operations/puppet@production] query service: clean up absented resources
  
  https://gerrit.wikimedia.org/r/803336

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, gerritbot
Cc: dcausse, RKemper, Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, 
Gehel, Ladsgroup, Aklapper, Bugreporter, Fernandobacasegua34, Astuthiodit_1, 
AWesterinen, 786, Suran38, Biggs657, karapayneWMDE, Invadibot, Lalamarie69, 
MPhamWMF, maantietaja, Juan90264, Alter-paule, Beast1978, CBogen, ItamarWMDE, 
Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, 
Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2022-06-06 Thread gerritbot

gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, gerritbot
Cc: dcausse, RKemper, Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, 
Gehel, Ladsgroup, Aklapper, Bugreporter, Fernandobacasegua34, Astuthiodit_1, 
AWesterinen, 786, Suran38, Biggs657, karapayneWMDE, Invadibot, Lalamarie69, 
MPhamWMF, maantietaja, Juan90264, Alter-paule, Beast1978, CBogen, ItamarWMDE, 
Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, 
Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2022-06-06 Thread gerritbot

gerritbot added a comment.


  Change 803336 had a related patch set uploaded (by Ryan Kemper; author: Ryan 
Kemper):
  
  [operations/puppet@production] query service: clean up absented resources
  
  https://gerrit.wikimedia.org/r/803336

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, gerritbot
Cc: dcausse, RKemper, Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, 
Gehel, Ladsgroup, Aklapper, Bugreporter, Astuthiodit_1, AWesterinen, 
karapayneWMDE, Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-11-15 Thread Gehel

Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: dcausse, RKemper, Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, 
Gehel, Ladsgroup, Aklapper, Bugreporter, Invadibot, MPhamWMF, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-10-19 Thread dcausse

dcausse assigned this task to RKemper.
dcausse added a comment.


  @RKemper is there still something left to do related to this?

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, dcausse
Cc: dcausse, RKemper, Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, 
Mholloway, Gehel, Ladsgroup, Aklapper, Bugreporter, Invadibot, MPhamWMF, 
maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-16 Thread RKemper

RKemper added a comment.


  We're no longer doing hourly restarts; we should monitor availability over 
the weekend to make sure that we're capable of handling current load without 
the crutch of the hourly restarts. We still have the useragent we banned in the 
last full outage (dailymotion) banned, so I'd think we'll be okay on load, but 
I'll be checking Grafana over the next couple days.
  
  We can/should unban dailymotion early next week - perhaps tuesday - if wdqs 
has been stable over the weekend and during monday's load

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, Mholloway, 
Gehel, Ladsgroup, Aklapper, Bugreporter, Invadibot, MPhamWMF, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-16 Thread Stashbot

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2021-09-17T02:28:39Z]  
T290330  [Remove WDQS codfw ~hourly 
restarts] Successfully rolled out to rest of fleet `sudo cumin 
'C:query_service::crontasks' 'sudo run-puppet-agent --force && sudo systemctl 
reset-failed wdqs-restart-hourly-w-random-delay.timer'`

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, 
Ladsgroup, Aklapper, Bugreporter, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-16 Thread Stashbot

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2021-09-17T02:22:00Z]  
T290330  [Remove WDQS codfw ~hourly 
restarts] `wdqs2001` and `wdqs2004` look fine after running `sudo systemctl 
reset-failed wdqs-restart-hourly-w-random-delay.timer` to clean up dangling 
timer

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, 
Ladsgroup, Aklapper, Bugreporter, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-16 Thread Maintenance_bot

Maintenance_bot removed a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, 
Ladsgroup, Aklapper, Bugreporter, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331, Suran38, Biggs657, Lalamarie69, Juan90264, Alter-paule, 
Beast1978, Un1tY, Hook696, Kent7301, joker88john, CucyNoiD, Gaboe420, 
Giuliamocci, Cpaulf30, Af420, Bsandipan, Lewizho99, Maathavan
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-16 Thread Stashbot

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2021-09-17T01:55:10Z]  
T290330  [Remove WDQS codfw ~hourly 
restarts] Testing on arbitrary codfw host: `ryankemper@wdqs2001:~$ sudo 
run-puppet-agent`

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, 
Ladsgroup, Aklapper, Bugreporter, Suran38, Biggs657, Invadibot, Lalamarie69, 
MPhamWMF, maantietaja, Juan90264, Alter-paule, Beast1978, CBogen, Un1tY, 
Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, 
Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-16 Thread Stashbot

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2021-09-17T01:47:59Z]  
T290330  [Remove WDQS codfw ~hourly 
restarts] `sudo cumin 'C:query_service::crontasks' 'sudo disable-puppet "Stop 
doing wdqs codfw ~hourly restarts - T290330"'`

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, 
Ladsgroup, Aklapper, Bugreporter, Suran38, Biggs657, Invadibot, Lalamarie69, 
MPhamWMF, maantietaja, Juan90264, Alter-paule, Beast1978, CBogen, Un1tY, 
Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, 
Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-16 Thread gerritbot

gerritbot added a comment.


  Change 720102 **merged** by Ryan Kemper:
  
  [operations/puppet@production] wdqs: remove codfw hourly restarts
  
  https://gerrit.wikimedia.org/r/720102

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, 
Ladsgroup, Aklapper, Bugreporter, Suran38, Biggs657, Invadibot, Lalamarie69, 
MPhamWMF, maantietaja, Juan90264, Alter-paule, Beast1978, CBogen, Un1tY, 
Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, 
Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-09 Thread gerritbot

gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, 
Ladsgroup, Aklapper, Bugreporter, Suran38, Biggs657, Invadibot, Lalamarie69, 
MPhamWMF, maantietaja, Juan90264, Alter-paule, Beast1978, CBogen, Un1tY, 
Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, 
Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-09 Thread gerritbot

gerritbot added a comment.


  Change 720102 had a related patch set uploaded (by Ryan Kemper; author: Ryan 
Kemper):
  
  [operations/puppet@production] wdqs: remove codfw hourly restarts
  
  https://gerrit.wikimedia.org/r/720102

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Addshore, LSobanski, RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, 
Ladsgroup, Aklapper, Bugreporter, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-03 Thread Stashbot

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2021-09-03T19:04:43Z]  
T290330  `ryankemper@cumin1001:~$ 
sudo -E cumin 'P{wdqs2*}' 'sudo rm -fv /etc/cron.hourly/restart-blazegraph'` 
(Cleaned up manually created crons now that we have [somewhat hacky] systemd 
timers doing the same job)

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, Ladsgroup, Aklapper, 
Bugreporter, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-03 Thread Maintenance_bot

Maintenance_bot removed a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, Ladsgroup, Aklapper, 
Bugreporter, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, 
Suran38, Biggs657, Lalamarie69, Juan90264, Alter-paule, Beast1978, Un1tY, 
Hook696, Kent7301, joker88john, CucyNoiD, Gaboe420, Giuliamocci, Cpaulf30, 
Af420, Bsandipan, Lewizho99, Maathavan
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-03 Thread Stashbot

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2021-09-03T17:17:55Z]  
T290330  Deployed 
https://gerrit.wikimedia.org/r/c/operations/puppet/+/717508 across `wdqs` 
fleet; codfw wdqs hosts will restart on average once per hour now to address 
ongoing availability issues for wdqs codfw

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, Ladsgroup, Aklapper, 
Bugreporter, Suran38, Biggs657, Invadibot, Lalamarie69, MPhamWMF, maantietaja, 
Juan90264, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, 
Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-03 Thread gerritbot

gerritbot added a comment.


  Change 717508 **merged** by Ryan Kemper:
  
  [operations/puppet@production] wdqs: temp mitigation => restart hourly w 
random
  
  https://gerrit.wikimedia.org/r/717508

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, Ladsgroup, Aklapper, 
Bugreporter, Suran38, Biggs657, Invadibot, Lalamarie69, MPhamWMF, maantietaja, 
Juan90264, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, 
Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-03 Thread gerritbot

gerritbot added a comment.


  Change 717508 had a related patch set uploaded (by Ryan Kemper; author: Ryan 
Kemper):
  
  [operations/puppet@production] wdqs: temp mitigation => restart hourly w 
random
  
  https://gerrit.wikimedia.org/r/717508

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, Ladsgroup, Aklapper, 
Bugreporter, Suran38, Biggs657, Invadibot, Lalamarie69, MPhamWMF, maantietaja, 
Juan90264, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, 
Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-03 Thread gerritbot

gerritbot added a comment.


  Change 717494 **merged** by Ryan Kemper:
  
  [operations/puppet@production] wdqs: temp mitigation => restart hourly w 
random
  
  https://gerrit.wikimedia.org/r/717494

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, Ladsgroup, Aklapper, 
Bugreporter, Suran38, Biggs657, Invadibot, Lalamarie69, MPhamWMF, maantietaja, 
Juan90264, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, 
Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-03 Thread Maintenance_bot

Maintenance_bot added a project: Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, Ladsgroup, Aklapper, 
Bugreporter, Suran38, Biggs657, Invadibot, Lalamarie69, MPhamWMF, maantietaja, 
Juan90264, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, 
Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-03 Thread gerritbot

gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, Ladsgroup, Aklapper, 
Bugreporter, Suran38, Biggs657, Lalamarie69, MPhamWMF, Juan90264, Alter-paule, 
Beast1978, CBogen, Un1tY, Hook696, Kent7301, joker88john, CucyNoiD, 
Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, EBjune, merbst, Lewizho99, Maathavan, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-03 Thread gerritbot

gerritbot added a comment.


  Change 717494 had a related patch set uploaded (by Ryan Kemper; author: Ryan 
Kemper):
  
  [operations/puppet@production] wdqs: temp mitigation => restart hourly w 
random
  
  https://gerrit.wikimedia.org/r/717494

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, Ladsgroup, Aklapper, 
Bugreporter, MPhamWMF, CBogen, Namenlos314, Gq86, Lucas_Werkmeister_WMDE, 
EBjune, merbst, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-03 Thread Bugreporter

Bugreporter added a comment.


  For higher availability you may want to depool each server before restarting 
them.

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Bugreporter
Cc: RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, Ladsgroup, Aklapper, 
Bugreporter, MPhamWMF, CBogen, Namenlos314, Gq86, Lucas_Werkmeister_WMDE, 
EBjune, merbst, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-03 Thread Stashbot

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2021-09-03T16:10:13Z]  
blazegraph (public cofdfw cluster) will now restart every hour - T290330 


TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: RhinosF1, Zbyszko, WMDE-leszek, Mholloway, Gehel, Ladsgroup, Aklapper, 
Bugreporter, MPhamWMF, CBogen, Namenlos314, Gq86, Lucas_Werkmeister_WMDE, 
EBjune, merbst, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

2021-09-03 Thread Gehel

Gehel renamed this task from "502 Bad Gateway on WDQS on ulsfo" to "Wikidata 
Query Service unstable in codfw".

TASK DETAIL
  https://phabricator.wikimedia.org/T290330

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Zbyszko, WMDE-leszek, Mholloway, Gehel, Ladsgroup, Aklapper, Bugreporter, 
MPhamWMF, CBogen, Namenlos314, Gq86, Lucas_Werkmeister_WMDE, EBjune, merbst, 
Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

[Wikidata-bugs] [Maniphest] T290330: Wikidata Query Service unstable in codfw

27 matches

Site Navigation

Mail list logo

Footer information