[Wikidata-bugs] [Maniphest] T264821: Hourly read spikes against s8 resulting in occasional user-visible latency & error spikes

2022-11-17 Thread jijiki
jijiki closed this task as "Resolved". jijiki claimed this task. jijiki added a comment. Bluntly closing TASK DETAIL https://phabricator.wikimedia.org/T264821 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: jijiki, Michael

[Wikidata-bugs] [Maniphest] T261486: Plan to scale up termbox service to be able to render the termbox for desktop pageviews

2022-09-28 Thread jijiki
jijiki moved this task from Incoming  to Backlog on the serviceops board. Restricted Application added a project: wdwb-tech. TASK DETAIL https://phabricator.wikimedia.org/T261486 WORKBOARD https://phabricator.wikimedia.org/project/board/3775/ EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T293063: Write and adapt Runbooks and cookbooks related to the WDQS Streaming Updater and kubernetes

2021-10-13 Thread jijiki
jijiki added a project: Prod-Kubernetes. TASK DETAIL https://phabricator.wikimedia.org/T293063 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Aklapper, jijiki, dcausse, Invadibot, MPhamWMF, GeminiAgaloos, maantietaja, wkandek, JMeybohm

[Wikidata-bugs] [Maniphest] T293063: Write and adapt Runbooks and cookbooks related to the WDQS Streaming Updater and kubernetes

2021-10-13 Thread jijiki
jijiki renamed this task from "Write and adapt Runbooks related to the WDQS Streaming Updater and kubernetes" to "Write and adapt Runbooks and cookbooks related to the WDQS Streaming Updater and kubernetes". jijiki added a project: serviceops. jijiki updated the task des

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink (rdf-streaming-updater) to kubernetes (k8s)

2021-06-22 Thread jijiki
jijiki added a comment. @Zbyszko, @dcausse, we will try to clear any leftovers this week so you can do a first deployment to staging. Since next week we will be switchover datacenrtres, we can't deploy flink to production clusters anhyway, until it is complete and every is ok TASK DETAIL

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink (rdf-streaming-updater) to kubernetes (k8s)

2021-06-22 Thread jijiki
jijiki renamed this task from "Deploy Flink to kubernetes (k8s)" to "Deploy Flink (rdf-streaming-updater) to kubernetes (k8s)". jijiki added subscribers: Zbyszko, dcausse. jijiki added a project: serviceops. jijiki updated the task description. Restricted Application added

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-06-22 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: akosiaris, Mstyles, Gehel, Aklapper, Biggs657, Invadibot, Lalamarie69, MPhamWMF, maantietaja, Alter

[Wikidata-bugs] [Maniphest] T275133: Limit query parallelism from Flink based WDQS updater to Wikidata

2021-04-21 Thread jijiki
jijiki added a project: User-jijiki. TASK DETAIL https://phabricator.wikimedia.org/T275133 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: dcausse, Gehel, Aklapper, Invadibot, MPhamWMF, maantietaja, wkandek, JMeybohm, CBogen, Akuckartz

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2021-01-13 Thread jijiki
jijiki closed subtask T265643: Upgrade MediaWikis Redis cluster to Debian Buster as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2021-01-13 Thread jijiki
jijiki closed this task as "Resolved". jijiki claimed this task. jijiki added a comment. Despite of what the above messages say, mc2029 and mc1029 were properly reimaged  TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.or

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2021-01-13 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2021-01-07 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2021-01-07 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2021-01-05 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2021-01-05 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2020-12-20 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2020-12-17 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2020-12-16 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2020-12-16 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2020-12-16 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2020-12-15 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2020-12-13 Thread jijiki
jijiki added a comment. @Volans Should I run it for the ones I have already reimaged? TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2020-12-13 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Volans, Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2020-12-10 Thread jijiki
jijiki added a comment. @aaron In order to change the servers defined in the mediawiki-config (and use other redis instances), apart from roll change them one by one, is there something else we should keep in mind? TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Buster

2020-12-10 Thread jijiki
jijiki closed subtask T252391: Reimage one memcached shard per DC to Buster as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Ladsgroup, Krenair, elukey, jijiki, faidon

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Stretch/Buster

2020-12-08 Thread jijiki
jijiki added a comment. Looking at mc1035's behaviour after reimaging, it appears that its hit ratio reached 0.95 after ~10h, and it reached 28Mil items in ~13h. I think it is safe to say that we can reimage one memcached server in each DC every 12 hours. F33939723: image.png <ht

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Stretch/Buster

2020-12-08 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Stretch/Buster

2020-12-08 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Stretch/Buster

2020-12-07 Thread jijiki
jijiki added a comment. Given that the total size of our redis cluster is now ~2G ( as discussed in T252391#6647730 <https://phabricator.wikimedia.org/T252391#6647730>) we can upgrade a few more memcached servers to buster while we ensure that our work towards using redis 2.8 to

[Wikidata-bugs] [Maniphest] T266702: Move WDQS UI to microsites

2020-11-10 Thread jijiki
jijiki triaged this task as "Medium" priority. TASK DETAIL https://phabricator.wikimedia.org/T266702 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Ladsgroup, BBlack, Gehel, Dzahn, Addshore, Aklapper, Devnull, lmata, CBogen,

[Wikidata-bugs] [Maniphest] T266703: Deploy WDQS query builder to microsites

2020-11-10 Thread jijiki
jijiki triaged this task as "Medium" priority. TASK DETAIL https://phabricator.wikimedia.org/T266703 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Lydia_Pintscher, Aklapper, Dzahn, Addshore, Devnull, lmata, Akuckartz, Lega

[Wikidata-bugs] [Maniphest] T232246: Set HSTS on wikiba.se (force HTTPS)

2020-11-10 Thread jijiki
jijiki triaged this task as "Medium" priority. TASK DETAIL https://phabricator.wikimedia.org/T232246 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Nintendofan885, Addshore, abian, Aklapper, Devnull, lmata, Akuckartz, Lega

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Stretch/Buster

2020-10-28 Thread jijiki
jijiki added a comment. @aaron thank you! I updated the task description TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Stretch/Buster

2020-10-28 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Stretch/Buster

2020-10-28 Thread jijiki
jijiki added a comment. @aaron If you have any insights regarding the Redis Lock Manager and file upload, it would be much appreciated (+ T265643 <https://phabricator.wikimedia.org/T265643>) TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Stretch/Buster

2020-10-28 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Ladsgroup, Krenair, elukey, jijiki, faidon, Paladox, Aklapper, Krinkle, aaron, Joe

[Wikidata-bugs] [Maniphest] T213089: Upgrade memcached cluster to Debian Stretch/Buster

2020-10-28 Thread jijiki
jijiki added a subscriber: Ladsgroup. jijiki added a project: Wikidata. jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T213089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Ladsgroup, Krenair, elukey

[Wikidata-bugs] [Maniphest] T261486: Plan to scale up termbox service to be able to render the termbox for desktop pageviews

2020-08-28 Thread jijiki
jijiki triaged this task as "Medium" priority. TASK DETAIL https://phabricator.wikimedia.org/T261486 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: WMDE-leszek, daniel, Jakob_WMDE, Tarrow, Lydia_Pintscher, Addshore, Aklap

[Wikidata-bugs] [Maniphest] T260281: mw* servers memory leaks (12 Aug)

2020-08-20 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T260281 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Joe, jijiki Cc: eprodromou, Michael, NullPointer, Platonides, hashar, Addshore, Majavah, Ladsgroup, JMeybohm

[Wikidata-bugs] [Maniphest] [Triaged] T243701: Wikidata maxlag repeatedly over 5s since Jan20, 2020 (primarily caused by the query service)

2020-01-28 Thread jijiki
jijiki triaged this task as "Medium" priority. TASK DETAIL https://phabricator.wikimedia.org/T243701 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: Xqt, Lucas_Werkmeister_WMDE, Addshore, jcrespo, Dvorapa, Aklapper, Strainu, dar

[Wikidata-bugs] [Maniphest] [Commented On] T239594: Unexpected general module "jquery.ui.core.styles" in styles queue.

2019-12-04 Thread jijiki
jijiki added a comment. In T239594#5712075 <https://phabricator.wikimedia.org/T239594#5712075>, @Krinkle wrote: > Deployments happen once a week through the train. This is expected to roll out next week with 1.35.0-wmf.10, unless backported sooner which I proposed with the abo

[Wikidata-bugs] [Maniphest] [Commented On] T239594: Unexpected general module "jquery.ui.core.styles" in styles queue.

2019-12-04 Thread jijiki
jijiki added a comment. @Krinkle I am afraid we are still seeing those errors in https://logstash.wikimedia.org/goto/dd9770ce7a81dc3c7614e03cf7b9de15 TASK DETAIL https://phabricator.wikimedia.org/T239594 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Updated] T236500: large number of 504 errors from ulsfo

2019-10-28 Thread jijiki
jijiki removed a project: Security. jijiki changed the visibility from "Custom Policy" to "Public (No Login Required)". Restricted Application added a project: Security. TASK DETAIL https://phabricator.wikimedia.org/T236500 EMAIL PREFERENCES https://phabricator.wikimedi

[Wikidata-bugs] [Maniphest] [Changed Policy] T236500: large number of 504 errors from ulsfo

2019-10-27 Thread jijiki
jijiki changed the visibility from "Custom Policy" to "Public (No Login Required)". jijiki changed the edit policy from "Custom Policy" to "All Users". TASK DETAIL https://phabricator.wikimedia.org/T236500 EMAIL PREFERENCES https://phabricator.wikim

[Wikidata-bugs] [Maniphest] [Triaged] T221315: Determine future of bare-metal hosting for services like WDQS, ElasticSearch, RESTBase Cassandra, etc.

2019-06-21 Thread jijiki
jijiki triaged this task as "Low" priority. TASK DETAIL https://phabricator.wikimedia.org/T221315 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: EBernhardson, MoritzMuehlenhoff, mobrovac, Smalyshev, Jdforrester-WMF,

[Wikidata-bugs] [Maniphest] [Assigned] T207643: Sanitizing input and increase throttling rate for wdqs errors to prevent spamming logstash

2018-10-23 Thread jijiki
jijiki assigned this task to Gehel.jijiki triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T207643EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, jijikiCc: gerritbot, Aklapper, fgiunchedi, Smalyshev, dcau