Lucas_Werkmeister_WMDE added a comment.
In T270249#6830469 <https://phabricator.wikimedia.org/T270249#6830469>, @Lucas_Werkmeister_WMDE wrote: > In any case – at some point, we need to delete those 1.1 milion `wbt_item_term` rows belonging to 9593 deleted item IDs; assuming a batch size of 100 and a replication wait time of 1 s (and no time for the deletes themselves), that would take over three hours. Definitely needs a scheduled maintenance window, and possibly we’ll want to break it up into multiple batches of item IDs outside the script as well. In the end, the maintenance script was thankfully substantially faster than that :) You can see the impact of the script on the s8 master (db1104), by the way: F34161473: Screenshot_2021-03-15 MySQL - Grafana.png <https://phabricator.wikimedia.org/F34161473> Each of those `DELETE` spikes or plateaus corresponds to one run of the maintenance script. (They never reached the level of `INSERT` or `UPDATE`, though.) The changes in the I/O and Semaphores graphs might also be due to this, I’m not sure: F34161483: Screenshot_2021-03-15 MySQL - Grafana-bytes.png <https://phabricator.wikimedia.org/F34161483> F34161485: Screenshot_2021-03-15 MySQL - Grafana-semaphores.png <https://phabricator.wikimedia.org/F34161485> TASK DETAIL https://phabricator.wikimedia.org/T270249 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lucas_Werkmeister_WMDE Cc: Lucas_Werkmeister_WMDE, Aklapper, Addshore, MisterSynergy, noarave, maantietaja, Akuckartz, Iflorez, alaa_wmde, Nandana, lucamauri, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, abian, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
