[Wikidata-bugs] [Maniphest] [Created] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)

[jcrespo]

jcrespo created this task. jcrespo added projects: MediaWiki-Watchlist, DBA, Wikidata. Herald added subscribers: Liuxinyu970226, Jay8g, TerraCodes, Aklapper.

TASK DESCRIPTION

Once rows stop from coming in (see parent task), this will likely either solve or mitigate performance issues.

The rows affected seems to have rc_source = 'wb' (to be confirmed with wikidata team).

root@neodymium:~$ mysql -h db2073.codfw.wmnet commonswiki -e "SELECT COUNT(*) FROM recentchanges WHERE rc_source = 'wb'"
+----------+
| COUNT(*) |
+----------+
| 58075394 |
+----------+
root@neodymium:~$ mysql -h db2073.codfw.wmnet commonswiki -e "SELECT COUNT(*) FROM recentchanges"
+----------+
| COUNT(*) |
+----------+
| 70880706 |
+----------+

A backups should be done immediately before purging to avoid unaccounted effects.

Purging should be slow enough to not saturate replication or stole IOPS from main tasks.

TASK DETAIL

https://phabricator.wikimedia.org/T177772

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jcrespo
Cc: Aklapper, TerraCodes, Jay8g, Liuxinyu970226, Marostegui, jcrespo, GoranSMilovanovic, QZanden, Minhnv-2809, Izno, Luke081515, Wikidata-bugs, aude, Mbch331, Krenair

_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs