[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

[Addshore]

Addshore added a comment.

I wrote a little crappy but effective query that I can just run on all of the shards to see if anything else was affected.

select max(rev_id), min(rev_id), count(*), max(rev_id) - min(rev_id) as diff from ( select rev_id, rev_timestamp from revision order by rev_id DESC limit 20000000 ) as something where rev_timestamp > 20180913090816 and rev_timestamp < 20180913095825;

It shows us what happened to the rev_id in the 50 minute period that we are concerned with.

Small difference could be put down to revdel etc, as long as we don't see anything that is near 0 everything should be fine.

S1 - enwiki

+-------------+-------------+----------+------+
| max(rev_id) | min(rev_id) | count(*) | diff |
+-------------+-------------+----------+------+
|   859332479 |   859327787 |     4604 | 4692 |
+-------------+-------------+----------+------+

S2 - ptwiki

+-------------+-------------+----------+------+
| max(rev_id) | min(rev_id) | count(*) | diff |
+-------------+-------------+----------+------+
|    53121516 |    53121457 |       58 |   59 |
+-------------+-------------+----------+------+

S3 - afwiki

+-------------+-------------+----------+------+
| max(rev_id) | min(rev_id) | count(*) | diff |
+-------------+-------------+----------+------+
|     1814203 |     1814188 |       16 |   15 |
+-------------+-------------+----------+------+

S4 - commonswiki

+-------------+-------------+----------+------+
| max(rev_id) | min(rev_id) | count(*) | diff |
+-------------+-------------+----------+------+
|   319952253 |   319947702 |     4387 | 4551 |
+-------------+-------------+----------+------+

S5 - dewiki

+-------------+-------------+----------+------+
| max(rev_id) | min(rev_id) | count(*) | diff |
+-------------+-------------+----------+------+
|   180869513 |   180868285 |     1188 | 1228 |
+-------------+-------------+----------+------+

S6 - frwiki

+-------------+-------------+----------+------+
| max(rev_id) | min(rev_id) | count(*) | diff |
+-------------+-------------+----------+------+
|   152158909 |   152157584 |     1301 | 1325 |
+-------------+-------------+----------+------+

S7 - arwiki

+-------------+-------------+----------+------+
| max(rev_id) | min(rev_id) | count(*) | diff |
+-------------+-------------+----------+------+
|    30515544 |    30515320 |      220 |  224 |
+-------------+-------------+----------+------+

So it looks like s8 was indeed the only issue @Marostegui

TASK DETAIL

https://phabricator.wikimedia.org/T206743

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui, Addshore
Cc: Pigsonthewing, Nikerabbit, gerritbot, WMDE-leszek, jcrespo, mark, Stashbot, Nikki, Marostegui, daniel, TerraCodes, Liuxinyu970226, Addshore, Ladsgroup, Lea_Lacroix_WMDE, Lexicographical data, KaMan, CucyNoiD, Nandana, NebulousIris, Banyek, jijiki, Mringgaard, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Minhnv-2809, Volans, Maathavan, Jonas, Johan, Luke081515, Wikidata-bugs, aude, Lydia_Pintscher, Darkdadaah, TheDJ, Mbch331, Jay8g, Krenair, akosiaris

_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs