[Wikidata-bugs] [Maniphest] [Commented On] T205865: Investigate decrease in wikidata dispatch times due to eqiad -> codfw DC switch

[Marostegui]

Marostegui added a comment.

Another test with db1104 before and after compressing:

root@db1104.eqiad.wmnet[wikidatawiki]> show create table wb_changes_dispatch\G
*************************** 1. row ***************************
       Table: wb_changes_dispatch
Create Table: CREATE TABLE `wb_changes_dispatch` (
  `chd_site` varbinary(32) NOT NULL,
  `chd_db` varbinary(32) NOT NULL,
  `chd_seen` int(11) NOT NULL DEFAULT '0',
  `chd_touched` varbinary(14) NOT NULL DEFAULT '00000000000000',
  `chd_lock` varbinary(64) DEFAULT NULL,
  `chd_disabled` tinyint(3) unsigned NOT NULL DEFAULT '0',
  PRIMARY KEY (`chd_site`),
  KEY `wb_changes_dispatch_chd_seen` (`chd_seen`),
  KEY `wb_changes_dispatch_chd_touched` (`chd_touched`)
) ENGINE=InnoDB DEFAULT CHARSET=binary
1 row in set (0.00 sec)

root@db1104.eqiad.wmnet[wikidatawiki]> SELECT COUNT(*) FROM wb_changes_dispatch;
+----------+
| COUNT(*) |
+----------+
|      577 |
+----------+
1 row in set (0.98 sec)

root@db1104.eqiad.wmnet[wikidatawiki]> SELECT  chd_site  FROM wb_changes_dispatch    WHERE (( chd_touched < '20181010214641' OR ( 1086 - chd_seen ) > 1000) ) AND (chd_seen < 1086) AND (chd_disabled = 0)  ORDER BY chd_seen ASC LIMIT 15;
Empty set (0.99 sec)


root@db1104.eqiad.wmnet[wikidatawiki]> alter table wb_changes_dispatch ROW_FORMAT=COMPRESSED KEY_BLOCK_SIZE=8;
Query OK, 0 rows affected (4.66 sec)
Records: 0  Duplicates: 0  Warnings: 0

root@db1104.eqiad.wmnet[wikidatawiki]> show create table wb_changes_dispatch\G
*************************** 1. row ***************************
       Table: wb_changes_dispatch
Create Table: CREATE TABLE `wb_changes_dispatch` (
  `chd_site` varbinary(32) NOT NULL,
  `chd_db` varbinary(32) NOT NULL,
  `chd_seen` int(11) NOT NULL DEFAULT '0',
  `chd_touched` varbinary(14) NOT NULL DEFAULT '00000000000000',
  `chd_lock` varbinary(64) DEFAULT NULL,
  `chd_disabled` tinyint(3) unsigned NOT NULL DEFAULT '0',
  PRIMARY KEY (`chd_site`),
  KEY `wb_changes_dispatch_chd_seen` (`chd_seen`),
  KEY `wb_changes_dispatch_chd_touched` (`chd_touched`)
) ENGINE=InnoDB DEFAULT CHARSET=binary ROW_FORMAT=COMPRESSED KEY_BLOCK_SIZE=8
1 row in set (0.00 sec)

root@db1104.eqiad.wmnet[wikidatawiki]> SELECT COUNT(*) FROM wb_changes_dispatch;
+----------+
| COUNT(*) |
+----------+
|      577 |
+----------+
1 row in set (0.01 sec)

root@db1104.eqiad.wmnet[wikidatawiki]> SELECT  chd_site  FROM wb_changes_dispatch    WHERE (( chd_touched < '20181010214641' OR ( 1086 - chd_seen ) > 1000) ) AND (chd_seen < 1086) AND (chd_disabled = 0)  ORDER BY chd_seen ASC LIMIT 15;
Empty set (0.00 sec)

TASK DETAIL

https://phabricator.wikimedia.org/T205865

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui
Cc: Nikerabbit, Stashbot, gerritbot, aaron, hoo, Joe, User-Marostegui, Banyek, jcrespo, Marostegui, Addshore, Aklapper, CucyNoiD, Nandana, NebulousIris, thifranc, jijiki, AndyTan, Gaboe420, Phukettaxigroup, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, LawExplorer, Vali.matei, Lewizho99, Minhnv-2809, Zppix, Volans, Maathavan, D3r1ck01, Volker_E, Wong128hk, Luke081515, Wikidata-bugs, aude, GWicke, Dinoguy1000, faidon, Mbch331, Jay8g, Krenair, akosiaris, fgiunchedi

_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs