[Wikidata-bugs] [Maniphest] [Commented On] T179060: Dispatchers occasionally seem to "freeze" for certain wikis

2017-10-30 Thread gerritbot 
gerritbot added a comment.
Change 387114 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Remove bogus "lock" condition from SqlChangeDispatchCoordinator query

https://gerrit.wikimedia.org/r/387114TASK DETAILhttps://phabricator.wikimedia.org/T179060EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, hoo, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179060: Dispatchers occasionally seem to "freeze" for certain wikis

2017-10-29 Thread hoo 
hoo added a comment.
The above change will allow us to (almost) increase our maximum throughput by a factor of 8, thus should fix these issues for now at least.TASK DETAILhttps://phabricator.wikimedia.org/T179060EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, Aklapper, hoo, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179060: Dispatchers occasionally seem to "freeze" for certain wikis

2017-10-29 Thread gerritbot 
gerritbot added a comment.
Change 387114 had a related patch set uploaded (by Hoo man; owner: Hoo man):
[mediawiki/extensions/Wikibase@master] Remove bogus "lock" condition from SqlChangeDispatchCoordinator query

https://gerrit.wikimedia.org/r/387114TASK DETAILhttps://phabricator.wikimedia.org/T179060EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, hoo, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179060: Dispatchers occasionally seem to "freeze" for certain wikis

2017-10-29 Thread hoo 
hoo added a comment.
There are actually a lot of changes related to zhwiki happening:

mysql:wikiadmin@db1070 [wikidatawiki]> SELECT COUNT(*) FROM (SELECT * FROM recentchanges WHERE rc_source = 'mw.edit' ORDER BY rc_timestamp DESC LIMIT 10) AS innerQ INNER JOIN wb_changes_subscription ON rc_title = cs_entity_id AND rc_namespace = 0 AND cs_subscriber_id = 'zhwiki';
+--+
| COUNT(*) |
+--+
|46145 |
+--+
1 row in set (21.56 sec)

mysql:wikiadmin@db1070 [wikidatawiki]> SELECT COUNT(*) FROM (SELECT * FROM recentchanges WHERE rc_source = 'mw.edit' ORDER BY rc_timestamp DESC LIMIT 10) AS innerQ INNER JOIN wb_changes_subscription ON rc_title = cs_entity_id AND rc_namespace = 0 AND cs_subscrib = 'enwiki';
+--+
| COUNT(*) |
+--+
| 9038 |
+--+
1 row in set (1.75 sec)

Apparently there's a bot adding a lot of Welsh descriptions to Chinese villages and that seems to be causing these problems. See https://www.wikidata.org/wiki/Special:Contributions/Danielt998.TASK DETAILhttps://phabricator.wikimedia.org/T179060EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, Aklapper, hoo, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179060: Dispatchers occasionally seem to "freeze" for certain wikis

2017-10-29 Thread hoo 
hoo added a comment.
This just happened again, zhwiki got backlogged by 8h+.

It was not locked at this time:

hoo@terbium:~$ mwscript eval.php --wiki wikidatawiki
> $lockManager = LockManagerGroup::singleton( wfWikiID() )->get( 'redisLockManager' );

> $clientLockName = str_replace( ' ', '_', "Wikibase.wikidatawiki.dispatchChanges.zhwiki" );

>  var_dump( $lockManager->lock( [ $clientLockName ] ) );
object(StatusValue)#355 (6) {
  ["ok":protected]=>
  bool(true)
  ["errors":protected]=>
  array(0) {
  }
  ["value"]=>
  NULL
  ["success"]=>
  array(0) {
  }
  ["successCount"]=>
  int(0)
  ["failCount"]=>
  int(0)
}

>  var_dump( $lockManager->unlock( [ $clientLockName ] ) );
object(StatusValue)#355 (6) {
  ["ok":protected]=>
  bool(true)
  ["errors":protected]=>
  array(0) {
  }
  ["value"]=>
  NULL
  ["success"]=>
  array(0) {
  }
  ["successCount"]=>
  int(0)
  ["failCount"]=>
  int(0)
}TASK DETAILhttps://phabricator.wikimedia.org/T179060EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, Aklapper, hoo, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179060: Dispatchers occasionally seem to "freeze" for certain wikis

2017-10-27 Thread gerritbot 
gerritbot added a comment.
Change 386591 merged by Elukey:
[operations/puppet@production] mediawiki::maintenace::wikidata: log Wikidata dispatchers

https://gerrit.wikimedia.org/r/386591TASK DETAILhttps://phabricator.wikimedia.org/T179060EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, hoo, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179060: Dispatchers occasionally seem to "freeze" for certain wikis

2017-10-26 Thread gerritbot 
gerritbot added a comment.
Change 386591 had a related patch set uploaded (by Hoo man; owner: Hoo man):
[operations/puppet@production] Log Wikidata dispatchers on terbium

https://gerrit.wikimedia.org/r/386591TASK DETAILhttps://phabricator.wikimedia.org/T179060EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, hoo, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs