Hoo man has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/387282 )
Change subject: Wikidata dispatcher: Choose a better value for --randomness
......................................................................
Wikidata dispatcher: Choose a better value for --randomness
This should make the dispaters choose the wikis that need it the most.
Change-Id: I5b97c3ebb7a085c075d1192326e4c73cfcdaed6c
---
M modules/mediawiki/manifests/maintenance/wikidata.pp
1 file changed, 6 insertions(+), 2 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/82/387282/1
diff --git a/modules/mediawiki/manifests/maintenance/wikidata.pp
b/modules/mediawiki/manifests/maintenance/wikidata.pp
index 0c991cd..b36a09c 100644
--- a/modules/mediawiki/manifests/maintenance/wikidata.pp
+++ b/modules/mediawiki/manifests/maintenance/wikidata.pp
@@ -3,11 +3,15 @@
# Starts a dispatcher instance every 3 minutes
# They will run for a maximum of 9 minutes, so we can only have 3
concurrent instances.
- # This handles inserting jobs into client job queue, which then process
the changes
+ # This handles inserting jobs into client job queue, which then process
the changes.
+ # This will process up to --batch-size * (60 / --dispatch-interval)
changes per minute,
+ # to a single wiki (only counting changes that affect the wiki).
+ # --randomness should always be roughly #processes + 2 (it needs to be >
#processes,
+ # but making it to large will hinder the most lagged wikis from getting
priority).
$dispatch_log_file = '/var/log/wikidata/dispatchChanges-wikidatawiki.log';
cron { 'wikibase-dispatch-changes4':
ensure => $ensure,
- command => "echo \"\$\$: Starting dispatcher\" >>
${dispatch_log_file}; /usr/local/bin/mwscript
extensions/Wikidata/extensions/Wikibase/repo/maintenance/dispatchChanges.php
--wiki wikidatawiki --max-time 540 --batch-size 420 --dispatch-interval 25
--lock-grace-interval 200 >> ${dispatch_log_file} 2>&1; echo \"\$\$: Dispatcher
exited with $?\" >> ${dispatch_log_file}",
+ command => "echo \"\$\$: Starting dispatcher\" >>
${dispatch_log_file}; /usr/local/bin/mwscript
extensions/Wikidata/extensions/Wikibase/repo/maintenance/dispatchChanges.php
--wiki wikidatawiki --max-time 540 --batch-size 420 --dispatch-interval 25
--randomness 5 >> ${dispatch_log_file} 2>&1; echo \"\$\$: Dispatcher exited
with $?\" >> ${dispatch_log_file}",
user => $::mediawiki::users::web,
minute => '*/3',
require => File['/var/log/wikidata'],
--
To view, visit https://gerrit.wikimedia.org/r/387282
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I5b97c3ebb7a085c075d1192326e4c73cfcdaed6c
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Hoo man <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
