Gergő Tisza has uploaded a new change for review.
https://gerrit.wikimedia.org/r/132112
Change subject: Throttle GWToolset uploads
......................................................................
Throttle GWToolset uploads
GWToolset can cause system instability by filling pages like
Special:NewFiles with large files which are expensive to thumbnail.
To avoid this, we are temporarily adding extra throttling.
The goal is to keep the ratio of GWToolset images below 10% on
NewFiles and co. That means:
* these pages default to the last 50 images, so GWT should not upload
more than 5 images at the same time
* based on random checks of Special:Logs, there are about 240 uploads
per hour in the slowest part of the day, so GWT's upload speed
should not go over 10% of that.
We are overriding the default thread count, but not the max thread count
(which is 20), which means GWToolset users could override this limit
and upload up to 4x faster. There is no reason at the moment to prevent
that; it might be useful for uploading smaller files.
This uses a floating-point value for $wgJobBackoffThrottling, which
depends on I2e57d61fd67b97fbd593274b31e1bfada8f522f5
Change-Id: If6cc7e766f9b560db3b8fa385877c778d8436d15
---
M wmf-config/CommonSettings.php
1 file changed, 3 insertions(+), 0 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config
refs/changes/12/132112/1
diff --git a/wmf-config/CommonSettings.php b/wmf-config/CommonSettings.php
index ac416aa..0e4a686 100644
--- a/wmf-config/CommonSettings.php
+++ b/wmf-config/CommonSettings.php
@@ -1819,6 +1819,9 @@
$wgGWTFileBackend = 'local-multiwrite';
$wgGWTFBMaxAge = '1 week';
$wgJobTypeConf['gwtoolsetUploadMetadataJob'] = array( 'checkDelay' =>
true ) + $wgJobTypeConf['default'];
+ // extra throttling until the image scalers are more robust
+ GWToolset\Config::$mediafile_job_throttle_default = 5; // 5 files per
batch
+ $wgJobBackoffThrottling['gwtoolsetUploadMetadataJob'] = 5 / 3600; // 5
batches per hour
}
if ( $wmgUseMultimediaViewer ) {
--
To view, visit https://gerrit.wikimedia.org/r/132112
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: If6cc7e766f9b560db3b8fa385877c778d8436d15
Gerrit-PatchSet: 1
Gerrit-Project: operations/mediawiki-config
Gerrit-Branch: master
Gerrit-Owner: Gergő Tisza <gti...@wikimedia.org>
_______________________________________________
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
