| daniel created this task. daniel added projects: Wikidata, MediaWiki-extensions-WikibaseClient, JobRunner-Service. Herald added a subscriber: Aklapper. |
Currently, the number of pages purged by a singe HTMLCacheUpdateJob is limited to 20, by the wikiPageUpdaterDbBatchSize setting. The low number was set a few months ago because this setting used to also control the batch size for the expensive RefreshLinksJob, see rOMWCc29fae9270d1: Reduce wikiPageUpdaterDbBatchSize to 20.
However, as per rEWBA8c96687c2e46: Allow batch sizes for different jobs to be defined separately., we no longer apply batching for RefreshLinksJob, and wikiPageUpdaterDbBatchSize is deprecated in favor of purgeCacheBatchSize and recentChangesBatchSize.
Since we have problems with the a number of HTMLCacheUpdateJob being pushed to the job queue (see e.g. T173710#3699426), we should try to increase the batch size for this job, perhaps to 100 or 200.
The value for recentChangesBatchSize could perhaps also be increased, though in the light of rEWBAb00fac476e80: Quick fix for flooding of the RC table we should be careful here. A larger batch size may be help or hurt.
Cc: Aklapper, aude, thiemowmde, hoo, Ladsgroup, Krinkle, Joe, daniel, GoranSMilovanovic, QZanden, Wikidata-bugs, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
