Ladsgroup created this task.
Ladsgroup added projects: Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), 
Wikidata.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: User-Ladsgroup.

TASK DESCRIPTION
  Basically turning this to a RFC:
  
  In T240442#5945682 <https://phabricator.wikimedia.org/T240442#5945682>, 
@Ladsgroup wrote:
  
  > I have an idea. I think we should use PoolCounter 
<https://www.mediawiki.org/wiki/PoolCounter> (which is basically a SaaS, 
Semaphore as a service) to put a cap on edits happening on wikidata at the same 
time. This is being used when an article is being reparsed as well, so not too 
many mw nodes parse an article at the same time (The Michael Jackson effect 
<https://blog.wikimedia.org/2016/04/22/prince-death-wikipedia/>).
  > Basically once a request realizes it's going to make an edit in Wikidata, 
it decreases the semaphore of "edit cap on Wikidata" (let's say initialized by 
value of 10, meaning only ten edits at the same time can happen in Wikidata). 
Once the semaphore reaches zero, PoolCounter keeps the 11th mw node trying to 
lock waiting and responds once one of the ten current ones finishes, if it's 
more let's say twenty, it just responds with "Too many edits happening". This 
means edit saving time might be artificially slow when there are more ten edits 
happening at the same time. Not that this already works fine with parsing 
articles (look at the blog post), I used this a while back on ores to prevent 
more than four IPs requesting ores at the same to avoid intentional and 
unintentional DoSes, It works fine as well.
  > PoolCounter is a pretty reliable service with almost zero down time and 
already have a good support inside mediawiki.

TASK DETAIL
  https://phabricator.wikimedia.org/T247459

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Aklapper, WMDE-leszek, darthmon_wmde, Lydia_Pintscher, Addshore, Ladsgroup, 
Hazizibinmahdi, Iflorez, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, 
aude, Mbch331
_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to