tfmorris added a comment.
In T240442#5851541 <https://phabricator.wikimedia.org/T240442#5851541>, @Addshore wrote: > In T240442#5834866 <https://phabricator.wikimedia.org/T240442#5834866>, @Ladsgroup wrote: > >> Very broad idea, feel free to discard, I think using industry-wide standards for throttling like `token bucket`, `leaky bucket`, `fixed-window counter` or `sliding-window counter` might help here. > > One of the primary questions we need to answer is do we want to keep doing this client side self throttling, or switch to something more server side. I would have thought that it'd be obvious that this can't be done client side. They can cheat. They don't know what each other are doing. They don't know what other factors are affecting the servers. As @Ladsgroup hints, this is a basic distributed systems engineering problem with known answers. In addition to rate limiting at ingress, it may be helpful to add backpressure signals between the various internal servers as well as add jitter to the Retry-After signals sent to clients. TASK DETAIL https://phabricator.wikimedia.org/T240442 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: tfmorris Cc: tfmorris, valhallasw, Strainu, Xqt, Dvorapa, Ladsgroup, ArthurPSmith, Addshore, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
