Gehel created this task.
Gehel added projects: Wikidata-Query-Service, Operations, Wikimedia-Logstash.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION

We recently had cases of wdqs sending >10K logs per seconds to logstash. This overloads logstash and should be avoided.

We should probably rate limit by logger / message template.

logback does not seem to provide this kind of functionality out of the box (the closest to that is the DuplicateMessageFilter.


TASK DETAIL
https://phabricator.wikimedia.org/T204364

EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Smalyshev, fgiunchedi, Gehel, Aklapper, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, jeremyb
_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to