[Wikidata-bugs] [Maniphest] [Commented On] T235906: Cannot access replica databases
Betacommand added a comment. Also I think you have to do it as a tool, not as yourself TASK DETAIL https://phabricator.wikimedia.org/T235906 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Betacommand Cc: Betacommand, Harej, Aklapper, #cloud-services, #toolforge, dom_walden ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T159618: Job queue rising to nearly 3 million jobs
Betacommand added a parent task: T160003: Factor the JobQueue into the maxlag value. TASK DETAILhttps://phabricator.wikimedia.org/T159618EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Legoktm, BetacommandCc: JJMC89, IKhitron, Esc3300, Lydia_Pintscher, Emijrp, Betacommand, BethNaught, TerraCodes, Jay8g, Joe, aaron, Legoktm, Aklapper, Th3d3v1ls, Hfbn0, Zppix, D3r1ck01, Izno, Wikidata-bugs, aude, faidon, Mbch331, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T159618: Job queue rising to nearly 3 million jobs
Betacommand added a comment. In T159618#3080947, @Legoktm wrote: In T159618#3079361, @Esc3300 wrote: I think it might be worth attempting to determine the factors that lead to the rapid raise. The edit rate didn't seem that high and we could easily have several bots that resulted in the same rate. I disagree. According to https://wikipulse.herokuapp.com/, the edit rate on Wikidata right now is anywhere from 150-220 epm. Adding an extra 600 epm on top of that is what caused the problem. The edit rate may have been the issue, but we should still utilize the tools we have (maxlag) to notify bots that the server is under high load. If we throw a check in maxlag value calculation checking for the number of JobQueue entries and then raising the maxlag to indicate it, it would prevent bots from causing this issue again. Regardless of whether its one bot or several causing the spike, the existing maxlag checks could be used to notify all bots to back off.TASK DETAILhttps://phabricator.wikimedia.org/T159618EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: BetacommandCc: Esc3300, Lydia_Pintscher, Emijrp, Betacommand, BethNaught, TerraCodes, Jay8g, Joe, aaron, Legoktm, Aklapper, Th3d3v1ls, Hfbn0, Zppix, D3r1ck01, Izno, Wikidata-bugs, aude, faidon, Mbch331, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T159618: Job queue rising to nearly 3 million jobs
Betacommand added a comment. Suggestion, when the job queue gets too high set the maxlag parameter to a higher value, most bots use that as a throttle.TASK DETAILhttps://phabricator.wikimedia.org/T159618EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: BetacommandCc: Betacommand, BethNaught, TerraCodes, Jay8g, Joe, aaron, Legoktm, Aklapper, Th3d3v1ls, Zppix, D3r1ck01, Izno, Wikidata-bugs, aude, faidon, Mbch331, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T47534: [Task] Remove external site links from langlinks table on client wikis
Betacommand added a comment. Quite, would help tracking down the remaining non-wikidata entries and addressing/fixing those.TASK DETAILhttps://phabricator.wikimedia.org/T47534EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: BetacommandCc: hoo, Ricordisamoa, Aklapper, greg, Legoktm, Betacommand, Multichill, Lydia_Pintscher, daniel, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T43345: add info if langlink is stored at repository or local
Betacommand added a comment. That is actually the opposite reason. As more and more links get moved to wikidata finding and resolving the remaining links becomes more and more the primary focus. TASK DETAIL https://phabricator.wikimedia.org/T43345 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign . EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Betacommand Cc: Multichill, valhallasw, Wikidata-bugs, jeblad, Legoktm, Nemo_bis, Anomie, Merl, Denny, Betacommand, Ricordisamoa, MZMcBride, Yurik, daniel, aude ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T43345: add info if langlink is stored at repository or local
Betacommand added a comment. That works on the small scale, but doesn't scale.One key example of how this could be used: Find all articles where language links are not in wikidata, Its a fairly simple database query, or 2+ million queries to the API. TASK DETAIL https://phabricator.wikimedia.org/T43345 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign . EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Betacommand Cc: valhallasw, Wikidata-bugs, jeblad, Legoktm, Nemo_bis, Anomie, Merl, Denny, Betacommand, Ricordisamoa, MZMcBride, Yurik, daniel, aude ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T76699: Lost connection to MariaDB server during query
Betacommand added a subscriber: Betacommand. TASK DETAIL https://phabricator.wikimedia.org/T76699 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign . EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Springle, Betacommand Cc: Betacommand, Multichill, Giftpflanze, Lokal_Profil, Steinsplitter, Husky, Springle, Magnus, Aklapper, coren, Danilo, Wikidata-bugs, aude, jayvdb, scfc ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
