Joe created this task. Joe added projects: serviceops, Operations, Sustainability (Incident Followup), Platform Engineering, Wikidata.
TASK DESCRIPTION Something induced a progressive memory leak on all servers serving MediaWiki starting on august 4th between 8 and 13 UTC. The problem is more evident in servers that receive more traffic, which seems to correlate the memleak with something happening in MediaWiki. However, these are the patches that were released during that timeframe: - enabling Score in production again https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/618039 - this change to how wikibase is loaded https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/618266/ both seem like extremely simple changes we could just rollback easily. At the same time, some software packages were updated, the most relevant of which is imagemagik Plan of action: - Rollback those two changes - Check if memory growth continues - rollback imagemagick on one server, reboot it, see how it behaves afterwards. TASK DETAIL https://phabricator.wikimedia.org/T260329 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Joe Cc: CDanis, Aklapper, jijiki, ArielGlenn, RhinosF1, Joe, lmata, wkandek, JMeybohm, Akuckartz, darthmon_wmde, WDoranWMF, holger.knust, EvanProdromou, Legado_Shulgin, Nandana, Klaas_Z4us_V, Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, elukey, _jensen, rosalieper, Agabi10, Scott_WUaS, Pchelolo, Wong128hk, Wikidata-bugs, aude, faidon, Mbch331, Rxy, Jay8g, fgiunchedi, Dzahn
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
