On Fri, Nov 16, 2012 at 12:34 PM, Andre Klapper <aklap...@wikimedia.org> wrote: > * Missing Gadgets tab (also with Vector skin): > > https://en.wikipedia.org/wiki/Wikipedia:Village_pump_%28technical%29#Missing_Gadgets_Tab This was fixed last night. It has nothing to do with bits, it was caused by memcached corruption.
> * Maybe also: Edit conflict sometimes does not show the current > text: https://bugzilla.wikimedia.org/show_bug.cgi?id=42163 > I think it's very very very unlikely that this is because of a front-end issue, it's almost certainly a backend issue. > Speculation: > > Looking at the monthly stats on > http://ganglia.wikimedia.org/latest/graph_all_periods.php?c=Bits%20application%20servers%20pmtpa&m=cpu_report&r=hour&s=by%20name&hc=4&mc=2&st=1353096306&g=network_report&z=large&c=Bits%20application%20servers%20pmtpa > (click on "Inspect") there is a drop of "Out" on November 5/6th. > > From http://wikitech.wikimedia.org/view/Server_admin_log#November_5 : > 21:54 aaron synchronized wmf-config/mc.php 'Switched all wikis to > memcached-multiwrite.' > 21:54 logmsgbot_: aaron synchronized wmf-config/InitialiseSettings.php > 'Disabled spammy (with pecl memcached) memcached.log, the useful one is > memcached-serious.' > The drop is strange, but could be explained by the memcached changes and the logging changes, if similar drops were observed in the other Apache clusters. Roan _______________________________________________ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l