https://bugzilla.wikimedia.org/show_bug.cgi?id=31259
--- Comment #12 from Roan Kattouw <roan.katt...@gmail.com> 2011-10-04 08:41:18 UTC --- (In reply to comment #11) > ES has been migrating out (per > <http://wikitech.wikimedia.org/view/External_storage>) but as I understand > this > is not-quite-100%-done at this moment, so they still have to be watched out > for? > It looks like Ben's started to rewrite the documentation to represent the future state, or something. I know that he's working on moving all the ES data off the Apaches onto a bunch of dedicated ES boxes, but right now the Apaches are still listed in db.php and the ES boxes aren't. > Memcache still being in Apache space definitely indicates doing rolling > upgrades to keep most of the cluster online at any given time, but should > refill ok as long as each one that goes down has a replacement. > That's about right, yeah. But it's a bit slow because Peter's being careful and rotation out memcached boxes 3 at a time. Also, each replacement memcached server starts with a blank slate, so that part of the cache needs to be rebuilt, which means replacing 20 of them at once is probably not a good idea. And the number of spares we have lying around isn't infinite either, of course. > [In principle, apaches should hold no permanent data and should be able to act > like they're netbooting or something; re-imaging *shouldn't* be any more > unpleasant than just rebooting other than it being slower.] > > To confirm: we expect this process to be done by mid-October 2011 under > current > work plans? I *believe* so, but I'll ask Peter to comment here with an authoritative answer. I hacked up a quick one-liner to check the number of upgraded servers, and it seems we have 97 upgraded machines and 108 non-upgraded ones. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug. _______________________________________________ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
