Luke, stuff happens. 5 years is a long time between moves, having done
something similar with some 300+ servers  over the course of a 1 week
window, I feel your pain, especially the late night maintenance windows.

I had wondered the same thing about communication regarding the all clear,
but it turns out I had simply misread the end time of the maintenance
window, thought it ended at 12am. Here's the communication I saw leading up
to and slightly after the maintenance window for the Wilson server:

May 7th  - Luke  - general warning / heads up
May 8th  - Luke  - repeat of warning with date and window of time (8pm -
1am PST)

May 9th  - Sarah - (9:01pm)  - notice of box going down
[Wilson box actually down]
[Wilson box is back up by/before 12:35am, I was able to start my instances
via the console]
May 10th - Sarah - (12:42am) - notice of maint done
May 10th - Sarah - (1:55am)  - notice of ip address of hosting
server(wilson) ip address change

May 11th - Luke  - Update on networking on Wilson
May 14th - Chris - Notice of IP address change (my ip(s) didn't match the
ranges, but I am getting notification all the same)

What threw me for a mini-loop were the following:

   - Multiple/potentially redundant communication for folks with multiple
   instances. A single notice per account summarizing things would have been
   easier to read, but with everything going on, the keeping things simple
   paradigm applies.
   - Notifications from accounts with differing names. For some reason, I
   just assumed that Luke was/is the face/voice/typing hand of Prgmr.com. :)
    Have since updated my email rules to just flag all emails from the
   prgmr.com domain.
   - I've been cutting back on caffeine that week.

In the end, looking back:

   - The maintenance completed within the indicated window.
   - There was a networking config issue that got resolved.
   - Servers were up and running happily.

Great job to Luke and his team.

Wing.



Wing Wong
[email protected]
http://about.me/wingtangwong
https://www.facebook.com/wingedpower


On Wed, May 15, 2013 at 5:12 PM, Luke S. Crawford <[email protected]> wrote:

> On 05/15/2013 04:16 PM, Scott Newell wrote:
>
>  What brought this on?  I don't mean to whine, really, but somehow I
>> didn't know mantle was moving last night, so my monitoring services blew
>> my phone up just about the time I was entering REM sleep. Now I'm trying
>> to figure out (even with all that above) how I missed the move
>> announcement.
>>
>
>
> Yes.  I'm sorry.   this move has been horribly planned and poorly
> executed.    I mean, after this, we're at the new location for 5 years, so
> I won't have a chance to make these particular mistakes for a while.
>
>
>
>  BTW, I did check for any email from prgmr.com on both my primary (domU)
>> and secondary (gmail) accounts: the only emails this month were the IP
>> messages from "chris t" on 5/14.
>>
>
>
> Yeah.   You would have gotten more messages (but not enough) if my
> username -> email script handled multiple emails properly, as it does now
> (as of this morning, I haven't generated new email lists yet, though.  srn
> just fixed the script.)
>
> ______________________________**_________________
> discuss mailing list
> [email protected]
> http://lists.prgmr.com/**mailman/listinfo/discuss<http://lists.prgmr.com/mailman/listinfo/discuss>
>
_______________________________________________
discuss mailing list
[email protected]
http://lists.prgmr.com/mailman/listinfo/discuss

Reply via email to