Luke, stuff happens. 5 years is a long time between moves, having done
something similar with some 300+ servers over the course of a 1 week
window, I feel your pain, especially the late night maintenance windows.
I had wondered the same thing about communication regarding the all clear,
but it turns out I had simply misread the end time of the maintenance
window, thought it ended at 12am. Here's the communication I saw leading up
to and slightly after the maintenance window for the Wilson server:
May 7th - Luke - general warning / heads up
May 8th - Luke - repeat of warning with date and window of time (8pm -
1am PST)
May 9th - Sarah - (9:01pm) - notice of box going down
[Wilson box actually down]
[Wilson box is back up by/before 12:35am, I was able to start my instances
via the console]
May 10th - Sarah - (12:42am) - notice of maint done
May 10th - Sarah - (1:55am) - notice of ip address of hosting
server(wilson) ip address change
May 11th - Luke - Update on networking on Wilson
May 14th - Chris - Notice of IP address change (my ip(s) didn't match the
ranges, but I am getting notification all the same)
What threw me for a mini-loop were the following:
- Multiple/potentially redundant communication for folks with multiple
instances. A single notice per account summarizing things would have been
easier to read, but with everything going on, the keeping things simple
paradigm applies.
- Notifications from accounts with differing names. For some reason, I
just assumed that Luke was/is the face/voice/typing hand of Prgmr.com. :)
Have since updated my email rules to just flag all emails from the
prgmr.com domain.
- I've been cutting back on caffeine that week.
In the end, looking back:
- The maintenance completed within the indicated window.
- There was a networking config issue that got resolved.
- Servers were up and running happily.
Great job to Luke and his team.
Wing.
Wing Wong
[email protected]
http://about.me/wingtangwong
https://www.facebook.com/wingedpower
On Wed, May 15, 2013 at 5:12 PM, Luke S. Crawford <[email protected]> wrote:
> On 05/15/2013 04:16 PM, Scott Newell wrote:
>
> What brought this on? I don't mean to whine, really, but somehow I
>> didn't know mantle was moving last night, so my monitoring services blew
>> my phone up just about the time I was entering REM sleep. Now I'm trying
>> to figure out (even with all that above) how I missed the move
>> announcement.
>>
>
>
> Yes. I'm sorry. this move has been horribly planned and poorly
> executed. I mean, after this, we're at the new location for 5 years, so
> I won't have a chance to make these particular mistakes for a while.
>
>
>
> BTW, I did check for any email from prgmr.com on both my primary (domU)
>> and secondary (gmail) accounts: the only emails this month were the IP
>> messages from "chris t" on 5/14.
>>
>
>
> Yeah. You would have gotten more messages (but not enough) if my
> username -> email script handled multiple emails properly, as it does now
> (as of this morning, I haven't generated new email lists yet, though. srn
> just fixed the script.)
>
> ______________________________**_________________
> discuss mailing list
> [email protected]
> http://lists.prgmr.com/**mailman/listinfo/discuss<http://lists.prgmr.com/mailman/listinfo/discuss>
>
_______________________________________________
discuss mailing list
[email protected]
http://lists.prgmr.com/mailman/listinfo/discuss