Colorado ski vacation is scheduled for Jan. 31 - Feb. 6 @ Wolf Creek. Yeah Richard, with the warning of "Do you really want to have days like this?"....
Final tally of damages, 2 sticks of memory in one of the VMWare servers, spare parts on hand, everything up now. I haven't seen my server room completely dark in years. That was pretty surreal. On Tue, Dec 22, 2009 at 12:30 PM, Eldridge, Dave <d...@parkviewmc.com> wrote: > You lucky the AC stayed on. > > Makes my day look easy. J good luck with this one. > > You should book that Colorado ski vacation soon and get away. > > > > > > *From:* Sherry Abercrombie [mailto:saber...@gmail.com] > *Sent:* Tuesday, December 22, 2009 11:13 AM > > *To:* NT System Admin Issues > *Subject:* My Tuesday Morning/Afternoon > > > > So here's how my Tuesday morning/afternoon is going so far. > > Arrive shortly after 7AM CST, all is quiet and functioning normally. I > proceed with taking care of some Heat tickets, monitoring stuff as normal > via Nagios, checking on backups, etc etc. Send a few emails to this list > about Citrix, blah blah blah, all rocking along nice and quiet like. > > 9AM - Generator testing, happens every Tuesday @ 9AM. > > 9:30AM - Generator shuts down, check on AC in server room to confirm it has > made the switch from generator back to house power (doesn't always switch & > will not be cooling in that event.) All is normal. > > 10:25AM - Fire suppression system starts alerting with a very loud beeping > noise, server room is locked down, we cannot access with our proximity > badges. Fire suppression system continues to alert with a "System Problem" > issue. > > 10:28AM - Gain entry into server room. AC unit is running....and that's > the only thing that is running. Server room is black, no power. > > Now that the issue has been assessed, it has been determined that the UPS > didn't make the switch from being on battery power for the generator test, > back to house power. Batteries drained, when batteries drained completely & > power went down, fire suppression system performed like it was supposed to > and locked everything down, shut the dampers on the vents etc, and went into > almost there is a fire mode. Fortunately it didn't release since no fire or > smoke was detected. > > Now 12:10PM and most everything is back on-line with the exception of 2 > VMWare hosts that are not being cooperative and the Oracle databases. > > Sigh.....Can I go home now? > > Oh, and the replacement parts are on order and should be here by in the > morning, electrician says he can replace the parts with no disruption of > service, and one minor detail, this could happen again before the parts get > replaced tomorrow. Glad I'm not the on-call person this week!! > > -- > Sherry Abercrombie > > "Any sufficiently advanced technology is indistinguishable from magic." > Arthur C. Clarke > > > > > > This e-mail contains the thoughts and opinions of the sender and does not > represent official Parkview Medical Center policy. > > This communication is intended only for the recipient(s) named above, may > be confidential and/or legally privileged: and, must be treated as such in > accordance with state and federal laws. If you are not the intended > recipient, you are hereby notified that any use of this communication, or > any of its contents, is prohibited. If you have received this communication > in error, please return to sender and delete the message from your computer > system.{token} > > > > > > -- Sherry Abercrombie "Any sufficiently advanced technology is indistinguishable from magic." Arthur C. Clarke Sent from Keller, TX, United States ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~
