This would have been an excellent first reply to yesterday's "Getting back into IT" query! -- richard
Sherry Abercrombie <saber...@gmail.com> wrote on 12/22/2009 12:13:14 PM: > So here's how my Tuesday morning/afternoon is going so far. > > Arrive shortly after 7AM CST, all is quiet and functioning > normally. I proceed with taking care of some Heat tickets, > monitoring stuff as normal via Nagios, checking on backups, etc > etc. Send a few emails to this list about Citrix, blah blah blah, > all rocking along nice and quiet like. > > 9AM - Generator testing, happens every Tuesday @ 9AM. > > 9:30AM - Generator shuts down, check on AC in server room to confirm > it has made the switch from generator back to house power (doesn't > always switch & will not be cooling in that event.) All is normal. > > 10:25AM - Fire suppression system starts alerting with a very loud > beeping noise, server room is locked down, we cannot access with our > proximity badges. Fire suppression system continues to alert with a > "System Problem" issue. > > 10:28AM - Gain entry into server room. AC unit is running....and > that's the only thing that is running. Server room is black, no power. > > Now that the issue has been assessed, it has been determined that > the UPS didn't make the switch from being on battery power for the > generator test, back to house power. Batteries drained, when > batteries drained completely & power went down, fire suppression > system performed like it was supposed to and locked everything down, > shut the dampers on the vents etc, and went into almost there is a > fire mode. Fortunately it didn't release since no fire or smoke wasdetected. > > Now 12:10PM and most everything is back on-line with the exception > of 2 VMWare hosts that are not being cooperative and the Oracle databases. > > Sigh.....Can I go home now? > > Oh, and the replacement parts are on order and should be here by in > the morning, electrician says he can replace the parts with no > disruption of service, and one minor detail, this could happen again > before the parts get replaced tomorrow. Glad I'm not the on-call > person this week!! > > -- > Sherry Abercrombie > > "Any sufficiently advanced technology is indistinguishable from magic." > Arthur C. Clarke > > ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~
