So many times the screw ups are small. Noticeable only to a few. However, there are those times, when you become 'that guy'. Those days and the weeks that follow just sort of suck.
At a previous place, way back in the NT3.51 days. A DC had a hardware failure that was resolved but left the DC in a weird state. So the BDC was promoted and that blue screened and failed as well. The backup tapes were turned to and well... it really was a bad week for those two guys. So people were told no logging out, work on paper, pull out the disaster scenario plans and keep the business running. Three days and a bunch of desktop guys running around fixing broken trusts on desktop systems later (site had 8,000 desktops and a few thousand servers, only about 1,000 desktops had to be physically touched) the disaster was over. A common statement was "I'll bet those guys got fired". The IT director stopped by our group once and stated, "I already paid for the mistake, why would I get rid of those who have learned the lesson?". Of course, they were staked to the wall for a few weeks in various meetings until some other issue allowed them to take off the burlap sacks. This was not a small company. It was a large International place whose products every person on this lists uses. Sometimes, things just happen. All it takes is for the wrong 3 or 4 things to happen at the same time to make it worse. Steven On Fri, Aug 27, 2010 at 2:38 PM, Sean Martin <seanmarti...@gmail.com> wrote: > I'm not overly concerned. We've been running a couple of CX700s for about 5 > years with no issues other than a few bad drives. I'm sure the vendor of > their hardware had a similar track record though. I'd still like to know why > bad memory would prompt them to failover. > > - Sean > > On Fri, Aug 27, 2010 at 12:04 PM, Mayo, Bill <bem...@pittcountync.gov>wrote: > >> I wouldn't worry. We have been using EMC CX-whatevers for over 7 years >> now. We have had hard drives die (naturally) and even once had a memory >> stick go bad. But never once has a hardware failure lead to any downtime. >> The redundancy within CLARiiONs is extensive. >> >> Bill Mayo >> >> ------------------------------ >> *From:* Sean Martin [mailto:seanmarti...@gmail.com] >> *Sent:* Friday, August 27, 2010 3:51 PM >> >> *To:* NT System Admin Issues >> *Subject:* Re: Massive computer outage halts some Va. agencies >> >> Odd, I can hit the site just fine from Anchorage.... >> >> Possibly. Can't wait to find out. We just bought an EMC CX4-960 earlier >> this year. I'm assuming they're using higher-end gear so it has me thinking >> what kind of failures we could be victim of. >> >> - Sean >> >> On Fri, Aug 27, 2010 at 11:44 AM, Ben Scott <mailvor...@gmail.com> wrote: >> >>> On Fri, Aug 27, 2010 at 2:17 PM, Sean Martin <seanmarti...@gmail.com> >>> wrote: >>> > >>> http://hamptonroads.com.nyud.net/2010/08/massive-computer-outage-halts-some-va-agencies >>> >>> Unable to lookup the IP address of host name: hamptonroads.com.nyud.net >>> The DNS (Domain Name System) subsystem returned: Server Failure: The >>> name server was unable to process this query. >>> >>> > I'm really curious to know what SAN hardware they're using.... >>> >>> Maybe they're using the same SAN system that ate Microsoft's >>> Sidekick database last year... >>> >>> -- Ben >>> >>> ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ >>> ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ >>> >>> --- >>> You are currently subscribed to ntsysadmin as: seanmarti...@gmail.com. >>> To unsubscribe click here: >>> http://lyris.sunbelt-software.com/u?id=7432680.6e6595761ad36f434042683031b94018&n=T&l=ntsysadmin&o=9077006 >>> or send a blank email to >>> leave-9077006-7432680.6e6595761ad36f434042683031b94...@lyris.sunbelt-software.com >>> >> >> ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ >> ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ >> >> >> --- >> You are currently subscribed to ntsysadmin as: bem...@pittcountync.gov. >> To unsubscribe click here: >> http://lyris.sunbelt-software.com/u?id=787424.5b52d7aa670c9e7284b212f5caeb31d2&n=T&l=ntsysadmin&o=9077014 >> >> (It may be necessary to cut and paste the above URL if the line is broken) >> or send a blank email to >> leave-9077014-787424.5b52d7aa670c9e7284b212f5caeb3...@lyris.sunbelt-software.com >> >> ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ >> ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ >> >> >> --- >> You are currently subscribed to ntsysadmin as: seanmarti...@gmail.com. >> To unsubscribe click here: >> http://lyris.sunbelt-software.com/u?id=7432680.6e6595761ad36f434042683031b94018&n=T&l=ntsysadmin&o=9077026 >> >> (It may be necessary to cut and paste the above URL if the line is broken) >> or send a blank email to >> leave-9077026-7432680.6e6595761ad36f434042683031b94...@lyris.sunbelt-software.com >> >> > ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ > ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ > > > --- > You are currently subscribed to ntsysadmin as: sep...@gmail.com. > To unsubscribe click here: > http://lyris.sunbelt-software.com/u?id=7435566.4f879397846fbfec9cad8950daf326b3&n=T&l=ntsysadmin&o=9077113 > (It may be necessary to cut and paste the above URL if the line is broken) > or send a blank email to > leave-9077113-7435566.4f879397846fbfec9cad8950daf32...@lyris.sunbelt-software.com > ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ --- You are currently subscribed to ntsysadmin as: arch...@mail-archive.com. To unsubscribe click here: http://lyris.sunbelt-software.com/u?id=8142875.a9cf90b99baa17cb4fcf8293a59eb3b1&n=T&l=ntsysadmin&o=9077137 or send a blank email to leave-9077137-8142875.a9cf90b99baa17cb4fcf8293a59eb...@lyris.sunbelt-software.com
