We got bit by that one too. Most of our stuff came back up automatically, but not everything. That data center is impressive. Surprising to see something like that happen there of all places.
On Thu, 31 Mar 2005 13:04:47 -0500, D. Richard Hipp <[EMAIL PROTECTED]> wrote: > The SQLite website is back up after being down > all day due to a power supply failure at a data > center. Sorry for the inconvenience. For those > who are curious, the a detailed description of > the data center's problem is reproduced below: > > > Location: DLLSTX2 > > Severity: Level 5 > > Description: > > At 4:09AM CST, a power failure occurred in a redundant pair of Powerware UPS > > units feeding power to section B of the DLLSTX2 datacenter. The power > > failure > > was caused by a faulty fuse in UPS unit B-1. As the load transferred to UPS > > unit B-2, the spike in the load created an overloaded breaker and UPS B2 > > also > > lost power. This resulted in a power outage to the main power distribution > > unit feeding section B of the datacenter floor. Emergency teams were > > notified > > and the power was restored within 20 minutes. The power continued to cycle > > until 6:45AM due to the faulty fuse and the inability of the redundant UPS > > units to remain in bypass mode. Customers may have noticed several power > > cycles during this time period. Powerware, JT Packard, and electricians > > found > > the problem and replaced the faulty hardware and fuses. At 6:45AM, all > > electrical > > service was restored to normal and the NOC team began to bring all servers > > back online. The technical staff is currently placing a console on all > > servers > > to verify server restarts. Customers with operating systems that require a > > file > > check may have experienced extended downtime during the file check. > > Powerware > > and JT Packard will continue to monitor the UPS systems for the next 24 to > > 48 > > hours. The Planet does not anticipate any further outages. > > > > Note that even though the management at The Planet claims > that all power was restored by 6:45 AM, in fact the server > that hosts www.sqlite.org did not receive power until about > 12:30 PM. > -- > D. Richard Hipp <[EMAIL PROTECTED]> > >
