Re: [c-nsp] Multiple power supply failures. Advise needed

ore it hits the power supply in most cases. System boards are > > WAY > > > more sensitive to this kind of thing. > > > > > > The fact you have ONLY PSU's failing still makes me think you have power > > issues. > > > > > > -- > >

Re: [c-nsp] Multiple power supply failures. Advise needed

offline temporarily. -- Randy www.FastServ.com -- Original Message --- From: Michael Ulitskiy To: "Randy McAnally" Cc: cisco-nsp@puck.nether.net Sent: Wed, 2 Sep 2009 12:47:57 -0400 Subject: Re: [c-nsp] Multiple power supply failures. Advise needed > You made me dou

Re: [c-nsp] Multiple power supply failures. Advise needed

uot;Michael Ulitskiy" > To: "Randy McAnally" > Cc: > Sent: Wednesday, September 02, 2009 8:08 AM > Subject: Re: [c-nsp] Multiple power supply failures. Advise needed > > > > What about the fact that most (if not all) power supplies have independent

Re: [c-nsp] Multiple power supply failures. Advise needed

k you have power > issues. > > > > > > -- > > > Randy > > > www.FastServ.com > > > > > > -- Original Message --- > > > From: Michael Ulitskiy > > > To: "Randy McAnally" > > > Cc: "Scott G

Re: [c-nsp] Multiple power supply failures. Advise needed

Message --- > > From: Michael Ulitskiy > > To: "Randy McAnally" > > Cc: "Scott Granados" , "Seth Mattinen" > > , cisco-nsp@puck.nether.net > > Sent: Tue, 1 Sep 2009 23:21:23 -0400 > > Subject: Re: [c-nsp] Multiple power sup

Re: [c-nsp] Multiple power supply failures. Advise needed

ichael Ulitskiy" To: "Randy McAnally" Cc: "Scott Granados" ; "Seth Mattinen" ; Sent: Tuesday, September 01, 2009 8:21 PM Subject: Re: [c-nsp] Multiple power supply failures. Advise needed This is my main suspect now. They are doing work in the facility. Not

Re: [c-nsp] Multiple power supply failures. Advise needed

platforms / hardware types? - Original Message - From: "Michael Ulitskiy" To: "Randy McAnally" Cc: Sent: Wednesday, September 02, 2009 8:08 AM Subject: Re: [c-nsp] Multiple power supply failures. Advise needed What about the fact that most (if not all) power sup

Re: [c-nsp] Multiple power supply failures. Advise needed

--- From: Michael Ulitskiy To: "Randy McAnally" Cc: cisco-nsp@puck.nether.net Sent: Wed, 2 Sep 2009 11:08:24 -0400 Subject: Re: [c-nsp] Multiple power supply failures. Advise needed > What about the fact that most (if not all) power supplies have > independent sucking fa

Re: [c-nsp] Multiple power supply failures. Advise needed

stServ.com -- Original Message --- From: Michael Ulitskiy To: "Randy McAnally" Cc: "Scott Granados" , "Seth Mattinen" , cisco-nsp@puck.nether.net Sent: Tue, 1 Sep 2009 23:21:23 -0400 Subject: Re: [c-nsp] Multiple power supply failures. Advise needed

Re: [c-nsp] Multiple power supply failures. Advise needed

w.FastServ.com > > -- Original Message --- > From: Michael Ulitskiy > To: "Randy McAnally" > Cc: "Scott Granados" , "Seth Mattinen" > , cisco-nsp@puck.nether.net > Sent: Tue, 1 Sep 2009 23:21:23 -0400 > Subject: Re: [c-nsp] Mult

Re: [c-nsp] Multiple power supply failures. Advise needed

On Tue, 1 Sep 2009, Seth Mattinen wrote: Yeah, metal dust would be a killer. I don't know what to say either; magnetic air filters? Maybe salvage/buy some powerful magnets and mount them in your airflow. See if they collect anything over time. If they do, at least you'll have evidence. I've

Re: [c-nsp] Multiple power supply failures. Advise needed

Michael Ulitskiy wrote: > On Tuesday 01 September 2009 07:26:27 pm you wrote: > >> Something really odd/fishy is going on at the facility in question. >> Either they have a problem and won't admit it, or they're just as >> baffled as you are. But there is obviously *something* very bad going on >

Re: [c-nsp] Multiple power supply failures. Advise needed

a single environmental alarm from any cisco device or server sensor. > -- > Randy > > -- Original Message --- > From: Michael Ulitskiy > To: "Randy McAnally" > Cc: cisco-nsp@puck.nether.net > Sent: Tue, 1 Sep 2009 17:27:00 -0400 > Subject: R

Re: [c-nsp] Multiple power supply failures. Advise needed

dy > > -- Original Message --- > From: "Scott Granados" > To: "Seth Mattinen" , "Michael Ulitskiy" > > Cc: cisco-nsp@puck.nether.net > Sent: Tue, 1 Sep 2009 17:35:34 -0700 > Subject: Re: [c-nsp] Multiple power supply failure

Re: [c-nsp] Multiple power supply failures. Advise needed

On Tuesday 01 September 2009 07:26:27 pm you wrote: > Something really odd/fishy is going on at the facility in question. > Either they have a problem and won't admit it, or they're just as > baffled as you are. But there is obviously *something* very bad going on > to fry power supplies like tha

Re: [c-nsp] Multiple power supply failures. Advise needed

Justin, I'm not going to argue an importance of proper grounding. Also I do want to thank you for your reply. At this point I really doubt that the problem is grounding related, but I'll definitely keep that in mind. Also in my experience I've never seen a place where every piece of equipment w

Re: [c-nsp] Multiple power supply failures. Advise needed

power failure in the bay area because their UPS system >> went crazy under far to much load. Sounds like transients to me! >> >> - Original Message - >> From: "Seth Mattinen" >> To: >> Sent: Tuesday, September 01, 2009 10:21 AM >> Subje

Re: [c-nsp] Multiple power supply failures. Advise needed

5:34 -0700 Subject: Re: [c-nsp] Multiple power supply failures. Advise needed > Also make sure that the provider isn't doing work in the facility. > I'll never forget going to an L3 datacenter and arriving to find > workmen in the overhead grinding away and dropping dust and

Re: [c-nsp] Multiple power supply failures. Advise needed

1, 2009 4:26 PM Subject: Re: [c-nsp] Multiple power supply failures. Advise needed Randy McAnally wrote: I'm sorry, but I highly doubt this is why his devices are failing. Each device receives ground through the power cord (3rd prong is there for a reason, as well it is tied to chassis gro

Re: [c-nsp] Multiple power supply failures. Advise needed

-boun...@puck.nether.net] On Behalf Of Justin Shore Sent: Tuesday, September 01, 2009 3:03 PM To: Michael Ulitskiy Cc: cisco-nsp@puck.nether.net Subject: Re: [c-nsp] Multiple power supply failures. Advise needed Unless you scrapped the paint off of every joint between the chassis through the mounting bracke

Re: [c-nsp] Multiple power supply failures. Advise needed

Randy McAnally wrote: > I'm sorry, but I highly doubt this is why his devices are failing. Each > device receives ground through the power cord (3rd prong is there for a > reason, as well it is tied to chassis ground internally). Secondly, the > cabinets themselves should be grounded as is the ca

Re: [c-nsp] Multiple power supply failures. Advise needed

or them. According to the > > wiki > > they should be somewhat visible, at least with a magnifying glass. > > > > -- > > Randy > > > > -- Original Message --- > > From: Michael Ulitskiy > > To: cisco-nsp@puck.nether.net >

Re: [c-nsp] Multiple power supply failures. Advise needed

- Original Message --- > > From: Michael Ulitskiy > > To: cisco-nsp@puck.nether.net > > Sent: Tue, 1 Sep 2009 16:35:49 -0400 > > Subject: Re: [c-nsp] Multiple power supply failures. Advise needed > > > > > Well, I find the idea with whiskers particula

Re: [c-nsp] Multiple power supply failures. Advise needed

Unless you scrapped the paint off of every joint between the chassis through the mounting brackets to the rack then you aren't guaranteed a good connection. That's why most telco screw kits come with the star washer to help scrap the paint of the rack and why most telco equipment frames and mo

Re: [c-nsp] Multiple power supply failures. Advise needed

lass. > > -- > Randy > > -- Original Message --- > From: Michael Ulitskiy > To: cisco-nsp@puck.nether.net > Sent: Tue, 1 Sep 2009 16:35:49 -0400 > Subject: Re: [c-nsp] Multiple power supply failures. Advise needed > > > Well, I find the idea with

Re: [c-nsp] Multiple power supply failures. Advise needed

: [c-nsp] Multiple power supply failures. Advise needed > Well, I find the idea with whiskers particularly interesting, > because a lot of things described are perfectly matched with my situation. > We did recently moved, the data-center does have tiled raised floor > (don't

Re: [c-nsp] Multiple power supply failures. Advise needed

Well, I find the idea with whiskers particularly interesting, because a lot of things described are perfectly matched with my situation. We did recently moved, the data-center does have tiled raised floor (don't know if it zinced though) and the airflow is bottom to top which probably helps to b

Re: [c-nsp] Multiple power supply failures. Advise needed

nded which means no matter how well he grounds his equipment it won't help unless he digs his own ground. -- Randy -- Original Message --- From: Justin Shore To: Michael Ulitskiy Cc: cisco-nsp@puck.nether.net Sent: Tue, 01 Sep 2009 14:19:50 -0500 Subject: Re: [c-nsp] Multip

Re: [c-nsp] Multiple power supply failures. Advise needed

Sure, but what the proper grounding is? Does it mean that I have to run a dedicated grounding wire to every piece of equipment? The racks are properly grounded (according to provider) and every server is screwed to them. The power is provided via NEMA L5-20P twisted lock connecter with proper g

Re: [c-nsp] Multiple power supply failures. Advise needed

Michael Ulitskiy wrote: I forgot to mention that after the 1st wave of failures we have installed tripp lite surge protectors on all circuits. These last failures happened with tripp lites installed, so it shouldn't be transients. The events are random. Happened during daytime, night-time, wee

Re: [c-nsp] Multiple power supply failures. Advise needed

>> Check out http://en.wikipedia.org/wiki/Zinc_whiskers and Google for >> "zinc whiskers". Or, just as useful to you, check out new-ish research results: http://blogs.physicstoday.org/update/2009/05/how-tin-whiskers-grow.html Note that it is in-plane strain *gradients* that lead to the whisker

Re: [c-nsp] Multiple power supply failures. Advise needed

Michael Ulitskiy wrote: As for grounding lug I would gladly add it to 6500 chassis if that was the only problem. Running it to every piece of equipment which count about 50 pieces at the moment wouldn't be fun at all... Doh... I hate to say it, but the devices shouldn't have gone into product

Re: [c-nsp] Multiple power supply failures. Advise needed

; - Original Message - > From: "Seth Mattinen" > To: > Sent: Tuesday, September 01, 2009 10:21 AM > Subject: Re: [c-nsp] Multiple power supply failures. Advise needed > > > > Michael Ulitskiy wrote: > >> Hello, > >> > >> After a

Re: [c-nsp] Multiple power supply failures. Advise needed

their UPS system went crazy > under far to much load. Sounds like transients to me! > > - Original Message - > From: "Seth Mattinen" > To: > Sent: Tuesday, September 01, 2009 10:21 AM > Subject: Re: [c-nsp] Multiple power supply failures. Advise needed &

Re: [c-nsp] Multiple power supply failures. Advise needed

Well, they claim they have their engineers checked grounding, wiring, UPSes logs. They also claim they're doing unintrusive power circuit monitoring and so far found no problems. As for grounding lug I would gladly add it to 6500 chassis if that was the only problem. Running it to every piece o

Re: [c-nsp] Multiple power supply failures. Advise needed

! - Original Message - From: "Seth Mattinen" To: Sent: Tuesday, September 01, 2009 10:21 AM Subject: Re: [c-nsp] Multiple power supply failures. Advise needed Michael Ulitskiy wrote: Hello, After a little pause it started happening again and we lost 2 more power suppl

Re: [c-nsp] Multiple power supply failures. Advise needed

Interesting. Never heard of that. Can I ask you how you found the source of the problem and what you did to get it eliminated? Michael On Tuesday 01 September 2009 01:06:12 pm Geoffrey Pendery wrote: > Another odd-ball thing to look for, which has plagued us in a few > locations, is zinc whisker

Re: [c-nsp] Multiple power supply failures. Advise needed

-0700 Subject: Re: [c-nsp] Multiple power supply failures. Advise needed > Michael Ulitskiy wrote: > > Hello, > > > > After a little pause it started happening again and we lost 2 more power supplies > > (this time in servers) during last week. > > Can anybody advic

Re: [c-nsp] Multiple power supply failures. Advise needed

Michael Ulitskiy wrote: > Hello, > > After a little pause it started happening again and we lost 2 more power > supplies > (this time in servers) during last week. > Can anybody advice on a good organization that could do independent power > analysis > in New York, NY? > Thank you, > Unfortu

Re: [c-nsp] Multiple power supply failures. Advise needed

Another odd-ball thing to look for, which has plagued us in a few locations, is zinc whiskers. You mention physically moving to a new colo provider, and that your power is supposed to be clean... We've had repeated power supply failures because of zinc whiskers in a few of our sites. Check out htt

Re: [c-nsp] Multiple power supply failures. Advise needed

Hello, After a little pause it started happening again and we lost 2 more power supplies (this time in servers) during last week. Can anybody advice on a good organization that could do independent power analysis in New York, NY? Thank you, Michael On Friday 14 August 2009 09:56:00 pm you w

Re: [c-nsp] Multiple power supply failures. Advise needed

Michael Ulitskiy wrote: > Thanks for the advise. This is a good one. Will definitely do. > I should also add that ground potential differences are also dangerous and can shock you if it's high enough, not just something to be worried about with equipment. ~Seth __

Re: [c-nsp] Multiple power supply failures. Advise needed

Thanks for the advise. This is a good one. Will definitely do. Michael On Sunday 16 August 2009 03:15:44 pm Seth Mattinen wrote: > Michael Ulitskiy wrote: > > Thanks everybody who replied. > > I was promised our circuits to be examined by electrician on Monday. > > Is there a way for me to check

Re: [c-nsp] Multiple power supply failures. Advise needed

Michael Ulitskiy wrote: > Thanks everybody who replied. > I was promised our circuits to be examined by electrician on Monday. > Is there a way for me to check the grounding? I remember some fat wires are > fastened to the cage, > but honestly I didn't pay particular attention. > Thanks, > You c

Re: [c-nsp] Multiple power supply failures. Advise needed

Thanks everybody who replied. I was promised our circuits to be examined by electrician on Monday. Is there a way for me to check the grounding? I remember some fat wires are fastened to the cage, but honestly I didn't pay particular attention. Thanks, Michael On Friday 14 August 2009 09:59:30 p

Re: [c-nsp] Multiple power supply failures. Advise needed

On Aug 15, 2009, at 3:04 AM, Michael Ulitskiy wrote: Does anybody have any ideas what could be causing this and how I can monitor the specific conditions? Grounding? --- Roland Dobbins //

Re: [c-nsp] Multiple power supply failures. Advise needed

Michael Ulitskiy wrote: > Hello, > > We have a very strange problem. We have recently changed colo-space provider > and since that > we had 4 power supply failures in all kind of cisco equipment within 2 month > period. > According to colo provider we're receiving "clean" power backed up by UPS

[c-nsp] Multiple power supply failures. Advise needed

Hello, We have a very strange problem. We have recently changed colo-space provider and since that we had 4 power supply failures in all kind of cisco equipment within 2 month period. According to colo provider we're receiving "clean" power backed up by UPSes and generator. We're currently hav