As I said, it's a known bug that will never be fixed by ganglia's maintainers, so if you want it fixed you have to try to do it yourself. The bug is missing input sanity checking. If it were documented someplace, you could call it a feature.
The HP DL3x0 and DL5x0 seem to be rather popular. We keep buying more because everything cheaper that we've tried has had performance or management problems. It's not some obscure, low volume product. Martin Knoblauch wrote: > Hi Cameron, > > there are two problems: > > a) overflow. 32-bit counters will not last very long on 1 Gbit or > faster. They should not repord PB spikes though. > b) some BMC adapters on Linux-64 had/have a really bad HW bug > reporting bogus counters every now and then. That is supposed to be > fixed by REMOVE_BOGUS_SPIKES, but only on Linux. But no guarantees. It > worked for me on 3.0.7. > > Cheers > Martin > ------------------------------------------------------ > Martin Knoblauch > email: k n o b i AT knobisoft DOT de > www: http://www.knobisoft.de > > > *From:* Cameron Spitzer <cspit...@nvidia.com> > *To:* Bostjan Skufca <bost...@a2o.si> > *Cc:* ganglia-general <ganglia-general@lists.sourceforge.net> > *Sent:* Tue, March 29, 2011 11:01:24 PM > *Subject:* Re: [Ganglia-general] Network bytes spikes > > > CPPFLAGS=-DREMOVE_BOGUS_SPIKES > had no effect in my installation. > We eventually found a patch in a non-ganglia forum somewhere, but > I can't find it now. > It basically added input sanity checking. > > The problem is a 32-bit counter on a 1 Gbps NIC can overflow in > less than gmond's sampling interval. > When it overflows, ganglia treats the small negative number as a > very large positive. > This is a known ganglia bug. It's been around since 2003. You > just have to live with it, or try to fix it yourself. > > -Cameron > > > > Bostjan Skufca wrote: >> That really seems to be the case. Speaking out of my head now but >> it seems that I only see this on HP DL3x0 with Broadcom >> Corporation NetXtreme II BCM5708 Gigabit Ethernet (rev 12) >> interfaces. I've found some threads... >> >> Anyway, does this really work? There is something in code which >> eliminates 1e^13 and bigger or so it seems... >> make CPPFLAGS=-DREMOVE_BOGUS_SPIKES >> >> >> b. >> >> >> On 29 March 2011 20:30, Vladimir Vuksan <vli...@veus.hr >> <mailto:vli...@veus.hr>> wrote: >> >> >> I see it all the time :-(. According to Bernard this is due >> to problem >> with some of the Broadcom cards. Perhaps Bernard can offer >> more insight. >> >> On Tue, 29 Mar 2011 20:23:31 +0200, Bostjan Skufca >> <bost...@a2o.si <mailto:bost...@a2o.si>> wrote: >> > Hi, >> > >> > occasionally I notice huge spikes in network graphs in ganglia >> (petabytes >> > per second or so). Not sure whether those are caused by >> gmond restarts >> or >> > network interface byte counter overflows or something else. >> > Is someone else also seeing similar behaviour? Running >> latest ganglia >> > (3.1.7). >> > >> > b. >> >> > > ------------------------------------------------------------------------ > This email message is for the sole use of the intended > recipient(s) and may contain confidential information. Any > unauthorized review, use, disclosure or distribution is > prohibited. If you are not the intended recipient, please contact > the sender by reply email and destroy all copies of the original > message. > ------------------------------------------------------------------------ >
------------------------------------------------------------------------------ Create and publish websites with WebMatrix Use the most popular FREE web apps or write code yourself; WebMatrix provides all the features you need to develop and publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
_______________________________________________ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
