I'm seeing reasonable load under FreeBSD 6.0 with 217 nodes. I wouldn't expect ~100 nodes to be very functional on a machine with anything by amazingly fast disks. With ~150 I was seeing 300+ transactions per second which rendered my boxes with 10K RPM SCSI disks in a hardware RAID5 unusable much of the time. To fix that I store the RRDs on a memory disk and store copies in a tarball periodically. The code I use (other than the crontab entry) is part of the FreeBSD port:
http://www.freebsd.org/cgi/cvsweb.cgi/ports/sysutils/ganglia-monitor-core/files/gmetasnap.sh There are start and stop hooks in the rc.d script as well. On a related note, the tarball should be rerolled to contain the new freebsd/metrics.c I just committed since ganglia won't build on modern FreeBSD machines without it. If that's impractical, I can include the patch in the port, but it would be better to keep my patches to those required to make ganglia hier(7) friendly and avoid the dangerous use of nobody. -- Brooks On Fri, Apr 14, 2006 at 01:06:08PM -0700, Gilad Raphaelli wrote: > <!-- DIV {margin:0px} -->I'm actually seeing 100% disk busy under both rhel4 > and freebsd 4.11 with just 98 nodes in 13 clusters. My goal is to get > gmetad running on freebsd, rhel4 was just for comparision's sake. A ktrace > reveals 100s of failed mkdirs during every writing period - traceable to > rrd_helpers.c. There don't seem to be any other significant events. When > the disk hits 100% iowait the system is unusable. > > I was under the impression that a relatively low powered system could handle > something like this configuration - perhaps that is the issue? The box is a > PIII 800 with 1.5 GB mem - the rrds are stored on a dedicated 70 GB ide disk. > > Any insight would be appreciated. I'm hanging out in #ganglia on freenode if > anyone wants to chat. > > Thank you, > > Gil > > ----- Original Message ---- > From: Bernard Li <[EMAIL PROTECTED]> > To: [EMAIL PROTECTED]; [EMAIL PROTECTED]; > ganglia-developers@lists.sourceforge.net > Sent: Thursday, April 13, 2006 11:19:50 PM > Subject: [Ganglia-developers] RE: [Ganglia-general] New (final?) tarball for > ganglia-3.0.3 > > RE: [Ganglia-general] New (final?) tarball for ganglia-3.0.3 Hi > Martin: > > Finally had the time to test it, here's the text in the webpage now: > > Gmetad Web Frontend version 3.0.3.200604132304 Check for Updates. > Gmetad Web Backend (gmetad) version 3.0.3.200604102000 Check for Updates. > > Looks like it's fixed. > > BTW, I tested Ganglia on Fedora Core 5 x86 and it is working fine. > > Did anybody else test 3.0.3? Somebody on IRC mentioned that he was having > issues with gmetad using up 99% CPU with a large number of clients (50+). > > Cheers, > > Bernard > > > From: Martin Knoblauch [mailto:[EMAIL PROTECTED] > Sent: Tue 11/04/2006 11:38 > To: Bernard Li; [EMAIL PROTECTED]; ganglia-developers@lists.sourceforge.net > Subject: RE: [Ganglia-general] New (final?) tarball for ganglia-3.0.3 > > > Bernard, > > could you please test the following patch in "web" to solve this > really really big problem :-) You need to run "./configure" to recreate > "web/version.php". > > $diff -u -r1.9 ganglia.php > --- ganglia.php 25 Mar 2006 01:53:57 -0000 1.9 > +++ ganglia.php 11 Apr 2006 18:34:31 -0000 > @@ -33,7 +33,8 @@ > $version = array(); > > # The web frontend version, from conf.php. > -$version["webfrontend"] = "$majorversion.$minorversion.$microversion"; > +#$version["webfrontend"] = > "$majorversion.$minorversion.$microversion"; > +$version["webfrontend"] = "$ganglia_version"; > > # The name of our local grid. > $self = " "; > > > $diff -u -r1.1 version.php.in > --- version.php.in 10 Dec 2004 21:34:04 -0000 1.1 > +++ version.php.in 11 Apr 2006 18:34:50 -0000 > @@ -5,7 +5,7 @@ > $minorversion = @GANGLIA_MINOR_VERSION@; > $microversion = @GANGLIA_MICRO_VERSION@; > > -$ganglia_version = > "@[EMAIL PROTECTED]@[EMAIL PROTECTED]@GANGLIA_MICRO_VERSION@"; > +$ganglia_version = "@GANGLIA_VERSION@"; > $ganglia_release_name = "@GANGLIA_RELEASE_NAME@"; > > ?> > > > --- Bernard Li <[EMAIL PROTECTED]> wrote: > > > Just tested building and running on Fedora Core 4 x86, everything > > checks out (minimal installation test) - did notice this minor issue > > though: > > > > Gmetad Web Frontend version 3.0.3 Check for Updates. > > Gmetad Web Backend (gmetad) version 3.0.3.200604102000 Check for > > Updates. > > > > Notice the versions are different between webfrontend and gmetad - I > > guess they use difference sources for the version string? > > > > Chris, are you still planning to help us test with your hardware? > > > > Thanks, > > > > Bernard > > > > P.S. If anybody wants the RPMs, please ping me. > > > > ________________________________ > > > > From: [EMAIL PROTECTED] on behalf of Martin > > Knoblauch > > Sent: Sat 08/04/2006 00:31 > > To: ganglia general; ganglia-developers@lists.sourceforge.net > > Subject: [Ganglia-general] New (final?) tarball for ganglia-3.0.3 > > > > > > > > Hi, > > > > as promised, I have created a new pre-3.0.3 tarball. It can be > > downloaded from: > > > > http://www.knobisoft.de/ganglia/ganglia-3.0.3.200604080900.tar.gz > > > > Due to the release plans for OSCAR5, this could be the last snaphot > > before a release next week. > > > > Especially the following problems are supposed to be solved: > > > > - truncated XML > > - bogus "old protocol" messages in dead-host detection > > - gmetad will not stop updating RRDs after a previous failure > > - apr-0.9.7 is now officially in CVS > > - minor fixes to the webfrontend > > - more minor stuff -> See the ChangeLog > > > > Cheers > > Martin > > > > ------------------------------------------------------ > > Martin Knoblauch > > email: k n o b i AT knobisoft DOT de > > www: http://www.knobisoft.de > > > > > > ------------------------------------------------------- > > This SF.Net email is sponsored by xPML, a groundbreaking scripting > > language > > that extends applications into web and mobile media. Attend the live > > webcast > > and join the prime developer group breaking into this new coding > > territory! > > > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642 > > _______________________________________________ > > Ganglia-general mailing list > > [EMAIL PROTECTED] > > https://lists.sourceforge.net/lists/listinfo/ganglia-general > > > > > > > > > ------------------------------------------------------ > Martin Knoblauch > email: k n o b i AT knobisoft DOT de > www: http://www.knobisoft.de > > > > > -- Any statement of the form "X is the one, true Y" is FALSE. PGP fingerprint 655D 519C 26A7 82E7 2529 9BF0 5D8E 8BE9 F238 1AD4
pgpqI1j5tiMtI.pgp
Description: PGP signature
