On Thu, Nov 12, 2009 at 06:23:07AM -0500, Daniel Pocock wrote: >Bernard Li wrote: >> Hi Daniel: >> >> On Tue, Nov 10, 2009 at 8:30 AM, Daniel Pocock <dan...@pocock.com.au> wrote: >> >> >>> Which gmetad is intended to be on the future roadmap? >>> >>> For a large site, do you believe it is fair to say that the C >>> implementation is best for performance? >>> >> >> I think if possible, we should perform a side-by-side performance test. >> >> It should be possible to run both gmetad and gmetad-python polling the >> same sets of gmonds for data. The gmetads can reside on different but >> similar servers. >> >I've been meaning to do something like this anyway, with a view to >finding out how scalable Ganglia is when handling a large number of >hosts and metrics at short polling intervals.
I can say that the IO system really matters a lot when it comes to scaling, probably moreso than the number of hosts. That said, I'd love to see the results of any tests that you do. I recently moved from a 15 second interval to 30 seconds to reduce load on the gmetad server. I'm only dealing with about 5,300 metrics over 70 hosts, with about 70 metrics on average for each host (some more, some less). This cut the load a fair bit, but I lost resolution in the rrd files. After trying this for about a day, I moved all RRD files over to a ramdisk, which made the IO issues go away. >One related issue for me is distributing the load across multiple gmetad >servers dynamically - is something like this on the roadmap for either >of the gmetad versions? At the moment, the administrator has to manage >the load and move things around, but with users feeding their own >metrics in, the need for Ganglia to adapt dynamically and distribute the >load becomes more important. > >My first thoughts on the matter involved some kind of shared storage >containing all the RRDs, and using DLM to make sure that only one gmetad >can write the RRDs for a particular host or cluster. > > > >------------------------------------------------------------------------------ >Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day >trial. Simplify your report design, integration and deployment - and focus on >what you do best, core application coding. Discover what's new with >Crystal Reports now. http://p.sf.net/sfu/bobj-july >_______________________________________________ >Ganglia-developers mailing list >Ganglia-developers@lists.sourceforge.net >https://lists.sourceforge.net/lists/listinfo/ganglia-developers -- Jesse Becker NHGRI Linux support (Digicon Contractor) ------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers
