Re: [Ganglia-developers] Gmetad bottlenecks

2013-12-08 Thread Devon H. O'Dell
2013/12/8 Chris Burroughs : > On 12/07/2013 03:22 PM, Devon H. O'Dell wrote: >> >> We were polling every 10 seconds, and it was taking over 2 minutes to >> finish parsing the XML (which includes writing the RRDs). With my >> changes, the 10 second poll is feasible. >> > > Parse, or fetch & parse?

Re: [Ganglia-developers] Gmetad bottlenecks

2013-12-08 Thread Chris Burroughs
On 12/07/2013 03:22 PM, Devon H. O'Dell wrote: > We were polling every 10 seconds, and it was taking over 2 minutes to > finish parsing the XML (which includes writing the RRDs). With my > changes, the 10 second poll is feasible. > Parse, or fetch & parse? We have a simple python script we use to

Re: [Ganglia-developers] Gmetad bottlenecks

2013-12-08 Thread Chris Burroughs
On 12/07/2013 03:00 PM, Vladimir Vuksan wrote: >> Were these failures totally random or grouped in some way? (Same >> cluster, type, etc). > > We run multiple dozens of clusters and some of the larger clusters ie. > clusters that had 2-3x machines that other clusters would exhibit either > gaps, s