Re: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Martin Knoblauch
Arjun, instead of hacking "gmetad", another option could be to just write a script/program that queries a running "gmetad" tcp-port and feed the data from the received XML stream into your DB. That way you could avoid touching the existing ganglia code alltogether. Just for curiosity, how would

Re: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Arjun
Martin, Thanks for the tip. Yes, it seems that the rrd_helpers.c file is where I will have to start. I think that maybe we should have a separate helper file for MySql insertion (or any DB insertion) and have that as a separate option for ganglia. So people will have a choice of where to store dat

Re: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Arjun
Thanks Paul, I think this may be what Chris was looking for. I still need to write directly to MySql so do you have any ideas there ? thanks Arjun On 2/22/06, Paul Millar <[EMAIL PROTECTED]> wrote: > > On Wednesday 22 Feb 2006 19:08, Arjun wrote: > > I think there are probably already some tools

Re: [Ganglia-developers] apr, expat, confuse as shipped with ganglia

2006-02-22 Thread Martin Knoblauch
> > > > I believe apr was modified to include multicast functionality, I'm > > not sure about > > the rest. > > > Hi Brooks, > > good point. Now I remember the same. Time for a session with "diff" > :-) > > Martin > Matt, "diff" does not make me happy. It seems our version of apr-0.9.5 was

Re: [Ganglia-developers] apr, expat, confuse as shipped with ganglia

2006-02-22 Thread Martin Knoblauch
--- Brooks Davis <[EMAIL PROTECTED]> wrote: > On Wed, Feb 22, 2006 at 05:07:08PM -0800, Martin Knoblauch wrote: > > Hi Matt, > > > > you may have seen the recent report about problems in apr code > which > > are solved in later versions. This opens the question how to handle > > this for Gangli

Re: [Ganglia-developers] apr, expat, confuse as shipped with ganglia

2006-02-22 Thread Brooks Davis
On Wed, Feb 22, 2006 at 05:07:08PM -0800, Martin Knoblauch wrote: > Hi Matt, > > you may have seen the recent report about problems in apr code which > are solved in later versions. This opens the question how to handle > this for Ganglia. > > Are the versions of apr, expat and confuse shipped

[Ganglia-developers] apr, expat, confuse as shipped with ganglia

2006-02-22 Thread Martin Knoblauch
Hi Matt, you may have seen the recent report about problems in apr code which are solved in later versions. This opens the question how to handle this for Ganglia. Are the versions of apr, expat and confuse shipped with the current code just unmodified copies of the stuff, or are there ganglia

Re: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Martin Knoblauch
Arjun, only comments I have: - yes pleaase. Having the metrics stored in a "real" DB is something I am very interested in. Although this may have some issues like capacity, being able to view/search 1-hour stats over the last year would be great. - modifying "gmetad" seems to be the most likely

[Ganglia-developers] Re: [Ganglia-general] Ganglia truncating larger status messages

2006-02-22 Thread Martin Knoblauch
Hi Ian, beating me with this advice :-) Chris -> Please assign the bug to me. Not that I know how to fix this short term, as upgrading the whole of "apr" might be a challenge. I could imagine a way to specify a different apr-location with "configure". Cheers Martin --- Ian Cunningham <[EMAIL

Re: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Paul Millar
On Wednesday 22 Feb 2006 19:08, Arjun wrote: > I think there are probably already some tools available for transferring or > importing data from RRD to MySql. If I come across any I'll let you know. If you don't come across anything specific, you might like to look at: http://www.enhydra.org/tec

Re: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Arjun
In my case the monitoring db will be on a separate machine along with gmetad. I'm monitoring a cluster so can have a separate (external) machine to store data on so I guess this will not be a performace bottleneck if I have a DB like MySql to store and retreive data. thanks Arjun On 2/22/06, Bern

Re: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Chris Croswhite
Thanks! Chris On Wed, 2006-02-22 at 11:08, Arjun wrote: > Chris, > > Sure thing. Will let you know if I get anything or write anything. > Yes, I guess it will be a gmetad modification. > > In my case, I'm not interested in transferring data from RRD to mysql > offline but > rather have gmetad w

Re: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Arjun
Chris, Sure thing. Will let you know if I get anything or write anything. Yes, I guess it will be a gmetad modification. In my case, I'm not interested in transferring data from RRD to mysql offline but rather have gmetad write to the MySql DB directly instead of RRD. I think there are probably

RE: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Bernard Li
I don't know of anybody who has attempted to implement a relational db with Ganglia - I guess the biggest concern would be performance. Cheers, Bernard > -Original Message- > From: Chris Croswhite [mailto:[EMAIL PROTECTED] > Sent: Wednesday, February 22, 2006 10:47 > To: Bernard Li > C

RE: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Chris Croswhite
In my case, yes, I will be querying the data set by outside users. If someone has code for sqllite implementation, then I can modify that to call out to mysql or just dump the results to a flat file and read it into the db or choice. Really, I guess I need someone to help me jump start this with

RE: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Bernard Li
I'll let Martin and possibly Matt pitch in on the technical details, but I was wondering if sqlite would be better suited than MySQL? I mean you probably don't really need users accessing the data - do you? Cheers, Bernard From: [EMAIL PROTECTED] [ma

Re: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Arjun
Hi Chris, Any ideas on where (in the codebase) I can start ? I don't mind doing the code modifications myself as long as I can get a jumpstart. (I'm a bit pressed for time so I'd rather have an existing solution) regds Arjun On 2/22/06, Chris Croswhite <[EMAIL PROTECTED]> wrote: > > I am looking

Re: [Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Chris Croswhite
I am looking to do something like this as well. TIA, Chris On Wed, 2006-02-22 at 10:02, Arjun wrote: > Hi Folks, > > I have a requirement to integrate ganglia to a DB such as MySql so > that gmetad should store retreived data in > MySql instead of an RRD. > > Has anyone already done this and i

[Ganglia-developers] Integrating Ganglia with a DB (MySql) ?

2006-02-22 Thread Arjun
Hi Folks, I have a requirement to integrate ganglia to a DB such as MySql so that gmetad should store retreived data in MySql instead of an RRD. Has anyone already done this and if so can someone please point me to the code/docs etc ? If it has not been done then can someone guide as to where I