Re: [Ganglia-developers] PATCH : Adding trends to Ganglia

2010-01-05 Thread Sebastien Termeau
On Mon, Jan 4, 2010 at 10:03 AM, Carlo Marcelo Arenas Belon 
care...@sajinet.com.pe wrote:

 On Tue, Dec 29, 2009 at 02:49:28PM +0100, Sebastien Termeau wrote:
 
  OK, I will provide you with two new patches that include those remarks.

 BUG249 (the one about using tables for formatting of the host view) is IMHO
 already closed, and unless you really meant to (as I expected and asked
 before
 but got no confirmation) to be really an enhancement that would be released
 with some 3.1 version (most likely 3.1.7).

 if that is the case, please update the target on the bugs or if you can't
 do
 that let me know and I would do so and track the corresponding backport for
 the release.


I agree.
How do I change the target version? It is the version number in the bug
description?



 BUG250 will need an updated patch that can be applied cleanly to trunk so
 that it can be tested/enhanced further.


I just submitted a new version of the patch.
This one can be cleanly applied to trunk.
I slightly modified the order in which thinks are done in graph.php in order
to calculate the 'start' and 'end' values before calling the metric.php
script.




  I was also thinking of adding a third one with minimum, maximum and
 average.
  Do you think it might be interesting to have this graph also?

 AFAIK, those values are already in the metric graphs as numeric values, and
 the MAX is also graphed with a red line, is that what you were looking to
 add?


Yes it is.
I was thinking that maybe the normal graphs should not come with this max
line.
And instead, we can provide a new 'trend graph' with MIN, MAX and AVG drawn
as lines.

Regards

Sebastien
--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev ___
Ganglia-developers mailing list
Ganglia-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-developers


Re: [Ganglia-developers] template-based metric definition with PCRE

2010-01-05 Thread Daniel Pocock
Carlo Marcelo Arenas Belon wrote:
 On Mon, Dec 28, 2009 at 08:47:35PM +, Daniel Pocock wrote:
   
 Jesse Becker wrote:
 
 On Sat, Nov 28, 2009 at 08:42, Daniel Pocock dan...@pocock.com.au wrote:
   
   
 For those following trunk, you may need to bootstrap again, and make
 sure you have pcre available.

 I've linked gmond with libpcre so that it can dynamically match the
 metric names

 E.g., for the multicpu module, this is the only metric definition that
 needs to be given to enable all metrics on all cores:

  metric {
name_match = multicpu_([a-z]+)([0-9]+)
value_threshold = 1.0
title = CPU-\\2 \\1
  }
 
 Oh, that's cool. +1 for me.
   
   
 I've backported to 3.1,
 

 that was a bad idea IMHO, not because the implementation is bad, but because
 3.1.3^H4^H5^H6 has been delayed long enough that adding anything else to it
 this late and therefore resetting the testing cycle would be unwise;
 specially considering there are other fairly significant fixes/features
 waiting as well for backport as well.

   
That is a risk - that is why I have now made it completely optional
 there is also the fact that there was a valid (sorta, even if no code was
 ever produced otherwise) comment on how this functionality should be made
 optional (just like python is) and that wasn't discussed further (except
 on this email after it was committed), neither corrected.
   
Now this has been done - I've also demonstrated how to do this with a 
single configure option, we should consider the same syntax for the 
python option

 lastly, this code makes using multicpu so easy that it will be fairly obvious
 the module never worked fine to begin with and so it would therefore make
 more sense to also backport the needed fixes in r2116 (still incomplete), and
 maybe even the configuration cleanup patches in r2118 which are also somehow
 related, and also consider better ways to protect users of other platforms
 than Linux and Cygwin from shooting themselves on the foot by trying to get
 that module loaded, and which is an even bigger issue.

   
Is it the job of the release manager to apply each backport himself, or 
can these tasks be assigned to the people who developed the patches?

I think that exposing the problems in multicpu is not such a bad thing - 
hopefully it will encourage people to contribute fixes.
 $ svn log -r2160
 
 r2160 | d_pocock | 2009-12-28 20:43:54 + (Mon, 28 Dec 2009) | 1 line

 Patch for PCRE support (backport r2112 and r2119)
 

 you are missing also r2150 and r2156 and some yet not existent patches
 so that the dependency will be also in the RPM SPEC and documented in
 the configuration man page and other needed places.

   
Those changes have been backported

The RPM spec and man page have been updated now

I've also updated the STATUS file

 would suggest instead to revert this backport for now.
   
With the change I have made, do you still believe we should revert this?

   
 I'd be interested in any feedback on the PCRE dependency.  If necessary,
 the feature can be made into a compile time option so that gmond can
 build without it.
 
 Yes, an optional compile time option is the way to do this.  Use it if
 present, but continue on without it if not present.
   
   
 Is PCRE not available on any platform that we want to support for 3.1?  
 

 most likely available everywhere (just like python), but since not having
 it would most likely only imply that the use of the corresponding
 configuration wouldn't be possible it really makes sense to be considered
 optional.

   
 If not, then I'll leave the patch as it is, too many #ifdefs can make 
 the code look messy.  The current implementation tries default locations 
 for pcre, or let's you specify your own version:

 ./configure --with-libpcre=/opt/pcre
 

 ideally all that should be needed will be to also have a --enable-pcre or
 equivalent flag to control how to disable support for this at compile time
 just like it is possible for python (and that has proven to be really useful
 for Solaris users AFAIK)
   

To disable it:

./configure --without-libpcre

or

./configure --with-libpcre=no


--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev 
___
Ganglia-developers mailing list
Ganglia-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-developers


Re: [Ganglia-developers] bootstrapping for 3.1.X series and 3.2.X

2010-01-05 Thread Daniel Pocock
Carlo Marcelo Arenas Belon wrote:
 On Mon, Dec 28, 2009 at 10:51:51PM +, Daniel Pocock wrote:
   
 Carlo Marcelo Arenas Belon wrote:
 
 On Sun, Dec 06, 2009 at 09:28:04AM +, Daniel Pocock wrote:
   
   
 Carlo Marcelo Arenas Belon wrote:
 
 
 On Wed, Nov 25, 2009 at 11:00:21AM +, Daniel Pocock wrote:
   
   
 b) should the choice of bootstrap environment be locked for all 
 3.1.X, and only changed when increasing the minor version number 
 (e.g. when we go from 3.1 to 3.2)?
 
 
 no, but since our build system is full of hacks and not completely 
 reliable
 it might be a good idea to test no issues are introduced when looking at
 a new version.
   
   
 Ok, but if it is not locked down, let's consider some of the following:

 - document the version we expect
 
 agree, and that is what README.SVN is for, but first we have to decide which
 version to expect to begin with.
   
   
 - maybe add some check to configure that warns if a different version of  
 autotools is detected?
 
 configure doesn't depend autotools and so that would be the wrong place to 
 put
 any checks, but configure.in does and there is where bootstrapping should be
 aborted using AC_PREREQ and friends if using the wrong versions.
   
   
 Ok, should we use AC_PREREQ for 3.1.6, are there any disadvantages?
 

 only if the macros will definitely break with an older version of autoconf
 as otherwise all we are doing is enforcing a recommendation and preventing
 anyone that might not have access to the newest version of autotools the
 posibility of getting their own bootstrap (not much of an issue if we also
 provide regular snapshots though).

   

I've had a quick search for information on this - it appears that adding

AC_PREREQ(2.61)

would cause bootstrapping to fail on any older or newer version - only 
2.61 would be supported.

I think this is the right way to go, as it will prevent us from running 
in to the same issues again, and it will hopefully prevent people 
building trunk with a different version of autotools and creating bugs 
that no one else can re-produce.

 d) Can anyone volunteer to provide a stable bootstrap environment 
 (e.g. a virtual server) just for Ganglia?  Two such environments may 
 be needed, one for trunk and one for the current release branch.
 
 
 Matt did offer an EC2 instance if we could agree on an OS version :

   
 http://www.mail-archive.com/ganglia-developers@lists.sourceforge.net/msg05271.html

 I suggested Debian 5.0 (more conservative) or Fedora 12 (to be updated 
 more
 frequently) but as far as it is agreed, documented and reproducible 
 anything
 should work.
   
   
 I prefer Debian 5.0 (lenny), that is what I have on my laptop, home PC  
 and various other infrastructure that I use. Elsewhere I am using 
 RHEL3/4/5.
 
 Debian 5.0 is also what is being used for bugzilla AFAIK and so that might
 be a good option for consolidation.
   
 Who controls access to the Bugzilla server?  I wouldn't mind having use 
 of that as a bootstrap environment.
 

 Matt would know, but I suspect that shell access might be probably problematic
 to get and therefore unless we are talking about some continuous build system
 like cruisecontrol or hudson making snapshots, it might be problematic
 otherwise.

 to easy using one of those systems r2144 (still incomplete) was committed
 but would be nice to know which direction we are going anyway and for now it
 would seem there is not much dialogue going on about the alternatives.

   
Access to that box probably isn't necessary, most people should have 
little difficulty getting their hands on a copy of lenny, and it is easy 
to install - any other comments on this?
 We also have access to the OpenCSW build farm, and they are willing to  
 consider applications for access by Ganglia developers, so we could look  
 at that as a bootstrap environment.
 
 Bootstrapping is done only once per package and so wouldn't make sense to
 also do bootstrapping in Solaris.
   
 No, I wasn't suggesting we bootstrap separately for Solaris.  I was just 
 suggesting that we use the OpenCSW machine to bootstrap for all platforms.

 However, we would be stuck with whatever version of autotools is current 
 in the OpenCSW environment, and any decision to change the version there 
 would be out of our control.

 I think Debian 5.0 (lenny) is the final decision then
 

 Debian 5.0 (lenny) x86 (32-bit) right?
   

I'm using lenny amd64 (64 bit) most of the time now, especially since 
the various browser plugins (e.g. Java) now support 64 bit Linux.

   
 any final objections/comments?
 

 the only one I can think of is that we sometimes used to provide RPMs with
 the releases but that would be IMHO not that important considering that
 fedora/EPEL might be the package most people would use anyway and at least
 for fedora that