Re: [Ganglia-general] newbie question - web frontend templates

2010-11-29 Thread Bostjan Skufca
> P.S. Any of your customizations could be contributed to the project
> generically? :)

I thought about it and I would do it gladly, but it was/is a
multidirection development process which started with a messy code,
continued with code strips to enhance readability and modifications
which suit my use case.

Let me share the idea and current status first.

I manage disjoint groups of servers and I use ganglia to get a general
overview and metric monitoring with nagios, and if I need closer look
I use collectd on each host (collectd has a whole load of plugins
readily available). For all this to work I had to modify the following
stuff with ganglia:

- python modules for:
---> disk IOPS,
---> disk time,
---> interrupts,
---> context switches
---> process creation rate
---> (I really missed these things in form of a built-in C module)

- additional report graphs for aforementioned plugins and variations
(like average time per disk operation, average network packet size
etc)
- (change RRA definitions - I know this is a custom setting but I was
very disappointed to notice there were no min/max values stored in
RRDs by default)

- created grid overview which displays all report graphs at once (I
skim over this page to get a glance of what is going on) - talking
about 12 report graphs here (graphs are clickable, see below)
- changed grid report view to grid mesh view (or it should be called
cluster mesh) which displays all previously mentioned reports in
per-cluster manner
- click on report graph in grid overview shows clicked graph as first
one in cluster list, so I can easily locate malfunctioning cluster,
click on a report from cluster goes to cluster view and shows given
report for all hosts in cluster (this is standard, I just added html
anchor)

- in grid overview, at each report graph I have a link that takes you
to page which displays given report for each and every host in grid
- in this view I am able to normalize Y-axis scale across all graphs
so I can compare in absolute terms what is going on with each server
in comparison to all others

- in host view, I changed metric graph script to show min/avg/max
values (not supported by distributed version of frontend)

That is basically it.

Now, the code is still a mess and it has become (by my opinion) too
my-environment-specific to be easily adoptable by other users (I
stripped away private clusters, multigrid support is not working, disk
ops reports are mandatory etc).
The whole programming was more of an experiment to see if I can get
this done with ganglia It was successful, it serves it's purpose well
for me, but the code is non-releaseable (I am ashamed of it,
actually:). If one wants a .tar.gz I can send it, but you have been
warned:)

I am thinking of a total rewrite in due time (OO, with ZF templates
probably, should not take more than a day or two for my use case) and
when this happens I will have contributions to the project in mind, I
promise (it makes my life easier if I don't have to modify original
packages:).

b.

PS: If you would like a demo of my custom ganglia frontend (to click
through and see if you like it), send me your static IP and I can open
it up for you for a day or two.



On 29 November 2010 20:04, Bernard Li  wrote:
> Hi Bostjan:
>
> On Mon, Nov 29, 2010 at 8:26 AM, Bostjan Skufca  wrote:
>
>> I would be glad to know this before I started making customizations to
>> frontend, just 3 weeks ago. I know, my fault, I did not ask about it
>> :)
>
> Sorry for not making the announcement more obvious, but the switch
> between TemplatePower to Dwoo is not that bad.  I was able to do the
> switch of the entire web codebase in less than a week.
>
> But please do let us know if you run into any problems (perhaps better
> discussed in the -developers mailing-list).  And realistically we
> won't be releasing new frontend code for at least a couple of months I
> think, so it depends on your timeline :)
>
>> Anyway, I seriously hope that Dwoo supports 'if' statement in
>> templates. Working without it kinda sucks (TemplatePower).
>
> Yes it does, please see here:
>
> http://wiki.dwoo.org/index.php/Blocks:if
>
>
> Cheers,
>
> Bernard
>

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Ganglia-general mailing list
Ganglia-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-general


Re: [Ganglia-general] newbie question - web frontend templates

2010-11-29 Thread Bernard Li
Hi Chris:

On Mon, Nov 29, 2010 at 9:04 AM, Chris Hunter  wrote:

> Besides Rocks are there any other custom templates generally available ?
> I really don't know _what_ we can do with templates. The _how_ part I
> could figure out from other custom templates.

As far as I know Rocks and Jobmonarch are the only two projects that
have provided Ganglia templates.  Perhaps some other "commercial"
solutions make use of that, but I'm not too sure.

If development picks up on the templating front, we could add another
section in GitHub for that ;-)

Cheers,

Bernard

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Ganglia-general mailing list
Ganglia-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-general


Re: [Ganglia-general] newbie question - web frontend templates

2010-11-29 Thread Bernard Li
Hi Bostjan:

On Mon, Nov 29, 2010 at 8:26 AM, Bostjan Skufca  wrote:

> I would be glad to know this before I started making customizations to
> frontend, just 3 weeks ago. I know, my fault, I did not ask about it
> :)

Sorry for not making the announcement more obvious, but the switch
between TemplatePower to Dwoo is not that bad.  I was able to do the
switch of the entire web codebase in less than a week.

But please do let us know if you run into any problems (perhaps better
discussed in the -developers mailing-list).  And realistically we
won't be releasing new frontend code for at least a couple of months I
think, so it depends on your timeline :)

> Anyway, I seriously hope that Dwoo supports 'if' statement in
> templates. Working without it kinda sucks (TemplatePower).

Yes it does, please see here:

http://wiki.dwoo.org/index.php/Blocks:if

P.S. Any of your customizations could be contributed to the project
generically? :)

Cheers,

Bernard

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Ganglia-general mailing list
Ganglia-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-general


Re: [Ganglia-general] newbie question - web frontend templates

2010-11-29 Thread Jesse Becker
A custom template was created for the "Job Monarch" project that
attempts to displace queue stats on cluster_view pages within ganglia.
 See https://subtrac.sara.nl/oss/jobmonarch/wiki/Documentation/Screenshots
for examples.

The answer to "what?" is "anything you'd like."  The templates are
HTML based, with various template-related syntactic bits sprinkled
throughout.  They define almost everything about the webpages--the
layout, the look, the interface, navigation, etc.

You can, if you want, make a template that just dumps all of the rrd
files for a single metric, across all hosts (similar to MRTG, I
suppose).  or, you could re-do the entire interface with lots of
javascript and other stuff with a completely new "look".  However,
that will almost certainly require changes to the various php files as
well.  Unfortunately, the PHP code and the templates are pretty
closely intertwined--thus the recent discussion about a front-end
rewrite.



On Mon, Nov 29, 2010 at 12:04, Chris Hunter  wrote:
> Besides Rocks are there any other custom templates generally available ?
> I really don't know _what_ we can do with templates. The _how_ part I could
> figure out from other custom templates.
>
> So, what are templates used for ?
>
> Thanks,
> Chris Hunter
> Yale University
>
> Jesse Becker wrote:
>>
>> There isn't any specific documentation about making a new template
>> (alas!).  There isn't even something as simple as a list of variables
>> which will be expanded in the HTML template files. :-/
>>
>> I suggest that you make a copy of the GANGLIA_WWW/template/default
>> directory, and start making your changes from there.  The variables
>> are pretty obvious.
>>
>> Also, note that the templating engine has *changed* in the trunk
>> release.  We are not using TemplatePower anymore, and have moved to
>> using the Dwoo package instead.  I believe that the forthcoming 3.2.0
>> release will use this.  Dwoo has a similar, but different template
>> language, and I suggest that you make your changes against trunk, and
>> not the 3.1.x series.
>>
>> On Thu, Nov 18, 2010 at 17:07, Chris Hunter  wrote:
>>>
>>> Hi,
>>>
>>> I have been maintaining an instance of ganglia 3.0.3 installed by my
>>> predecessor. The last guy was a php programmer and did all sorts of
>>> fancy things to our ganglia frontend.
>>>
>>> I am starting a fresh install of ganglia 3.1.7; I have the basics done.
>>> I have our gmond-3.0.x clusters talking to the gmetad-3.1.7 host. I have
>>> the web frontend running.
>>>
>>> Next I want to create a custom template. I'll start with simple stuff
>>> like adding a custom logo bitmap to the metapage, maybe some URL links
>>> to our department website, etc.
>>>
>>> Can anyone point me to some documentation about creating custom
>>> templates ? What is 'best practice' to integrate a template with a
>>> ganglia-3.1.x installation ?
>>>
>>> Thank-you in advance,
>>>
>>> Chris Hunter
>>> Yale University
>>>
>>>
>>> --
>>> Beautiful is writing same markup. Internet Explorer 9 supports
>>> standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2 & L3.
>>> Spend less time writing and  rewriting code and more time creating great
>>> experiences on the web. Be a part of the beta today
>>> http://p.sf.net/sfu/msIE9-sfdev2dev
>>> ___
>>> Ganglia-general mailing list
>>> Ganglia-general@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/ganglia-general
>>>
>>
>>
>>
>
>



-- 
Jesse Becker

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Ganglia-general mailing list
Ganglia-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-general


Re: [Ganglia-general] newbie question - web frontend templates

2010-11-29 Thread Chris Hunter
Besides Rocks are there any other custom templates generally available ?
I really don't know _what_ we can do with templates. The _how_ part I 
could figure out from other custom templates.

So, what are templates used for ?

Thanks,
Chris Hunter
Yale University

Jesse Becker wrote:
> There isn't any specific documentation about making a new template
> (alas!).  There isn't even something as simple as a list of variables
> which will be expanded in the HTML template files. :-/
> 
> I suggest that you make a copy of the GANGLIA_WWW/template/default
> directory, and start making your changes from there.  The variables
> are pretty obvious.
> 
> Also, note that the templating engine has *changed* in the trunk
> release.  We are not using TemplatePower anymore, and have moved to
> using the Dwoo package instead.  I believe that the forthcoming 3.2.0
> release will use this.  Dwoo has a similar, but different template
> language, and I suggest that you make your changes against trunk, and
> not the 3.1.x series.
> 
> On Thu, Nov 18, 2010 at 17:07, Chris Hunter  wrote:
>> Hi,
>>
>> I have been maintaining an instance of ganglia 3.0.3 installed by my
>> predecessor. The last guy was a php programmer and did all sorts of
>> fancy things to our ganglia frontend.
>>
>> I am starting a fresh install of ganglia 3.1.7; I have the basics done.
>> I have our gmond-3.0.x clusters talking to the gmetad-3.1.7 host. I have
>> the web frontend running.
>>
>> Next I want to create a custom template. I'll start with simple stuff
>> like adding a custom logo bitmap to the metapage, maybe some URL links
>> to our department website, etc.
>>
>> Can anyone point me to some documentation about creating custom
>> templates ? What is 'best practice' to integrate a template with a
>> ganglia-3.1.x installation ?
>>
>> Thank-you in advance,
>>
>> Chris Hunter
>> Yale University
>>
>> --
>> Beautiful is writing same markup. Internet Explorer 9 supports
>> standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2 & L3.
>> Spend less time writing and  rewriting code and more time creating great
>> experiences on the web. Be a part of the beta today
>> http://p.sf.net/sfu/msIE9-sfdev2dev
>> ___
>> Ganglia-general mailing list
>> Ganglia-general@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/ganglia-general
>>
> 
> 
> 


--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Ganglia-general mailing list
Ganglia-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-general


Re: [Ganglia-general] newbie question - web frontend templates

2010-11-29 Thread Jesse Becker
On Mon, Nov 29, 2010 at 11:26, Bostjan Skufca  wrote:
> "We are not using TemplatePower anymore, and have moved to using the
> Dwoo package instead."
>
> I would be glad to know this before I started making customizations to
> frontend, just 3 weeks ago. I know, my fault, I did not ask about it
> :)

There was an announcement on the ganglia-developers list
(http://www.mail-archive.com/ganglia-develop...@lists.sourceforge.net/msg05653.html),
but only a passing reference on the -general list.

> Anyway, I seriously hope that Dwoo supports 'if' statement in
> templates. Working without it kinda sucks (TemplatePower).

It does include looping and conditional support.  Dwoo was picked (I
believe) because it supports all of the features supported by
TemplatePower and is released under a BSD license (unlike
TemplatePower)

> Any move towards an OO frontend? Because current code is a mess... (no
> disrespect intended, just personal observation).

There was some discussion about frontend development in IRC recently.
A transcript was kept, and posted here:
http://therealms.org/oss/ganglia/ganglia_frontend_rewrite_irc_101310.txt

-- 
Jesse Becker

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Ganglia-general mailing list
Ganglia-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-general


Re: [Ganglia-general] newbie question - web frontend templates

2010-11-29 Thread Bostjan Skufca
"We are not using TemplatePower anymore, and have moved to using the
Dwoo package instead."

I would be glad to know this before I started making customizations to
frontend, just 3 weeks ago. I know, my fault, I did not ask about it
:)
Anyway, I seriously hope that Dwoo supports 'if' statement in
templates. Working without it kinda sucks (TemplatePower).

Any move towards an OO frontend? Because current code is a mess... (no
disrespect intended, just personal observation).

b.



On 29 November 2010 15:30, Jesse Becker  wrote:
> There isn't any specific documentation about making a new template
> (alas!).  There isn't even something as simple as a list of variables
> which will be expanded in the HTML template files. :-/
>
> I suggest that you make a copy of the GANGLIA_WWW/template/default
> directory, and start making your changes from there.  The variables
> are pretty obvious.
>
> Also, note that the templating engine has *changed* in the trunk
> release.  We are not using TemplatePower anymore, and have moved to
> using the Dwoo package instead.  I believe that the forthcoming 3.2.0
> release will use this.  Dwoo has a similar, but different template
> language, and I suggest that you make your changes against trunk, and
> not the 3.1.x series.
>
> On Thu, Nov 18, 2010 at 17:07, Chris Hunter  wrote:
>> Hi,
>>
>> I have been maintaining an instance of ganglia 3.0.3 installed by my
>> predecessor. The last guy was a php programmer and did all sorts of
>> fancy things to our ganglia frontend.
>>
>> I am starting a fresh install of ganglia 3.1.7; I have the basics done.
>> I have our gmond-3.0.x clusters talking to the gmetad-3.1.7 host. I have
>> the web frontend running.
>>
>> Next I want to create a custom template. I'll start with simple stuff
>> like adding a custom logo bitmap to the metapage, maybe some URL links
>> to our department website, etc.
>>
>> Can anyone point me to some documentation about creating custom
>> templates ? What is 'best practice' to integrate a template with a
>> ganglia-3.1.x installation ?
>>
>> Thank-you in advance,
>>
>> Chris Hunter
>> Yale University
>>
>> --
>> Beautiful is writing same markup. Internet Explorer 9 supports
>> standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2 & L3.
>> Spend less time writing and  rewriting code and more time creating great
>> experiences on the web. Be a part of the beta today
>> http://p.sf.net/sfu/msIE9-sfdev2dev
>> ___
>> Ganglia-general mailing list
>> Ganglia-general@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/ganglia-general
>>
>
>
>
> --
> Jesse Becker
>
> --
> Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
> Tap into the largest installed PC base & get more eyes on your game by
> optimizing for Intel(R) Graphics Technology. Get started today with the
> Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
> http://p.sf.net/sfu/intelisp-dev2dev
> ___
> Ganglia-general mailing list
> Ganglia-general@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/ganglia-general
>

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Ganglia-general mailing list
Ganglia-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-general


Re: [Ganglia-general] newbie question - web frontend templates

2010-11-29 Thread Jesse Becker
There isn't any specific documentation about making a new template
(alas!).  There isn't even something as simple as a list of variables
which will be expanded in the HTML template files. :-/

I suggest that you make a copy of the GANGLIA_WWW/template/default
directory, and start making your changes from there.  The variables
are pretty obvious.

Also, note that the templating engine has *changed* in the trunk
release.  We are not using TemplatePower anymore, and have moved to
using the Dwoo package instead.  I believe that the forthcoming 3.2.0
release will use this.  Dwoo has a similar, but different template
language, and I suggest that you make your changes against trunk, and
not the 3.1.x series.

On Thu, Nov 18, 2010 at 17:07, Chris Hunter  wrote:
> Hi,
>
> I have been maintaining an instance of ganglia 3.0.3 installed by my
> predecessor. The last guy was a php programmer and did all sorts of
> fancy things to our ganglia frontend.
>
> I am starting a fresh install of ganglia 3.1.7; I have the basics done.
> I have our gmond-3.0.x clusters talking to the gmetad-3.1.7 host. I have
> the web frontend running.
>
> Next I want to create a custom template. I'll start with simple stuff
> like adding a custom logo bitmap to the metapage, maybe some URL links
> to our department website, etc.
>
> Can anyone point me to some documentation about creating custom
> templates ? What is 'best practice' to integrate a template with a
> ganglia-3.1.x installation ?
>
> Thank-you in advance,
>
> Chris Hunter
> Yale University
>
> --
> Beautiful is writing same markup. Internet Explorer 9 supports
> standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2 & L3.
> Spend less time writing and  rewriting code and more time creating great
> experiences on the web. Be a part of the beta today
> http://p.sf.net/sfu/msIE9-sfdev2dev
> ___
> Ganglia-general mailing list
> Ganglia-general@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/ganglia-general
>



-- 
Jesse Becker

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Ganglia-general mailing list
Ganglia-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-general


Re: [Ganglia-general] newbie question - web frontend templates

2010-11-18 Thread Auld, Russell G CSC
Anything here http://templatepower.codocad.com/ ?

There is a link to that at the bottom of the 3.1.7-generated front page:
"Pages generated using TemplatePower version 3.0.1." 

HTH

> -Original Message-
> From: Chris Hunter [mailto:chris.hun...@yale.edu] 
> Sent: Thursday, November 18, 2010 5:08 PM
> To: ganglia-general@lists.sourceforge.net
> Subject: [Ganglia-general] newbie question - web frontend templates
> 
> Hi,
> 
> I have been maintaining an instance of ganglia 3.0.3 installed by my 
> predecessor. The last guy was a php programmer and did all sorts of 
> fancy things to our ganglia frontend.
> 
> I am starting a fresh install of ganglia 3.1.7; I have the 
> basics done. 
> I have our gmond-3.0.x clusters talking to the gmetad-3.1.7 
> host. I have 
> the web frontend running.
> 
> Next I want to create a custom template. I'll start with simple stuff 
> like adding a custom logo bitmap to the metapage, maybe some 
> URL links 
> to our department website, etc.
> 
> Can anyone point me to some documentation about creating custom 
> templates ? What is 'best practice' to integrate a template with a 
> ganglia-3.1.x installation ?
> 
> Thank-you in advance,
> 
> Chris Hunter
> Yale University
> 
> --
> 
> Beautiful is writing same markup. Internet Explorer 9 supports
> standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2 & L3.
> Spend less time writing and  rewriting code and more time 
> creating great
> experiences on the web. Be a part of the beta today
> http://p.sf.net/sfu/msIE9-sfdev2dev
> ___
> Ganglia-general mailing list
> Ganglia-general@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/ganglia-general
> 

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2 & L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Ganglia-general mailing list
Ganglia-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-general


[Ganglia-general] newbie question - web frontend templates

2010-11-18 Thread Chris Hunter
Hi,

I have been maintaining an instance of ganglia 3.0.3 installed by my 
predecessor. The last guy was a php programmer and did all sorts of 
fancy things to our ganglia frontend.

I am starting a fresh install of ganglia 3.1.7; I have the basics done. 
I have our gmond-3.0.x clusters talking to the gmetad-3.1.7 host. I have 
the web frontend running.

Next I want to create a custom template. I'll start with simple stuff 
like adding a custom logo bitmap to the metapage, maybe some URL links 
to our department website, etc.

Can anyone point me to some documentation about creating custom 
templates ? What is 'best practice' to integrate a template with a 
ganglia-3.1.x installation ?

Thank-you in advance,

Chris Hunter
Yale University

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2 & L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Ganglia-general mailing list
Ganglia-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-general