Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine? (RDlab)

2015-04-08 Thread Varela Agrelo, Jordi
Apr 8, 2015 at 2:00 PM, wrote: > Date: Wed, 8 Apr 2015 12:06:58 +0200 > From: RDlab > To: users@gridengine.org > Subject: Re: [gridengine users] Anyone using S-GAE reporting app with > Univa grid engine? > Message-ID: > Content-Type: text/plain; charset=us-asci

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-04-08 Thread Chris Dagdigian
Fantastic timing! Thank you very much. I'm going to install and try it out right now. Regards, Chris RDlab April 8, 2015 at 6:06 AM Hello, My name is Gabriel and I am the IT manager at RDlab, we are the S-GAE guys :) A new version of S-GAE compliant and tested

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-04-08 Thread RDlab
Hello, My name is Gabriel and I am the IT manager at RDlab, we are the S-GAE guys :) A new version of S-GAE compliant and tested for UNIVA logs has been released today v1.1.8. You can download it for free at its homepage: http://rdlab.cs.upc.edu/s-gae Please, do not hesitate to contact us! Be

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-03-03 Thread Jesse Becker
Thanks, some comments/questions inline. On Tue, Mar 03, 2015 at 07:16:16AM -0500, Chris Dagdigian wrote: - It's a good basic reporting tool for monthly metrics. Is that the smallest resolution it supports? XDMoD can drill down to daily, which we find very useful. - Job count shown as a perce

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-03-03 Thread Jesse Becker
On Tue, Mar 03, 2015 at 11:45:25AM +, Tina Friedrich wrote: I've been meaning to move to XDMoD for a while now (from UBMoD). Any pitfalls to watch out for? Does it still (like UBMoD) index on Job ID for SGE (I patched it internally to add a date stamp to that, as my job IDs ran over the old

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-03-03 Thread Chris Dagdigian
I'll give some impressions of S-GAE since I have it installed in a lot of places ... - It's a good basic reporting tool for monthly metrics. - I don't use all of the features; mainly the full cluster "view" - In the full cluster view there are 4-6 PNG graphics that I just generate and copy/em

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-03-03 Thread Tina Friedrich
I've been meaning to move to XDMoD for a while now (from UBMoD). Any pitfalls to watch out for? Does it still (like UBMoD) index on Job ID for SGE (I patched it internally to add a date stamp to that, as my job IDs ran over the old 9,999,999 twice in my accounting records...) I second the 'kee

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-03-02 Thread Jesse Becker
On Mon, Mar 02, 2015 at 04:21:57PM -0500, Jesse Becker wrote: One thing that we *have* learned is that you should keep all of the raw records. They compress well, and disk space is cheap. Our UGE logs compress about 85% using gzip -9, and is fast. Other methods (xz) get almost 90%, but take ab

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-03-02 Thread Jesse Becker
I spent a bit of time looking at things to replace ARCO--which I found more trouble than it's worth. You *could* get it to work, but it was alsways more trouble that it was worth to do so, especially since it's simple to parse the accounting and reporting files. I looked at a few different open

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-03-02 Thread Jesse Becker
One other change for UGE 8.2.x: The jobids no longer wrap at 9,999,999. I think the new value is 2^32-1. More info here: http://gridengine.eu/index.php/grid-engine-internals/213-univa-grid-engine-82-released-2014-09-16 On Mon, Mar 02, 2015 at 11:32:55AM -0500, Jesse Becker wrote: I looked

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-03-02 Thread Chris Dagdigian
ooh the various MoD ("metrics on demand") look pretty interesting. Would love to chat about how people have made XDMoD and other variants work with Grid Engine(s) -- can we get a little thread going on best practices and recommendations for 3rd party reporting/metrics tools? Suspect there

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-03-02 Thread Tina Friedrich
Yes, there's an additional field - job_class. I'm not using S-GAE, so got nothing for you I'm afraid; I had a similar problem with UBMoD (which I'm still running), where I had to make (probably similar) changes to make it work (keep it working, rather). Tina On 02/03/15 16:09, Chris Dagdigia

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-03-02 Thread Jesse Becker
I looked at S-GAE and a few other tools. I settled on using XDMoD. It was easier for me to get running. The Univa logs are indeed different, and I had similar problems ingesting them into XDMoD. For UGE version <8.2.0, I believe there are two or three 3 additional fields at the end of the acco

[gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

2015-03-02 Thread Chris Dagdigian
Hey folks, I'm a big fan of the php based S-GAE grid engine reporting tool that the fine folks over at http://rdlab.cs.upc.edu/index.php/en/services/s-gae.html have put together However it looks like S-GAE is falling over on a cluster where we recently converted from open source grid engine