Greetings,
I'm pondering writing a python based dbwriter replacement which would
just parse the accounting file and stuff it in a db, and then have some
python web app framework for reporting.
Has anyone already done this?
Any suggestions on how to "eat" the accounting log file?
(consume it
I've written perl scripts to scrape the accounting log and throw the
entries into a mysql database - mainly so we could write our own simple
queries and text based reporting tools. Never wrote the web app though
at one time when I was entranced with ruby-on-rails I thought it would
be a cool
may be you want to check this link
https://twiki.grid.iu.edu/bin/view/Accounting/
On 5/5/2011 4:46 PM, William Deegan wrote:
Greetings,
I'm pondering writing a python based dbwriter replacement which would
just parse the accounting file and stuff it in a db, and then have
some python web app
Am 05.05.11 22:55, schrieb Chris Dagdigian:
I've written perl scripts to scrape the accounting log and throw the
entries into a mysql database - mainly so we could write our own simple
queries and text based reporting tools. Never wrote the web app though
at on
Chris Dagdigian writes:
> - the value for dbrwriter is what it does with the reporting file, the
> accounting file AND the new values it derives from those data sets.
> There is a lot to be learned from dbrwriter.
>
> My secret plan was always to keep dbrwriter, the schema and the code
> that
"Hung-ShengTsao (Lao Tsao) Ph.D." writes:
> may be you want to check this link
> https://twiki.grid.iu.edu/bin/view/Accounting/
Do you have experience of it? I vaguely remember looking at it and
being put off, possibly because it was implemented around EGEE or
similar; maybe that was a mistake.
On 5/6/2011 9:43 AM, Dave Love wrote:
"Hung-ShengTsao (Lao Tsao) Ph.D." writes:
may be you want to check this link
https://twiki.grid.iu.edu/bin/view/Accounting/
Do you have experience of it? I vaguely remember looking at it and
being put off, possibly because it was implemented around EGE
On Thu, 5 May 2011 at 16:46 -, William Deegan wrote:
> I'm pondering writing a python based dbwriter replacement which
> would just parse the accounting file and stuff it in a db, and then
> have some python web app framework for reporting.
>
> Has anyone already done this?
>
> Any suggestions
Am 06.05.2011 um 19:17 schrieb Stuart Barkley:
> On Thu, 5 May 2011 at 16:46 -, William Deegan wrote:
>
>> I'm pondering writing a python based dbwriter replacement which
>> would just parse the accounting file and stuff it in a db, and then
>> have some python web app framework for reporting
Stuart Barkley writes:
> Yes, just roll the log file (see responses to your question on that).
[Of course, qacct will only work for the entries left in `accounting'
itself.]
> When you get to proper accounting, these details are very important.
> Being sure these edges don't duplicate or miss j
On Sun, 8 May 2011 at 09:58 -, Dave Love wrote:
> > When you get to proper accounting, these details are very
> > important. Being sure these edges don't duplicate or miss jobs and
> > doing the desired processing for jobs splitting reporting
> > boundaries is another
>
> Why don't the interme
Stuart Barkley writes:
>> Why don't the intermediate accounting records cover that?
>
> Didn't know about them. Are they in the accounting file or just the
> reporting file?
Sorry, just the latter. I don't remember what was in the original, but
it's in http://arc/SGE/htmlman/htmlman5/reporting
On Sun, 8 May 2011 at 18:03 -, Dave Love wrote:
> >> Is it worth worrying about any real accuracy in accounting?
> >> Tyring to keep track of everything relevant, like system problems
> >> that clobber jobs, just doesn't seem worthwhile to me.
>
> > This is a very important basic question and
Stuart Barkley writes:
> Not intentionally. We have had users ssh into random compute nodes
> and run things (not maliciously). Getting the appropriate pam modules
> in place is also on our long TODO list.
You can also turn off ssh and only allow qrsh.
> I've read of MPI jobs escaping out of
Am 08.05.2011 um 21:20 schrieb Stuart Barkley:
> On Sun, 8 May 2011 at 09:58 -, Dave Love wrote:
>
>>> When you get to proper accounting, these details are very
>>> important. Being sure these edges don't duplicate or miss jobs and
>>> doing the desired processing for jobs splitting reporting
15 matches
Mail list logo
