There is a general API called DRMAA
http://en.wikipedia.org/wiki/DRMAA
We have an example local app that uses it to track state of grid engine
jobs:
https://github.com/StanfordBioinformatics/SJM
I found one result for "DRMAA Jenkins" in Google:
http://biouno.org/2014/07/08/java-drmaa-api-part-2/
It may be easier to use DRMAA than to parse output of qstat yourself.
On 2/4/15 4:53 AM, [email protected] wrote:
thanks a lot for the suggestions and the input. This gives me some more
ideas where to look further.
I'm not so much interested into defining work flows (although this is an
interesting aspect). Our workflows are rather static/pre-defined, so
there is little user interaction required here. I'd rather interested in
some linkage of cluster monitoring and jenkins. What I'm looking for is:
1. have a view on the cluster status from within jenkins, i.e. replace
the slot approach in Jenkins with a view on the cluster status.
2. see the GE job status in jenkins: which jobs are running (on which
machine)/queued etc..
3. submit jobs from Jenkins to the cluster (with the ability to define
resource requests, etc.)
4 ...
Regards,
Thomas
Quoting Reuti <[email protected]>:
Am 03.02.2015 um 13:41 schrieb Nick Holway <[email protected]>:
A colleague has done a far amount of work on this for image
processing. See https://www.youtube.com/watch?v=nW02VEEXxlk I'd be
happy to put you in touch with him if you (or anyone else who's
interested) contact me off list.
Does Jenkins deliver any kind of workflow on top of a queuing system?
It might be of broader interest, up to now I knew only of
http://wildfire.bii.a-star.edu.sg/ which looks unmaintained.
-- Reuti
Nick
On 3 February 2015 at 12:26, Thomas Hottendorff
<[email protected]> wrote:
Hi all,
we are using Jenkins CI to schedule and run our production jobs on our
small cluster with ~240 slots. We are now looking into using our
present GE installation together with Jenkins to better utilize our
resources.
So, is there any Jenkins plugin/extension to integrate Jenkins better
with GE?
Of course we can just run qsub/qrsh from Jenkins but this does not
give information on whether the job is queued or already running, on
what machine it is running etc.
Any hint is greatly appreciated.
_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users
