Hi all, sorry for the late reply.
Yes, I came across Biouno while looking for Jenkins - GE integration and found that this could be an interesting effort for me. As such, I'd be really interested in the progress of the discussion. So I'd be happy if you could send me an invite. Kind regards, Thomas Am 09.02.2015 um 15:26 schrieb Hetherington, James: > Hi Thomas, all, > > We’re trying to form a community of people interested in using CI tools > like Jenkins and Buildbot for research, called CI4RI, Continuous > Integration for Research Infrastructure. > > We’re particularly interested in using HPC systems to provide compute to > CI tools, and testing CI at higher core counts. > > The BioUno team are involved in this forum, if you know their work, > http://biouno.org, they made a working backend for Jenkins with PBS, > https://github.com/biouno/pbs-plugin , > and I’m interested in porting this work to SGE. > > If you’d like me to add you to our discussion forum, let me know and I’ll > send you an invite. > > — > > Dr James Hetherington > > Team Leader, > Research Software Development, > Research IT Services > > And > > Honorary Lecturer, > Department of Computer Science > > University College London > > Twitter: @uclrcsoftdev, @jamespjh > Skype: ucgajhe > Phone: +44 7946868834 > Site: development.rc.ucl.ac.uk > > > > > > > On 09/02/2015 13:45, "William Hay" <[email protected]> wrote: > >> On Wed, 4 Feb 2015 12:53:01 +0000 >> "[email protected]" <[email protected]> wrote: >> >>> thanks a lot for the suggestions and the input. This gives me some >>> more ideas where to look further. >>> I'm not so much interested into defining work flows (although this is >>> an interesting aspect). Our workflows are rather static/pre-defined, >>> so there is little user interaction required here. I'd rather >>> interested in some linkage of cluster monitoring and jenkins. What I'm >>> looking for is: >>> >>> 1. have a view on the cluster status from within jenkins, i.e. replace >>> the slot approach in Jenkins with a view on the cluster status. >>> 2. see the GE job status in jenkins: which jobs are running (on which >>> machine)/queued etc.. >>> 3. submit jobs from Jenkins to the cluster (with the ability to define >>> resource requests, etc.) >>> 4 ... >>> >>> Regards, >>> Thomas >> My colleague James Hetherington(CC'd on this mail) has been looking into >> connecting continuous integration systems with batch schedulers and is >> trying to put other people with similar interests in contact. If you >> e-mail him he may be able to help or put you in touch with other people >> who can. >> >> >>> Quoting Reuti <[email protected]>: >>> >>>> Am 03.02.2015 um 13:41 schrieb Nick Holway <[email protected]>: >>>>> A colleague has done a far amount of work on this for image >>>>> processing. See https://www.youtube.com/watch?v=nW02VEEXxlk I'd be >>>>> happy to put you in touch with him if you (or anyone else who's >>>>> interested) contact me off list. >>>> Does Jenkins deliver any kind of workflow on top of a queuing >>>> system? It might be of broader interest, up to now I knew only of >>>> http://wildfire.bii.a-star.edu.sg/ which looks unmaintained. >>>> >>>> -- Reuti >>>> >>>> >>>>> Nick >>>>> >>>>> On 3 February 2015 at 12:26, Thomas Hottendorff >>>>> <[email protected]> wrote: >>>>> Hi all, >>>>> >>>>> we are using Jenkins CI to schedule and run our production jobs on >>> our >>>>> small cluster with ~240 slots. We are now looking into using our >>>>> present GE installation together with Jenkins to better utilize our >>>>> resources. >>>>> >>>>> So, is there any Jenkins plugin/extension to integrate Jenkins better >>>>> with GE? >>>>> Of course we can just run qsub/qrsh from Jenkins but this does not >>>>> give information on whether the job is queued or already running, on >>>>> what machine it is running etc. >>>>> >>>>> Any hint is greatly appreciated. >>>>> >>>>> Cheers, >>>>> >>>>> Thomas >>>>> _______________________________________________ >>>>> users mailing list >>>>> [email protected] >>>>> https://gridengine.org/mailman/listinfo/users >>>>> >>>>> _______________________________________________ >>>>> users mailing list >>>>> [email protected] >>>>> https://gridengine.org/mailman/listinfo/users >>>> >>>> _______________________________________________ >>>> users mailing list >>>> [email protected] >>>> https://gridengine.org/mailman/listinfo/users >>> >>> >>> _______________________________________________ >>> users mailing list >>> [email protected] >>> https://gridengine.org/mailman/listinfo/users >> >> -- >> William Hay <[email protected]> _______________________________________________ users mailing list [email protected] https://gridengine.org/mailman/listinfo/users
