Not to throw a spanner into the works, but we have a similar problem in my work environment of needing a scheduler to schedule distributed jobs, one problem of writing a *nice* one for a given language is that you end up being pigeon holed into one solution. We've been looking at using drmaa as a way of accessing different schedulers in a more platform and language agnostic way. It may be worth your while to take a look at the golang bindings for drmaa so you aren't left reinventing the wheel. Maybe creating a dumb scheduler for drmaa library might be the way to go?
On Wednesday, 11 October 2017 20:14:46 UTC+1, Alex Buchanan wrote: > > Hey all, > > In Funnel (a distributed task toolkit) we're sort of dancing around having > a full-on scheduler. We have a scheduler that has grown from development > util, to prototype, to something we actually use, but it's missing many of > the features you'd want in production. Mostly we aim to delegate scheduling > to another application (SGE, Slurm, AWS Batch, Kubernetes, etc), but having > a built-in ability to schedule tasks without extra infrastructure is > undeniably attractive. > > Writing a scheduler is one of those things people warn you away from > though. I wish there was a solid library we could embed, but I haven't > found anything. > > I wanted to get some opinions from this community. Do you know of any > scheduling libraries? Do you think having scheduling built in is a good > idea? A bad idea? Should we keep chipping away at it? Would people be > interested in a standalone scheduling library, or is this problem > inherently too complex to be adequately captured in library form? > > Thanks! > > Funnel: https://github.com/ohsu-comp-bio/funnel > -- You received this message because you are subscribed to the Google Groups "golang-nuts" group. To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
