| > Probably apples and oranges, but Jim Kent wrote a job scheduler for his | > kilocluster that nicely handled about 1M jobs in six hours. It's the | > standard thing for whole genome sequence alignments at ucsc. | | I think that's neat, I would like to learn more. Was this scheduler for | an arbitrary job mix, or specialized to that app? Well, it was designed to do what we needed and no more, but it's still pretty general. The input is a file of commands, and it runs them all until they are all done (with a way to retry the ones that failed.)
http://www.cse.ucsc.edu/~kent/ http://www.soe.ucsc.edu/~donnak/eng/parasol.htm
