Am 26.04.2013 um 10:37 schrieb Jake Carroll: > Hi Grid-Engine gurus of the grid engine list. > > I have a question about the fair-share policy and the subsequent > algorithm/ratios it uses to manage user workload. > > Currently, we've set our grid engine up for fair-share in a very traditional > way: > > enforce_user auto > auto_user_fshare 100 > > And. > > weight_tickets_functional 10000 > > Now, to the best of my understanding, this is one of the "clean" ways to use > the fair-share scheduler policy to weight utilisation appropriately so that > the more a user uses CPU slots, the less run time priority they are given > compared to users who use very little/have not used much for quite a period > of time. > > Anyway. What I would really like to know is, if it's possible to weight and > "fair-share" based on something other than slots utilisation. Can a user > weight on memory utilisation for example? What I'd really like to be able to > do is prioritise and weight users down who slam the HPC environment with big > high memory jobs, such that they are de-prioritised once their jobs have run, > so it gives other users a fair swing at the lovely DIMM modules too. > > I've never seen it done/don't know if it's possible. Just a thought. I guess > what I'd really like to see is a way to "punish" or "smack" users who request > huge gobs of RAM continually such that I can then deprioritise them so that > users who've been nice and play by the rules get a fair run, immediately > after. > > It might be one of those fun/classic NP-hard insolvable problems or > NP-complete evil things that seem to come up whenever we talk about this kind > of thing on this list. If so, that's cool/fine. I'll just need to buy a pile > of more CPU cores and a lot higher density RAM modules ;).
One option could be to use a negative urgency for the h_vmem complex entry, although this won't be a fair share of the memory in the end. What about defining all users by hand, and give them a functional share entry by a cron job reciprocal to the requested/consumed memory of the running jobs? -- Reuti > Thanks as always, all. > > --JC > > _______________________________________________ > users mailing list > [email protected] > https://gridengine.org/mailman/listinfo/users _______________________________________________ users mailing list [email protected] https://gridengine.org/mailman/listinfo/users
