Re: CFS scheduler unfairly prefers pinned tasks

2015-10-11 Thread paul . szabo
I wrote: The Linux CFS scheduler prefers pinned tasks and unfairly gives more CPU time to tasks that have set CPU affinity. ... I believe I have now solved the problem, simply by setting: for n in /proc/sys/kernel/sched_domain/cpu*/domain0/min_interval; do echo 0 > $n; done for n

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-11 Thread paul . szabo
I wrote: The Linux CFS scheduler prefers pinned tasks and unfairly gives more CPU time to tasks that have set CPU affinity. I believe I have now solved the problem, simply by setting: for n in /proc/sys/kernel/sched_domain/cpu*/domain0/min_interval; do echo 0 > $n; done for n in /proc/s

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-10 Thread Wanpeng Li
On 10/10/15 11:59 AM, Wanpeng Li wrote: Hi Paul, On 10/8/15 4:19 PM, Mike Galbraith wrote: On Tue, 2015-10-06 at 04:45 +0200, Mike Galbraith wrote: On Tue, 2015-10-06 at 08:48 +1100, paul.sz...@sydney.edu.au wrote: The Linux CFS scheduler prefers pinned tasks and unfairly gives more CPU time t

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-09 Thread Wanpeng Li
Hi Paul, On 10/8/15 4:19 PM, Mike Galbraith wrote: On Tue, 2015-10-06 at 04:45 +0200, Mike Galbraith wrote: On Tue, 2015-10-06 at 08:48 +1100, paul.sz...@sydney.edu.au wrote: The Linux CFS scheduler prefers pinned tasks and unfairly gives more CPU time to tasks that have set CPU affinity. This

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-08 Thread Mike Galbraith
On Fri, 2015-10-09 at 08:55 +1100, paul.sz...@sydney.edu.au wrote: > >> Good to see that you agree ... > > Weeell, we've disagreed on pretty much everything ... > > Sorry I disagree: we do agree on the essence. :-) P.S. To some extent. If the essence is $subject, nope, we definitely disagree.

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-08 Thread Mike Galbraith
On Fri, 2015-10-09 at 08:55 +1100, paul.sz...@sydney.edu.au wrote: > Dear Mike, > > >>> I see a fairness issue ... but one opposite to your complaint. > >> Why is that opposite? ... > > > > Well, not exactly opposite, only opposite in that the one pert task also > > receives MORE than it's fair sh

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-08 Thread paul . szabo
Dear Mike, >>> I see a fairness issue ... but one opposite to your complaint. >> Why is that opposite? ... > > Well, not exactly opposite, only opposite in that the one pert task also > receives MORE than it's fair share when unpinned. Two 100$ hogs sharing > one CPU should each get 50% of that C

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-08 Thread Mike Galbraith
On Thu, 2015-10-08 at 21:54 +1100, paul.sz...@sydney.edu.au wrote: > Dear Mike, > > > I see a fairness issue ... but one opposite to your complaint. > > Why is that opposite? I think it would be fair for the one pert process > to get 100% CPU, the many oink processes can get everything else. That

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-08 Thread Peter Zijlstra
On Thu, Oct 08, 2015 at 09:54:21PM +1100, paul.sz...@sydney.edu.au wrote: > Good to see that you agree on the fairness issue... it MUST be fixed! > CFS might be wrong or wasteful, but never unfair. I've not yet had time to look at the case at hand, but there are wat is called 'infeasible weight' s

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-08 Thread paul . szabo
Dear Mike, > I see a fairness issue ... but one opposite to your complaint. Why is that opposite? I think it would be fair for the one pert process to get 100% CPU, the many oink processes can get everything else. That one oink is lowly 10% (when others are 100%) is of no consequence. What happe

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-08 Thread Mike Galbraith
On Tue, 2015-10-06 at 04:45 +0200, Mike Galbraith wrote: > On Tue, 2015-10-06 at 08:48 +1100, paul.sz...@sydney.edu.au wrote: > > The Linux CFS scheduler prefers pinned tasks and unfairly > > gives more CPU time to tasks that have set CPU affinity. > > This effect is observed with or without CGROUP

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-06 Thread Mike Galbraith
On Wed, 2015-10-07 at 07:44 +1100, paul.sz...@sydney.edu.au wrote: > I agree that pinning may be bad... should not the kernel penalize the > badly pinned processes? I didn't say pinning is bad, I said was what you're seeing is not a bug. -Mike -- To unsubscribe from this list: send the

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-06 Thread paul . szabo
Dear Mike, >> ... the CFS is meant to be fair, using things like vruntime >> to preempt, and throttling. Why are those pinned tasks not preempted or >> throttled? > > Imagine you own a 8192 CPU box for a moment, all CPUs having one pinned > task, plus one extra unpinned task, and ponder what would

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-06 Thread Mike Galbraith
On Tue, 2015-10-06 at 21:06 +1100, paul.sz...@sydney.edu.au wrote: > And further... the CFS is meant to be fair, using things like vruntime > to preempt, and throttling. Why are those pinned tasks not preempted or > throttled? Imagine you own a 8192 CPU box for a moment, all CPUs having one pinne

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-06 Thread paul . szabo
Dear Mike, >> .. CFS ... unfairly gives more CPU time to [pinned] tasks ... > > If they can all migrate, load balancing can move any of them to try to > fix the permanent imbalance, so they'll all bounce about sharing a CPU > with some other hog, and it all kinda sorta works out. > > When most are

Re: CFS scheduler unfairly prefers pinned tasks

2015-10-05 Thread Mike Galbraith
On Tue, 2015-10-06 at 08:48 +1100, paul.sz...@sydney.edu.au wrote: > The Linux CFS scheduler prefers pinned tasks and unfairly > gives more CPU time to tasks that have set CPU affinity. > This effect is observed with or without CGROUP controls. > > To demonstrate: on an otherwise idle machine, as