Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-14 Thread Paul Jackson
Mel wrote: > I have not read up on cpuset before so I am assuming you are talking about > http://www.bullopensource.org/cpuset/ so correct me if I am wrong. Yes - that. See also the kernel doc file: Documentation/cpusets.txt > I agree that if cpuset is not > widely used, it should not

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-14 Thread Mel Gorman
On Thu, 10 Mar 2005, Dave Hansen wrote: > On Thu, 2005-03-10 at 09:22 -0800, Paul Jackson wrote: > > In particular, I am working on preparing a patch proposal for a policy > > that would kill a task rather than invoke the swapper. In > > mm/page_alloc.c __alloc_pages(), if one gets down to the

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-14 Thread Mel Gorman
On Thu, 10 Mar 2005, Dave Hansen wrote: On Thu, 2005-03-10 at 09:22 -0800, Paul Jackson wrote: In particular, I am working on preparing a patch proposal for a policy that would kill a task rather than invoke the swapper. In mm/page_alloc.c __alloc_pages(), if one gets down to the point of

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-14 Thread Paul Jackson
Mel wrote: I have not read up on cpuset before so I am assuming you are talking about http://www.bullopensource.org/cpuset/ so correct me if I am wrong. Yes - that. See also the kernel doc file: Documentation/cpusets.txt I agree that if cpuset is not widely used, it should not be

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Paul Jackson
Dave wrote: > Shouldn't a particular task know what the policy should be when it is > launched? No ... but not necessarily because it isn't known yet, but rather also because it might be imposed earlier in the job creation, before the actual task hierarchy is manifest. This point goes to the

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Dave Hansen
On Thu, 2005-03-10 at 12:11 -0800, Paul Jackson wrote: > Dave wrote: > > Perhaps default policies inherited from a cpuset, but overridden by > > other APIs would be a good compromise. > > Perhaps. The madvise() and numa calls (mbind, set_mempolicy) only > affect the current task, as is usually

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Paul Jackson
Dave wrote: > Perhaps default policies inherited from a cpuset, but overridden by > other APIs would be a good compromise. Perhaps. The madvise() and numa calls (mbind, set_mempolicy) only affect the current task, as is usually appropriate for calls that allow specification of specific address

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Dave Hansen
On Thu, 2005-03-10 at 09:22 -0800, Paul Jackson wrote: > In particular, I am working on preparing a patch proposal for a policy > that would kill a task rather than invoke the swapper. In > mm/page_alloc.c __alloc_pages(), if one gets down to the point of being > about to kick the swapper, if

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Paul Jackson
Mel Gorman, responding to Dave Hansen > > The other thing is that we'll probably have to be a lot more strict > > about how the allocations fall back. Some users will probably prefer to > > kill an application rather than let a kernel allocation fall back into a > > user memory area. > > > >

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Dave Hansen
On Thu, 2005-03-10 at 14:31 +, Mel Gorman wrote: > > > There are 2 kinds of sections: user and kernel. The traditional > > > ZONE_HIGHMEM is full of user sections (except for vmalloc). > > And PTEs if configured to be allocated from high memory. I have not double > checked but I don't think

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Mel Gorman
On Mon, 7 Mar 2005, Dave Hansen wrote: > On Mon, 2005-03-07 at 19:39 +, Mel Gorman wrote: > > The placement policy patch should now be more Hotplug-friendly and I > > would like to hear from the Hotplug people if they have more > > requirements of this patch. > > It looks like most of what we

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Mel Gorman
On Mon, 7 Mar 2005, Dave Hansen wrote: On Mon, 2005-03-07 at 19:39 +, Mel Gorman wrote: The placement policy patch should now be more Hotplug-friendly and I would like to hear from the Hotplug people if they have more requirements of this patch. It looks like most of what we need is

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Dave Hansen
On Thu, 2005-03-10 at 14:31 +, Mel Gorman wrote: There are 2 kinds of sections: user and kernel. The traditional ZONE_HIGHMEM is full of user sections (except for vmalloc). And PTEs if configured to be allocated from high memory. I have not double checked but I don't think they can

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Paul Jackson
Mel Gorman, responding to Dave Hansen The other thing is that we'll probably have to be a lot more strict about how the allocations fall back. Some users will probably prefer to kill an application rather than let a kernel allocation fall back into a user memory area. That will be a

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Dave Hansen
On Thu, 2005-03-10 at 09:22 -0800, Paul Jackson wrote: In particular, I am working on preparing a patch proposal for a policy that would kill a task rather than invoke the swapper. In mm/page_alloc.c __alloc_pages(), if one gets down to the point of being about to kick the swapper, if this

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Paul Jackson
Dave wrote: Perhaps default policies inherited from a cpuset, but overridden by other APIs would be a good compromise. Perhaps. The madvise() and numa calls (mbind, set_mempolicy) only affect the current task, as is usually appropriate for calls that allow specification of specific address

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Dave Hansen
On Thu, 2005-03-10 at 12:11 -0800, Paul Jackson wrote: Dave wrote: Perhaps default policies inherited from a cpuset, but overridden by other APIs would be a good compromise. Perhaps. The madvise() and numa calls (mbind, set_mempolicy) only affect the current task, as is usually

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-10 Thread Paul Jackson
Dave wrote: Shouldn't a particular task know what the policy should be when it is launched? No ... but not necessarily because it isn't known yet, but rather also because it might be imposed earlier in the job creation, before the actual task hierarchy is manifest. This point goes to the

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-07 Thread Dave Hansen
On Mon, 2005-03-07 at 19:39 +, Mel Gorman wrote: > The placement policy patch should now be more Hotplug-friendly and I > would like to hear from the Hotplug people if they have more > requirements of this patch. It looks like most of what we need is there already. There are two things that

[PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-07 Thread Mel Gorman
Hi, The following two emails contain the latest version of the placement policy for the binary buddy allocator to reduce fragmentation and the prezeroing patch. The changelogs are with the patches. The placement policy patch should now be more Hotplug-friendly and I would like to hear from the

[PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-07 Thread Mel Gorman
Hi, The following two emails contain the latest version of the placement policy for the binary buddy allocator to reduce fragmentation and the prezeroing patch. The changelogs are with the patches. The placement policy patch should now be more Hotplug-friendly and I would like to hear from the

Re: [PATCH] 0/2 Buddy allocator with placement policy (Version 9) + prezeroing (Version 4)

2005-03-07 Thread Dave Hansen
On Mon, 2005-03-07 at 19:39 +, Mel Gorman wrote: The placement policy patch should now be more Hotplug-friendly and I would like to hear from the Hotplug people if they have more requirements of this patch. It looks like most of what we need is there already. There are two things that