On Sun, Jan 13, 2008 at 08:40:59AM -0800, Marcelo Schmidt wrote: > The memory limit is the full amount e.g. ulimit -d unlimited, but the datasize > (MAXDSIZ) is 1G. I also tried to recomle the 3.8 stable kernel with MAXDSIZ > > 1G. ulimit -d shows the new max but the processes run out of memory even > before 1G. Has anyone seen this problem before? I cannot set ulimit -d > > 1G at least on 3.5 and 3.8. Please let me know if this is a bug or a > some _future_ feature.
This is a known limitation. It is partly due to W^X, partly due to our memory model deep inside the kernel. Recompiling with a bigger MAXDSIZ is not enough. And yes, this does bother me as well... but I do not know our kernel well enough to fix it.
