May be you hit memory shortage in a particular NUMA node only, for example.
# numactl --hardware
# numastat -m
Or go hard way - trace kernel where exactly do we get -ENOMEM:
trace the kernel function cgroup_mkdir() using /sys/kernel/debug/tracing/
with function_graph tracer.
https://lwn.net/
Hi Joe,
i'd suggest to check memory limits for root and "machine.slice" memory cgroups
/sys/fs/cgroup/memory/*limit_in_bytes
/sys/fs/cgroup/memory/machine.slice/*limit_in_bytes
All of them should be unlimited.
If not - search who limit them.
--
Best regards,
Konstantin Khorenko,
Virtuozzo Li
I checked that, doesn't appear to be the case.
*# pwd*
*/sys/fs/cgroup/memory*
*# cat *limit_in_bytes*
*9223372036854771712*
*9223372036854767616*
*2251799813685247*
*2251799813685247*
*9223372036854771712*
*9223372036854771712*
*9223372036854771712*
*# cat *failcnt*
*0*
*0*
*0*
*0*
*0*
# pwd
/sy