Memory limit?

2017-11-01 Thread Rick Payne
I’m stressing OSv a bit, and though I start the VM with 10G of memory, it seems to fail after just over 5GB. Is there a limit that I’m hitting, or perhaps my memory usage is fragmenting things too much? Out of memory: could not reclaim any further. Current memory: 5122256 Kb [backtrace] 0x0

Re: Memory limit?

2017-11-02 Thread Nadav Har'El
On Thu, Nov 2, 2017 at 6:38 AM, Rick Payne wrote: > > I’m stressing OSv a bit, and though I start the VM with 10G of memory, it > seems to fail after just over 5GB. Is there a limit that I’m hitting, or > perhaps my memory usage is fragmenting things too much? > > Out of memory: could not reclaim

Re: Memory limit?

2017-11-02 Thread Rick Payne
> This suggests there was 5GB free while the allocation failed. > This *can* be a fragmentation issue (e.g., you asked for a 1 GB allocation, > but we couldn't free a 1GB consecutive area), but can also be a malloc() of a > ridiculous amount. Since commit 7ea953ca7d6533c025e535be49ee5bd2567fc8f3

Re: Memory limit?

2017-11-06 Thread Rick Payne (Offshore)
> Out of memory: could not reclaim any further. Current memory: 5122256 Kb > > This suggests there was 5GB free while the allocation failed. > This *can* be a fragmentation issue (e.g., you asked for a 1 GB allocation, > but we couldn't free a 1GB consecutive area), but can also be a malloc() of

Re: Memory limit?

2017-11-07 Thread Nadav Har'El
On Mon, Nov 6, 2017 at 10:26 PM, Rick Payne (Offshore) wrote: > > Out of memory: could not reclaim any further. Current memory: 5122256 Kb > > > > This suggests there was 5GB free while the allocation failed. > > This *can* be a fragmentation issue (e.g., you asked for a 1 GB > allocation, but we

Re: Memory limit?

2017-11-07 Thread Rick Payne
Hi, > I am not sure how this will help, as the later malloc() can still fail when > it wants to allocate physically-contiguous memory. > > One hack you can try to fix > https://github.com/cloudius-systems/osv/issues/854 and hopefully your issue > is to change in core/mempool.cc, the function s

Re: Memory limit?

2017-11-07 Thread Nadav Har'El
On Tue, Nov 7, 2017 at 10:35 AM, Rick Payne wrote: > Hi, > > > I am not sure how this will help, as the later malloc() can still fail > when it wants to allocate physically-contiguous memory. > > > > One hack you can try to fix https://github.com/cloudius- > systems/osv/issues/854 and hopefully y

Re: Memory limit?

2017-11-07 Thread Gleb Natapov
On Tue, Nov 07, 2017 at 10:31:36AM +0200, Nadav Har'El wrote: > > > However, this didn't help initially as the memory wasn't being populated. > > I altered the mmap calls to include MAP_POPULATE to get them filled at > > startup, and now I get this crash. The debug output is from the erlang > > ru