Re: Possible memory leak in Ignite 2.9

2020-11-13 Thread Ilya Kasnacheev
Hello! I think this is expected. Ignite needs to convert an entry (800G array) into packets to send to other nodes or put to persistence, where it will allocate another array (800G more). I don't think you can do anything here, short of chunking your data. Regards, -- Ilya Kasnacheev пт, 13 н

Re: Possible memory leak in Ignite 2.9

2020-11-03 Thread Ilya Kasnacheev
Hello! 800MB entry is far above of the entry size that we ever expected to see. Even brief holding of these entries on heap will cause problems for you, as well as sending them over communication. I recommend splitting entries into chunks, maybe. That's what IGFS did basically, we decided to ax i

Possible memory leak in Ignite 2.9

2020-11-03 Thread Kalin Katev
Hi, not too long ago I tested apache ignite for my use case on Open JDK 11. The use case consists of writing cache entries with values going up to 800MB in size, the data itself being a simple string. After writing 5 caches entries, 800 MB each, I noticed my Heap space exploding up to 11GB, while