Apache ignite statefulsets pods abruptly restarts

2020-09-21 Thread Sanjaya
Hi All, In out production environment, ignite v2.8.1 is install as a kubernetes stateful sets pods inside Azure Kubernetes cluster. There are 2 pods running. Ignite is persistence enabled, with on heap cache only. The pod is running with below guaranteed resources Memory : 11 GB CPU: 3 core

Re: Apache ignite statefulsets pods abruptly restarts

2020-09-21 Thread Evgenii Zhuravlev
There is no such thing as "on heap cache only.". It's possible to enable an additional cache level in heap, but it still will be storing all data in the off heap. So, right now you need at least 10.25+8gb+ Checkpoint buffer size for your Ignite node. Evgenii пн, 21 сент. 2020 г. в 09:29, Sanjaya

Re: Apache ignite statefulsets pods abruptly restarts

2020-09-21 Thread Sanjaya Kumar Sahoo
Hi, Thanks for your reply, we have set on heap as below in ignite configuration xml, https://apacheignite.readme.io/docs/memory-configuration#section-on-heap-caching Basically we have set as true in xml configuration as . The idea to move on heap with persistence enable is to maximize the late

Re: Apache ignite statefulsets pods abruptly restarts

2020-09-22 Thread Stephen Darlington
The on-heap cache is in addition to the off-heap cache. 8Gb (off-heap) + 8Gb (on-heap cache) + ~4Gb (heap space for running Ignite) = ~ 20Gb Way more than the 11Gb you have allocated. Three steps: Turn off the on-heap cache Decrease the data region to maybe 6Gb (in Ignite configuration) Allocate