Hi, In your case, striped pool starvation messages are showing that some Ignite related tasks are taking longer then a preconfigured threshold. (See https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/configuration/IgniteConfiguration.html#getFailureDetectionTimeout--) As long as the system works through all the tasks w/out any errors, no data is being corrupted. Looking at the Thread stacks below I see that most of the slow tasks are related to I/O and memory allocation. Per the metrics, you are running at the bounds of your configured default data region. I would increase the amount of memory given to this data region. Follow these guides to optimize I/O and durable memory: https://apacheignite.readme.io/docs/performance-tips https://apacheignite.readme.io/v2.7.0/docs/durable-memory-tuning If you are using putAll in your code: https://apacheignite.readme.io/docs/jcache#basic-operations If batch operations (such as IgniteCache#putAll, IgniteCache#invokeAll, etc.) are performed in parallel, then keys should be ordered in the same way to avoid deadlock. Use TreeMap instead of HashMap to guarantee consistent ordering. Thanks, Alex
---------------------------------------------------------------------------------- Look at the free indicators for default memory region. ^-- Off-heap [used=20084MB, free=3.35%, comm=20680MB] ^-- sysMemPlc region [used=0MB, free=99.98%, comm=100MB] ^-- default region [used=20084MB, free=1.93%, comm=20480MB] I/O operation Thread [name="sys-stripe-2-#3", id=28, state=WAITING, blockCnt=120, waitCnt=5301307] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:177) at o.a.i.i.util.future.GridFutureAdapter.getUninterruptibly(GridFutureAdapter.java:145) at o.a.i.i.processors.cache.persistence.file.AsyncFileIO.read(AsyncFileIO.java:128) at o.a.i.i.processors.cache.persistence.file.AbstractFileIO$2.run(AbstractFileIO.java:89) at o.a.i.i.processors.cache.persistence.file.AbstractFileIO.fully(AbstractFileIO.java:52) at o.a.i.i.processors.cache.persistence.file.AbstractFileIO.readFully(AbstractFileIO.java:87) at o.a.i.i.processors.cache.persistence.file.FilePageStore.readWithFailover(FilePageStore.java:791) off-heap memory related operation. Thread [name="sys-stripe-1-#2", id=27, state=RUNNABLE, blockCnt=70, waitCnt=6227939] at o.a.i.i.processors.cache.persistence.pagemem.PageMemoryImpl.acquirePage(PageMemoryImpl.java:735) at o.a.i.i.processors.cache.persistence.pagemem.PageMemoryImpl.acquirePage(PageMemoryImpl.java:698) at o.a.i.i.processors.cache.persistence.pagemem.PageMemoryImpl.acquirePage(PageMemoryImpl.java:687) at o.a.i.i.processors.cache.persistence.DataStructure.acquirePage(DataStructure.java:156) at o.a.i.i.processors.cache.persistence.freelist.PagesList.put(PagesList.java:686) at -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/