Hi community,
Call IgniteCache.destroy Method, NPE appears,logs are as follows:
2020-12-0717:32:18.870[] [exchange-worker-#54%tradecore%]
INFOo.a.i.i.e.time- Started exchange init
[topVer=AffinityTopologyVersion [topVer=1, minorTopVer=279], crd=true,
evt=DISCOVERY_CUSTOM_EVT, evtNode=320935f6-3516-4b0b-9e5f-e80768696522,
customEvt=DynamicCacheChangeBatch
[id=1f2a90e2671-562b8f51-fa6a-4094-928c-6976ce87614a, reqs=ArrayList
[DynamicCacheChangeRequest [cacheName=PksQuota, hasCfg=false,
nodeId=320935f6-3516-4b0b-9e5f-e80768696522, clientStartOnly=false,
stop=true, destroy=false, disabledAfterStartfalse]],
exchangeActions=ExchangeActions [startCaches=null,
stopCaches=[PksQuota], startGrps=[], stopGrps=[PksQuota, destroy=true],
resetParts=null, stateChangeRequest=null], startCaches=false],
allowMerge=false, exchangeFreeSwitch=false]
2020-12-0717:32:18.873[] [exchange-worker-#54%tradecore%]
INFOo.a.i.i.p.c.d.d.p.GridDhtPartitionsExchangeFuture- Finished waiting
for partition release future [topVer=AffinityTopologyVersion [topVer=1,
minorTopVer=279], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED]
2020-12-0717:32:18.873[] [exchange-worker-#54%tradecore%]
INFOo.a.i.i.p.c.d.d.p.GridDhtPartitionsExchangeFuture- Finished waiting
for partitions release latch: ServerLatch [permits=0,
pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid
[id=exchange, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=279]]]]
2020-12-0717:32:18.873[] [exchange-worker-#54%tradecore%]
INFOo.a.i.i.p.c.d.d.p.GridDhtPartitionsExchangeFuture- Finished waiting
for partition release future [topVer=AffinityTopologyVersion [topVer=1,
minorTopVer=279], waitTime=0ms, futInfo=NA, mode=LOCAL]
2020-12-0717:32:19.037[] [exchange-worker-#54%tradecore%]
INFOo.a.i.i.p.c.d.d.p.GridDhtPartitionsExchangeFuture-
finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1,
minorTopVer=279], resVer=AffinityTopologyVersion [topVer=1,
minorTopVer=279]]
2020-12-0717:32:19.438[] [exchange-worker-#54%tradecore%]
INFOo.a.i.i.p.c.d.d.p.GridDhtPartitionsExchangeFuture- Finish exchange
future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=279],
resVer=AffinityTopologyVersion [topVer=1, minorTopVer=279], err=null,
rebalanced=true, wasRebalanced=true]
2020-12-0717:32:20.870[] [db-checkpoint-thread-#75%tradecore%]
INFOo.a.i.i.p.c.p.GridCacheDatabaseSharedManager- Checkpoint started
[checkpointId=f001018a-100e-4154-98c9-547dabf5015f,
startPtr=FileWALPointer [idx=16, fileOff=1059360696, len=4770137],
checkpointBeforeLockTime=549ms, checkpointLockWait=0ms,
checkpointListenersExecuteTime=529ms, checkpointLockHoldTime=853ms,
walCpRecordFsyncDuration=17ms, writeCheckpointEntryDuration=7ms,
splitAndSortCpPagesDuration=4ms, pages=10775, reason='caches stop']
2020-12-0717:32:21.255[] [checkpoint-runner-#79%tradecore%]
WARNo.a.i.i.p.c.p.GridCacheDatabaseSharedManager- 1checkpoint pages were
not written yet due to unsuccessful page write lock acquisition and will
be retried
2020-12-0717:32:21.261[] [exchange-worker-#54%tradecore%]
ERRORo.a.i.i.p.c.GridCacheProcessor- Failed to wait for checkpoint
finish during cache stop.
org.apache.ignite.IgniteCheckedException: Compound exception for
CountDownFuture.
at
org.apache.ignite.internal.util.future.CountDownFuture.addError(CountDownFuture.java:72)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
org.apache.ignite.internal.util.future.CountDownFuture.onDone(CountDownFuture.java:46)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
org.apache.ignite.internal.util.future.CountDownFuture.onDone(CountDownFuture.java:28)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$WriteCheckpointPages.run(GridCacheDatabaseSharedManager.java:4546)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_272]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_272]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_272]
Suppressed: java.lang.NullPointerException
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$WriteCheckpointPages.writePages(GridCacheDatabaseSharedManager.java:4584)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$WriteCheckpointPages.run(GridCacheDatabaseSharedManager.java:4540)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_272]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_272]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_272]
2020-12-0717:32:21.265[] [exchange-worker-#54%tradecore%]
INFOo.a.i.i.p.c.GridCacheProcessor- Stopped cache [cacheName=PksQuota]
2020-12-0717:32:21.268[] [db-checkpoint-thread-#75%tradecore%]
ERRORc.j.i.i.c.IgniteConfig- Critical system error detected. Will be
handled accordingly to configured handler
[hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0,
super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet
[SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]],
failureCtx=FailureContext [type=CRITICAL_ERROR, err=class
o.a.i.IgniteCheckedException: Compound exception for CountDownFuture.]]
org.apache.ignite.IgniteCheckedException: Compound exception for
CountDownFuture.
at
org.apache.ignite.internal.util.future.CountDownFuture.addError(CountDownFuture.java:72)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
org.apache.ignite.internal.util.future.CountDownFuture.onDone(CountDownFuture.java:46)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
org.apache.ignite.internal.util.future.CountDownFuture.onDone(CountDownFuture.java:28)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$WriteCheckpointPages.run(GridCacheDatabaseSharedManager.java:4546)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_272]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_272]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_272]
Suppressed: java.lang.NullPointerException
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$WriteCheckpointPages.writePages(GridCacheDatabaseSharedManager.java:4584)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$WriteCheckpointPages.run(GridCacheDatabaseSharedManager.java:4540)
~[ignite-core-2.9.0.jar!/:2.9.0]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_272]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_272]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_272]
2020-12-0717:32:21.558[] [db-checkpoint-thread-#75%tradecore%]
WARNo.a.i.i.p.c.CacheDiagnosticManager- Page locks dump:
Thread=[name=Ims-PublishThread-sync0, id=122], state=WAITING
Locked pages = []
Locked pages log: name=Ims-PublishThread-sync0 time=(1607333541277,
2020-12-0717:32:21.277)
Thread=[name=MessageBus-1, id=22], state=WAITING
Locked pages = []
Locked pages log: name=MessageBus-1time=(1607333541276,
2020-12-0717:32:21.276)
Thread=[name=MessageBus-2, id=23], state=WAITING
Locked pages = []
Locked pages log: name=MessageBus-2time=(1607333541276,
2020-12-0717:32:21.276)
Thread=[name=MessageBus-3, id=24], state=WAITING
Locked pages = []
Locked pages log: name=MessageBus-3time=(1607333541276,
2020-12-0717:32:21.276)
Thread=[name=MessageBus-4, id=25], state=WAITING
Locked pages = []
Locked pages log: name=MessageBus-4time=(1607333541276,
2020-12-0717:32:21.276)
Thread=[name=checkpoint-runner-#76%tradecore%, id=114], state=WAITING
Locked pages = []
Locked pages log: name=checkpoint-runner-#76%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=checkpoint-runner-#77%tradecore%, id=115], state=WAITING
Locked pages = []
Locked pages log: name=checkpoint-runner-#77%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=checkpoint-runner-#78%tradecore%, id=116], state=WAITING
Locked pages = []
Locked pages log: name=checkpoint-runner-#78%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=checkpoint-runner-#79%tradecore%, id=117], state=WAITING
Locked pages = []
Locked pages log: name=checkpoint-runner-#79%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=data-streamer-stripe-0-#9%tradecore%, id=34], state=WAITING
Locked pages = []
Locked pages log: name=data-streamer-stripe-0-#9%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=data-streamer-stripe-1-#10%tradecore%, id=35], state=WAITING
Locked pages = []
Locked pages log: name=data-streamer-stripe-1-#10%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=data-streamer-stripe-2-#11%tradecore%, id=36], state=WAITING
Locked pages = []
Locked pages log: name=data-streamer-stripe-2-#11%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=data-streamer-stripe-3-#12%tradecore%, id=37], state=WAITING
Locked pages = []
Locked pages log: name=data-streamer-stripe-3-#12%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=data-streamer-stripe-4-#13%tradecore%, id=38], state=WAITING
Locked pages = []
Locked pages log: name=data-streamer-stripe-4-#13%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=data-streamer-stripe-5-#14%tradecore%, id=39], state=WAITING
Locked pages = []
Locked pages log: name=data-streamer-stripe-5-#14%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=data-streamer-stripe-6-#15%tradecore%, id=40], state=WAITING
Locked pages = []
Locked pages log: name=data-streamer-stripe-6-#15%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=data-streamer-stripe-7-#16%tradecore%, id=41], state=WAITING
Locked pages = []
Locked pages log: name=data-streamer-stripe-7-#16%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=db-checkpoint-thread-#75%tradecore%, id=113], state=RUNNABLE
Locked pages = []
Locked pages log: name=db-checkpoint-thread-#75%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=dms-writer-thread-#58%tradecore%, id=95], state=WAITING
Locked pages = []
Locked pages log: name=dms-writer-thread-#58%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=exchange-worker-#54%tradecore%, id=91], state=WAITING
Locked pages = []
Locked pages log: name=exchange-worker-#54%tradecore%
time=(1607333541276, 2020-12-0717:32:21.276)
Thread=[name=jdbc-request-handler-worker-#29357%tradecore%, id=39238],
state=WAITING
Locked pages = []
Locked pages log: name=jdbc-request-handler-worker-#29357%tradecore%
time=(1607333541274, 2020-12-0717:32:21.274)
Thread=[name=vacuum-cleaner-#67%tradecore%, id=105], state=RUNNABLE
Locked pages = []
Locked pages log: name=vacuum-cleaner-#67%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=vacuum-cleaner-#68%tradecore%, id=106], state=RUNNABLE
Locked pages = []
Locked pages log: name=vacuum-cleaner-#68%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=vacuum-cleaner-#69%tradecore%, id=107], state=WAITING
Locked pages = []
Locked pages log: name=vacuum-cleaner-#69%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=vacuum-cleaner-#70%tradecore%, id=108], state=RUNNABLE
Locked pages = []
Locked pages log: name=vacuum-cleaner-#70%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=vacuum-cleaner-#71%tradecore%, id=109], state=RUNNABLE
Locked pages = []
Locked pages log: name=vacuum-cleaner-#71%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=vacuum-cleaner-#72%tradecore%, id=110], state=RUNNABLE
Locked pages = []
Locked pages log: name=vacuum-cleaner-#72%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=vacuum-cleaner-#73%tradecore%, id=111], state=WAITING
Locked pages = []
Locked pages log: name=vacuum-cleaner-#73%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
Thread=[name=vacuum-cleaner-#74%tradecore%, id=112], state=WAITING
Locked pages = []
Locked pages log: name=vacuum-cleaner-#74%tradecore%
time=(1607333541277, 2020-12-0717:32:21.277)
2020-12-0717:32:21.558[] [db-checkpoint-thread-#75%tradecore%]
ERRORc.j.i.i.c.IgniteConfig- JVM will be halted immediately due to the
failure: [failureCtx=FailureContext [type=CRITICAL_ERROR, err=class
o.a.i.IgniteCheckedException: Compound exception for CountDownFuture.]]
