Hi, Possibly, it is a bug in partition eviction optimization. Ignite can skip partition eviction procedure and remove partition instantly if there is no indexes.
If it is so, you can try the latest ignite-2.5 version [1] or as a workaround you can add index via configuring QueryEntity or via setting cacheCfg.setIndexTypes(). [1] https://ignite.apache.org/download.cgi#binaries On Wed, Jun 13, 2018 at 1:22 AM, Oleks K <olexandr.kundire...@gmail.com> wrote: > Hi guys, > > I got similar errors in 2.4.0 > > First: > > org.apache.ignite.IgniteException: Runtime failure on bounds: [lower=null, > upper=PendingRow []] > --> Caused by: java.lang.IllegalStateException: Failed to get page IO > instance (page content is corrupted) > > Then lots of: > > org.apache.ignite.IgniteException: Runtime failure on bounds > --> Caused by: java.lang.IllegalStateException: Item not found: 3 > > This was reproduced when I started and stopped server nodes under the load > Topology: 2 server and 2 client nodes > Java: 1.8.0_162 > OS: Windows Server 2012 R2 6.3 amd64 > > Cache config: > <bean class="org.apache.ignite.configuration.CacheConfiguration"> > <property name="name" value="RefreshToken"/> > <property name="dataRegionName" > value="auth_durable_region"/> > <property name="atomicityMode" value="ATOMIC"/> > <property name="writeSynchronizationMode" > value="FULL_ASYNC"/> > <property name="cacheMode" value="PARTITIONED"/> > <property name="backups" value="0"/> > <property name="eagerTtl" value="true"/> > </bean> > > Ignite team, can you comment on this please? > How critical is the issue? What is the impact? > Any workarounds? Fix planned? > > 2018-06-13 00:22:30.978 [exchange-worker-#42] INFO > org.apache.ignite.internal.processors.cache.distributed.dht.preloader. > GridDhtPartitionDemander > - Starting rebalancing [mode=ASYNC, > fromNode=bdddfe24-aab3-46fa-9452-efe933783adb, partitionsCount=787, > topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], updateSeq=12] > 2018-06-13 00:22:31.594 [ttl-cleanup-worker-#52] ERROR > org.apache.ignite.internal.processors.cache.GridCacheSharedTtlCleanupManag > er > - Runtime error caught during grid runnable execution: GridWorker > [name=ttl-cleanup-worker, igniteInstanceName=null, finished=false, > hashCode=473353699, interrupted=false, runner=ttl-cleanup-worker-#52] > org.apache.ignite.IgniteException: Runtime failure on bounds: [lower=null, > upper=PendingRow []] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.BPlusTree.find(BPlusTree.java:963) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.BPlusTree.find(BPlusTree.java:942) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl. > expire(IgniteCacheOffheapManagerImpl.java:974) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.GridCacheTtlManager.expire( > GridCacheTtlManager.java:197) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.GridCacheSharedTtlCleanupManag > er$CleanupWorker.body(GridCacheSharedTtlCleanupManager.java:129) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) > [ignite-core-2.4.0.jar:2.4.0] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_162] > Caused by: java.lang.IllegalStateException: Failed to get page IO instance > (page content is corrupted) > at > org.apache.ignite.internal.processors.cache.persistence. > tree.io.IOVersions.forVersion(IOVersions.java:83) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.io.IOVersions.forPage(IOVersions.java:95) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > CacheDataRowAdapter.initFromLink(CacheDataRowAdapter.java:148) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > CacheDataRowAdapter.initFromLink(CacheDataRowAdapter.java:102) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.tree. > PendingRow.initKey(PendingRow.java:72) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.tree. > PendingEntriesTree.getRow(PendingEntriesTree.java:118) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.tree. > PendingEntriesTree.getRow(PendingEntriesTree.java:31) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.BPlusTree$ForwardCursor.fillFromBuffer(BPlusTree.java:4614) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.BPlusTree$ForwardCursor.init(BPlusTree.java:4516) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.BPlusTree$ForwardCursor.access$5300(BPlusTree.java:4455) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree. > findLowerUnbounded(BPlusTree.java:919) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.BPlusTree.find(BPlusTree.java:951) > ~[ignite-core-2.4.0.jar:2.4.0] > ... 6 more > > 2018-06-13 00:23:35.596 [sys-stripe-6-#7] ERROR > org.apache.ignite.internal.processors.cache.GridCacheIoManager - Failed to > process message [senderId=1dedb701-ffd1-4937-b202-7326367a92fb, > messageType=class > o.a.i.i.processors.cache.distributed.dht.atomic. > GridNearAtomicFullUpdateRequest] > org.apache.ignite.IgniteException: Runtime failure on bounds: [lower=null, > upper=PendingRow []] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.BPlusTree.find(BPlusTree.java:963) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.BPlusTree.find(BPlusTree.java:942) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl. > expire(IgniteCacheOffheapManagerImpl.java:974) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.GridCacheTtlManager.expire( > GridCacheTtlManager.java:197) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.GridCacheUtils.unwindEvicts( > GridCacheUtils.java:834) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager. > onMessageProcessed(GridCacheIoManager.java:1099) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager. > processMessage(GridCacheIoManager.java:1072) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0( > GridCacheIoManager.java:579) > [ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager. > handleMessage(GridCacheIoManager.java:378) > [ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager. > handleMessage(GridCacheIoManager.java:304) > [ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$100( > GridCacheIoManager.java:99) > [ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager$1. > onMessage(GridCacheIoManager.java:293) > [ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.managers.communication. > GridIoManager.invokeListener(GridIoManager.java:1555) > [ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.managers.communication.GridIoManager. > processRegularMessage0(GridIoManager.java:1183) > [ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.managers.communication. > GridIoManager.access$4200(GridIoManager.java:126) > [ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.managers.communication.GridIoManager$9.run( > GridIoManager.java:1090) > [ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.util.StripedExecutor$Stripe. > run(StripedExecutor.java:505) > [ignite-core-2.4.0.jar:2.4.0] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_162] > Caused by: java.lang.IllegalStateException: Item not found: 3 > at > org.apache.ignite.internal.processors.cache.persistence. > tree.io.AbstractDataPageIO.findIndirectItemIndex( > AbstractDataPageIO.java:341) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.io.AbstractDataPageIO.getDataOffset(AbstractDataPageIO.java:450) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.io.AbstractDataPageIO.readPayload(AbstractDataPageIO.java:492) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > CacheDataRowAdapter.initFromLink(CacheDataRowAdapter.java:150) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > CacheDataRowAdapter.initFromLink(CacheDataRowAdapter.java:102) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.tree. > PendingRow.initKey(PendingRow.java:72) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.tree. > PendingEntriesTree.getRow(PendingEntriesTree.java:118) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.tree. > PendingEntriesTree.getRow(PendingEntriesTree.java:31) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.BPlusTree$ForwardCursor.fillFromBuffer(BPlusTree.java:4614) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.BPlusTree$ForwardCursor.init(BPlusTree.java:4516) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.BPlusTree$ForwardCursor.access$5300(BPlusTree.java:4455) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree. > findLowerUnbounded(BPlusTree.java:919) > ~[ignite-core-2.4.0.jar:2.4.0] > at > org.apache.ignite.internal.processors.cache.persistence. > tree.BPlusTree.find(BPlusTree.java:951) > ~[ignite-core-2.4.0.jar:2.4.0] > ... 17 more > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ > -- Best regards, Andrey V. Mashenkov
