Ksenia Rybakova created IGNITE-5209: ---------------------------------------
Summary: "IllegalStateException: Already swapped" error with offheap_tired indexed cache Key: IGNITE-5209 URL: https://issues.apache.org/jira/browse/IGNITE-5209 Project: Ignite Issue Type: Bug Affects Versions: 1.9 Reporter: Ksenia Rybakova The following error occurs during load test and causes client fail: {noformat} <12:33:26><benchmark-worker-7><yardstick> The benchmark of random operation failed. javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Failed to update keys on primary node. at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1443) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.cacheException(IgniteCacheProxy.java:2182) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.putAll(IgniteCacheProxy.java:1429) at org.apache.ignite.yardstick.cache.load.IgniteCacheRandomOperationBenchmark.doPutAll(IgniteCacheRandomOperationBenchmark.java:712) at org.apache.ignite.yardstick.cache.load.IgniteCacheRandomOperationBenchmark.executeRandomOperation(IgniteCacheRandomOperationBenchmark.java:566) at org.apache.ignite.yardstick.cache.load.IgniteCacheRandomOperationBenchmark.executeOutOfTx(IgniteCacheRandomOperationBenchmark.java:548) at org.apache.ignite.yardstick.cache.load.IgniteCacheRandomOperationBenchmark.test(IgniteCacheRandomOperationBenchmark.java:157) at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:178) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Failed to update keys on primary node. at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicUpdateResponse.addFailedKeys(GridNearAtomicUpdateResponse.java:370) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateAllAsyncInternal0(GridDhtAtomicCache.java:2023) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateAllAsyncInternal(GridDhtAtomicCache.java:1776) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.processNearAtomicUpdateRequest(GridDhtAtomicCache.java:3254) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.access$1600(GridDhtAtomicCache.java:131) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$6.apply(GridDhtAtomicCache.java:342) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$6.apply(GridDhtAtomicCache.java:337) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1224) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:852) at org.apache.ignite.internal.managers.communication.GridIoManager.access$2100(GridIoManager.java:109) at org.apache.ignite.internal.managers.communication.GridIoManager$7.run(GridIoManager.java:792) at org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:428) ... 1 more Suppressed: java.lang.IllegalStateException: Already swapped: 140510727619712 at org.apache.ignite.internal.processors.query.h2.opt.GridH2KeyValueRowOffheap.onSwap(GridH2KeyValueRowOffheap.java:201) at org.apache.ignite.internal.processors.query.h2.opt.GridH2Table.onSwapUnswap(GridH2Table.java:230) at org.apache.ignite.internal.processors.query.h2.opt.GridH2Table.onSwap(GridH2Table.java:181) at org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.onSwap(IgniteH2Indexing.java:736) at org.apache.ignite.internal.processors.query.GridQueryProcessor.onSwap(GridQueryProcessor.java:1183) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.onSwap(GridCacheQueryManager.java:398) at org.apache.ignite.internal.processors.cache.GridCacheSwapManager.write(GridCacheSwapManager.java:1381) at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.swap(GridCacheMapEntry.java:673) at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.evictInternal(GridCacheMapEntry.java:4302) at org.apache.ignite.internal.processors.cache.GridCacheEvictionManager.evict0(GridCacheEvictionManager.java:709) at org.apache.ignite.internal.processors.cache.GridCacheEvictionManager.touch(GridCacheEvictionManager.java:798) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.unlockEntries(GridDhtAtomicCache.java:3104) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateAllAsyncInternal0(GridDhtAtomicCache.java:1998) ... 16 more Finishing main test [ts=1494581606980, date=Fri May 12 12:33:26 MSK 2017] ERROR: Shutting down benchmark driver to unexpected exception. {noformat} Load config: - CacheRandomOperationBenchmark - 1 client and 24 server nodes - 1 cache {noformat} <bean name="atomic-index" class="org.apache.ignite.configuration.CacheConfiguration"> <property name="name" value="atomic-index"/> <property name="cacheMode" value="PARTITIONED"/> <property name="atomicityMode" value="ATOMIC"/> <property name="indexedTypes"> <list> <value>java.lang.Integer</value> <value>org.apache.ignite.yardstick.cache.model.Person1</value> </list> </property> <property name="swapEnabled" value="false"/> <property name="memoryMode" value="OFFHEAP_TIERED"/> </bean> {noformat} - operations: PUT PUT_ALL GET GET_ALL INVOKE INVOKE_ALL REMOVE REMOVE_ALL PUT_IF_ABSENT REPLACE Complete configs are attached -- This message was sent by Atlassian JIRA (v6.3.15#6346)