[ https://issues.apache.org/jira/browse/IGNITE-9954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexand Polyakov updated IGNITE-9954: ------------------------------------- Summary: An error in rollback the transaction caused the cluster to hang (was: An error in rolling back the transaction caused the cluster to hang) > An error in rollback the transaction caused the cluster to hang > --------------------------------------------------------------- > > Key: IGNITE-9954 > URL: https://issues.apache.org/jira/browse/IGNITE-9954 > Project: Ignite > Issue Type: Bug > Reporter: Andrey Kalinin > Priority: Major > > Starts a transaction with a small timeout > on one node, we observe the rollback of the transaction by timeout: > {code:java} > 2018-10-18 02:14:13.339 > [ERROR][sys-stripe-48-#49%GRID%GridNodeName%][o.a.i.i.p.c.t.IgniteTxHandler] > Failed to process prepare request: GridDhtTxPrepareRequest > [nearNodeId=ab0c3e9f-1642-4779-a6a0-dd10a6efd387, > futId=54208048661-53dd6648-cc70-4076-a608-f6072645e609, miniId=1, > topVer=AffinityTopologyVersion [topVer=338, minorTopVer=0], > invalidateNearEntries={}, nearWrites=null, owned=null, > nearXidVer=GridCacheVersion [topVer=151260338, order=1543126364337, > nodeOrder=172], subjId=ab0c3e9f-1642-4779-a6a0-dd10a6efd387, taskNameHash=0, > preloadKeys=null, skipCompletedVers=false, > super=GridDistributedTxPrepareRequest [threadId=732, concurrency=PESSIMISTIC, > isolation=REPEATABLE_READ, writeVer=GridCacheVersion [topVer=151260338, > order=1543126439977, nodeOrder=81], timeout=9, reads=null, writes=ArrayList > [IgniteTxEntry [key=KeyCacheObjectImpl [part=12715, val=ids_name, > hasValBytes=true], cacheId=-1934881220, txKey=IgniteTxKey > [key=KeyCacheObjectImpl [part=12715, val=ids_name, hasValBytes=true], > cacheId=-1934881220], val=CacheObjectImpl [val=null, > hasValBytes=true][op=UPDATE, val=], prevVal=[op=NOOP, val=null], > oldVal=CacheObjectImpl [val=null, hasValBytes=true][op=UPDATE, val=], > entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, > explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], > filtersPassed=false, filtersSet=false, entry=GridCacheMapEntry > [key=KeyCacheObjectImpl [part=12715, val=ids_name, hasValBytes=true], > val=null, startVer=1543128775655, ver=GridCacheVersion [topVer=151260338, > order=1543126364674, nodeOrder=81], hash=-864500235, > extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion > [topVer=2147483647, order=0, nodeOrder=0]], flags=2]GridDistributedCacheEntry > [super=]GridDhtCacheEntry [rdrs=ReaderId[] [], part=12715, super=], > prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, > transferExpiryPlc=false, flags=2, partUpdateCntr=0, serReadVer=null, > xidVer=null]], dhtVers=null, txSize=0, plc=2, txState=null, > flags=onePhase|last, super=GridDistributedBaseMessage [ver=GridCacheVersion > [topVer=151260338, order=1543126439864, nodeOrder=81], committedVers=null, > rolledbackVers=null, cnt=0, super=GridCacheIdMessage [cacheId=0]]]] > org.apache.ignite.internal.transactions.IgniteTxTimeoutCheckedException: > Transaction timed out: GridCacheSharedManagerAdapter [starting=true, > stop=false] > at > org.apache.ignite.internal.processors.cache.transactions.IgniteTxManager.prepareTx(IgniteTxManager.java:868) > at > org.apache.ignite.internal.processors.cache.distributed.GridDistributedTxRemoteAdapter.prepareRemoteTx(GridDistributedTxRemoteAdapter.java:406) > at > org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.startRemoteTx(IgniteTxHandler.java:1754) > at > org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.processDhtTxPrepareRequest(IgniteTxHandler.java:1121) > at > org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.access$400(IgniteTxHandler.java:101) > at > org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler$5.apply(IgniteTxHandler.java:205) > at > org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler$5.apply(IgniteTxHandler.java:203) > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:1058) > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:583) > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:382) > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:308) > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$100(GridCacheIoManager.java:101) > at > org.apache.ignite.internal.processors.cache.GridCacheIoManager$1$2$1.run(GridCacheIoManager.java:277) > at > org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:496) > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) > at java.lang.Thread.run(Thread.java:745) > {code} > at the same time on another node: > {code:java} > 2018-10-18 02:14:03.948 [WARN > ][sys-stripe-36-#37%GRID%GridNodeName%][o.apache.ignite.cache.msg.tx.finish] > Received finish request for completed transaction (the message may be too > late) [txId=GridCacheVersion [topVer=151260338, order=1543126364337, > nodeOrder=172], dhtTxId=null, node=ab0c3e9f-1642-4779-a6a0-dd10a6efd387, > commit=false] > {code} > transaction hangs > {code:java} > TcpDiscoveryNode [id=db0b2eb9-c3ed-465a-8799-23e8ff336ffd, > addrs=[192.168.1.29], order=338, ver=2.5, isClient=false, consistentId=node3] > Tx: [xid=8b7d0894761-00000000-0904-0cb2-0000-000000000051, label=null, > state=MARKED_ROLLBACK, startTime=2018-10-18 02:14:13.307, duration=37507, > isolation=REPEATABLE_READ, concurrency=PESSIMISTIC, > topVer=AffinityTopologyVersion [topVer=338, minorTopVer=0], timeout=9, > size=1, dhtNodes=N/A, > nearXid=1b0bf794761-00000000-0904-0cb2-0000-0000000000ac, > parentNodeIds=[ab0c3e9f, 4e2505b4]] > {code} > exchange did not complete when changed the topology > no further transactions take place > {code:java} > TcpDiscoveryNode [id=4f06e4cb-5a79-4ce9-b5d8-e53c164e1791, > addrs=[192.168.1.35], order=337, ver=2.5, isClient=false, consistentId=node6] > Tx: [xid=4052cbfb761-00000000-0904-0cb5-0000-000000000151, label=null, > state=ACTIVE, startTime=2018-10-18 05:34:33.358, duration=25487, > isolation=READ_COMMITTED, concurrency=OPTIMISTIC, topVer=N/A, timeout=0, > size=0, dhtNodes=[], > nearXid=4052cbfb761-00000000-0904-0cb5-0000-000000000151, > parentNodeIds=[4f06e4cb]] > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)