[ https://issues.apache.org/activemq/browse/AMQ-1093?page=all ]
james strachan resolved AMQ-1093.
---------------------------------
Fix Version/s: 4.2.0
Resolution: Fixed
I've just committed a patch to trunk for this which I think resolves the issue.
There's no test case to easily verify its resolved though (its a tad hard to
recreate) so I wonder could you try and see if this is now fixed - if not let
us know and we can reopen this issue
> Client deadlock during failover
> -------------------------------
>
> Key: AMQ-1093
> URL: https://issues.apache.org/activemq/browse/AMQ-1093
> Project: ActiveMQ
> Issue Type: Bug
> Components: Transport
> Affects Versions: 4.1.0
> Environment: Linux 2.6, java 1.5.0
> Reporter: Danielius Jurna
> Priority: Critical
> Fix For: 4.2.0
>
>
> In 4.1.0 there's deadlock on connection failover. There is the scenario:
> 1. Client consumes message using message listener
> 2. Conection is lost
> 3. Client sends message to another queue from messagle listener and waits
> until connection is restored.
> 4. Reconnect task blocks on reconnecting.
>
> This bug is new to 4.1.0. The problem is in ActiveMQMessageConsumre.dispatch
> . There is new lock on unconsumedMessages.getMutex() . So the reconnect task
> cannot invoke ActiveMQMessageConsumre.clearMessagesInProgress(), because lock
> is acquired by message listener, which waits untill message is sent (untill
> connection is resumed). Here is stack traces:
>
> "ActiveMQ Session Task" daemon prio=1 tid=0x0000002b27774260 nid=0x4778 in
> Object.wait() [0x0000000040ef3000..0x0000000040ef4db0]
> at java.lang.Object.wait(Native Method)
> - waiting on <0x0000002b0020a7c8> (a
> edu.emory.mathcs.backport.java.util.concurrent.locks.CondVar)
> at java.lang.Object.wait(Object.java:474)
> at
> edu.emory.mathcs.backport.java.util.concurrent.locks.CondVar.await(CondVar.java:75)
>
> - locked <0x0000002b0020a7c8> (a
> edu.emory.mathcs.backport.java.util.concurrent.locks.CondVar)
> at
> edu.emory.mathcs.backport.java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:318)
>
> at
> org.apache.activemq.transport.FutureResponse.getResult(FutureResponse.java:42)
>
> at
> org.apache.activemq.transport.ResponseCorrelator.request(ResponseCorrelator.java:75)
>
> at
> org.apache.activemq.ActiveMQConnection.syncSendPacket(ActiveMQConnection.java:1171)
>
> at
> org.apache.activemq.ActiveMQSession.send(ActiveMQSession.java:1548)
> at
> org.apache.activemq.ActiveMQMessageProducer.send(ActiveMQMessageProducer.java:465)
>
> at
> org.apache.activemq.pool.PooledProducer.send(PooledProducer.java:75)
> - locked <0x0000002b173fa480> (a
> org.apache.activemq.ActiveMQMessageProducer)
> at
> org.apache.activemq.pool.PooledProducer.send(PooledProducer.java:60)
> at
> org.springframework.jms.core.JmsTemplate.doSend(JmsTemplate.java:537)
> at
> org.springframework.jms.core.JmsTemplate.doSend(JmsTemplate.java:513)
> at
> org.springframework.jms.core.JmsTemplate$2.doInJms(JmsTemplate.java:479)
> at
> org.springframework.jms.core.JmsTemplate.execute(JmsTemplate.java:430)
> at
> org.springframework.jms.core.JmsTemplate.send(JmsTemplate.java:477)
> at
> lt.elitnet.dbp.das.impl.storage.HI2StorageImpl.storeHI2Message(HI2StorageImpl.java:57)
>
> at
> lt.elitnet.dbp.das.impl.hi2.HI2PersistanceBase.saveIRIContent(HI2PersistanceBase.java:77)
>
> at sun.reflect.GeneratedMethodAccessor185.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:585)
> at
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:318)
>
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:203)
>
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:162)
>
> at
> org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:107)
>
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
>
> at
> org.springframework.orm.hibernate3.HibernateInterceptor.invoke(HibernateInterceptor.java:104)
>
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
>
> at
> lt.elitnet.dbp.das.impl.alarming.DataBaseConnectionAlarmsPublisher.invoke(DataBaseConnectionAlarmsPublisher.java:59)
>
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
>
> at
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:209)
>
> at $Proxy24.saveIRIContent(Unknown Source)
> at
> lt.elitnet.dbp.das.impl.hi2.HI2MessageListener.onMessage(HI2MessageListener.java:40)
>
> at
> lt.elitnet.dbp.commons.messaging.TextMessageListener.deliverMessage(TextMessageListener.java:84)
>
> at
> lt.elitnet.dbp.commons.messaging.TextMessageListener.onMessage(TextMessageListener.java:50)
>
> at
> org.springframework.jms.listener.AbstractMessageListenerContainer.doInvokeListener(AbstractMessageListenerContainer.java:854)
>
> at
> org.springframework.jms.listener.AbstractMessageListenerContainer.invokeListener(AbstractMessageListenerContainer.java:793)
>
> at
> org.springframework.jms.listener.AbstractMessageListenerContainer.doExecuteListener(AbstractMessageListenerContainer.java:763)
>
> at
> org.springframework.jms.listener.AbstractMessageListenerContainer.executeListener(AbstractMessageListenerContainer.java:743)
>
> at
> org.springframework.jms.listener.SimpleMessageListenerContainer$2.onMessage(SimpleMessageListenerContainer.java:190)
>
> at
> org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:840)
>
> - locked <0x0000002b1771ddc0> (a java.lang.Object)
> at
> org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:96)
>
> at
> org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:165)
>
> at
> org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:111)
>
> at
> org.apache.activemq.thread.PooledTaskRunner.access$100(PooledTaskRunner.java:26)
>
> at
> org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:44)
> at
> edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650)
>
> at
> edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
>
> at java.lang.Thread.run(Thread.java:595)
>
> "ActiveMQ Transport: tcp:///192.168.2.55:61616" prio=1 tid=0x0000002b2e814660
> nid=0x4773 waiting for monitor entry [0x0000000040e82000..0x0000000040e82c30]
> at
> org.apache.activemq.MessageDispatchChannel.clear(MessageDispatchChannel.java:135)
>
> - waiting to lock <0x0000002b1771ddc0> (a java.lang.Object)
> at
> org.apache.activemq.ActiveMQMessageConsumer.clearMessagesInProgress(ActiveMQMessageConsumer.java:546)
>
> at
> org.apache.activemq.ActiveMQSession.clearMessagesInProgress(ActiveMQSession.java:524)
>
> at
> org.apache.activemq.ActiveMQConnection.transportInterupted(ActiveMQConnection.java:1547)
>
> at
> org.apache.activemq.transport.TransportFilter.transportInterupted(TransportFilter.java:100)
>
> at
> org.apache.activemq.transport.TransportFilter.transportInterupted(TransportFilter.java:100)
>
> at
> org.apache.activemq.transport.failover.FailoverTransport.handleTransportFailure(FailoverTransport.java:236)
>
> at
> org.apache.activemq.transport.failover.FailoverTransport.access$300(FailoverTransport.java:55)
>
> at
> org.apache.activemq.transport.failover.FailoverTransport$1.onException(FailoverTransport.java:120)
>
> at
> org.apache.activemq.transport.TransportFilter.onException(TransportFilter.java:96)
>
> at
> org.apache.activemq.transport.WireFormatNegotiator.onException(WireFormatNegotiator.java:147)
>
> at
> org.apache.activemq.transport.InactivityMonitor.onException(InactivityMonitor.java:150)
>
> at
> org.apache.activemq.transport.TransportSupport.onException(TransportSupport.java:97)
>
> at
> org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:150)
> at java.lang.Thread.run(Thread.java:595)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://issues.apache.org/activemq/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
