I have activemq setup with replicated leveldb and zookeeper.
I see these exception in activemq. 2014-02-03 10:55:47,673 | WARN | Async error occurred: | org.apache.activemq.broker.TransportConnection.Service | ActiveMQ Transport: tcp:///[ip-address]:37297@61616 javax.jms.JMSException: Unmatched acknowledge: MessageAck {commandId = 18966, responseRequired = false, ackType = 2, consumerId = ID:[host]-36009-1391392374821-0:2:2:1, firstMessageId = ID:[clinet-host]-48566-1391392305331-0:2:14:1:131, lastMessageId = ID:[client-host]-48566-1391392305331-0:2:14:1:131, destination = queue://JMSHealthCheckDestination, transactionId = TX:ID:[client-host-2]-36009-1391392374821-0:2:6319, messageCount = 1, poisonCause = null}; Could not find Message-ID ID:[client-host-1]-48566-1391392305331-0:2:14:1:131 in dispatched-list (start of ack) at org.apache.activemq.broker.region.PrefetchSubscription.assertAckMatchesDispatched(PrefetchSubscription.java:480) at org.apache.activemq.broker.region.PrefetchSubscription.acknowledge(PrefetchSubscription.java:212) at org.apache.activemq.broker.region.AbstractRegion.acknowledge(AbstractRegion.java:416) at org.apache.activemq.broker.region.RegionBroker.acknowledge(RegionBroker.java:457) at org.apache.activemq.broker.BrokerFilter.acknowledge(BrokerFilter.java:82) at org.apache.activemq.broker.BrokerFilter.acknowledge(BrokerFilter.java:82) at org.apache.activemq.broker.TransactionBroker.acknowledge(TransactionBroker.java:277) at org.apache.activemq.broker.MutableBrokerFilter.acknowledge(MutableBrokerFilter.java:92) at org.apache.activemq.broker.TransportConnection.processMessageAck(TransportConnection.java:479) at org.apache.activemq.command.MessageAck.visit(MessageAck.java:236) at org.apache.activemq.broker.TransportConnection.service(TransportConnection.java:295) at org.apache.activemq.broker.TransportConnection$1.onCommand(TransportConnection.java:152) at org.apache.activemq.transport.MutexTransport.onCommand(MutexTransport.java:50) at org.apache.activemq.transport.WireFormatNegotiator.onCommand(WireFormatNegotiator.java:113) at org.apache.activemq.transport.AbstractInactivityMonitor.onCommand(AbstractInactivityMonitor.java:270) at org.apache.activemq.transport.TransportSupport.doConsume(TransportSupport.java:83) at org.apache.activemq.transport.tcp.TcpTransport.doRun(TcpTransport.java:214) at org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:196) I also see this exception: 2014-02-03 10:55:54,169 | WARN | Transport Connection to: tcp://[ip]:46789 failed: java.io.EOFException | org.apache.activemq.broker.TransportConnection.Transport | ActiveMQ Transport: tcp:///[ip]:46789@61616 I am not sure what is causing this exception. But suddenly messges start going to DLQ and doesnt get processes in from queues. any suggestion where to start toubleshoot. I dont see any exception in zookeeper. thanks, chirag