Hi all, I'm using ActiveMQ 5.2.0 and it has been stalling out on me recently. What happens is that after everything has been running for a while, it suddenly stops dispatching messages to a consumer. When I look in the logs I see an error saying "Could not locate data file data-topic-data-25". I'm running ActiveMQ using the Windows Service wrapper. I've seen other posts that seem to be related ( http://www.nabble.com/5.2.0-dequeue-counter%3D0-pending-queue-stalls-to21658012.html#a21658012 like this one ) but haven't seen a solution that addresses this error.
I don't have a whole lot of information, but I've included my config file and the log file from after I restarted the broker. I'm fairly new to ActiveMQ so maybe I'm missing something obvious. Any help would be greatly appreciated. Thanks, Stefan <beans xmlns="http://www.springframework.org/schema/beans" xmlns:amq="http://activemq.apache.org/schema/core" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-2.0.xsd http://activemq.apache.org/schema/core http://activemq.apache.org/schema/core/activemq-core.xsd http://activemq.apache.org/camel/schema/spring http://activemq.apache.org/camel/schema/spring/camel-spring.xsd"> <bean class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer"/> <broker xmlns="http://activemq.apache.org/schema/core" brokerName="localhost" persistent="true" dataDirectory="${activemq.base}/data"> <destinationPolicy> <policyMap> <policyEntries> <policyEntry topic=">"> <dispatchPolicy> <strictOrderDispatchPolicy /> </dispatchPolicy> <subscriptionRecoveryPolicy> <lastImageSubscriptionRecoveryPolicy /> </subscriptionRecoveryPolicy> </policyEntry> </policyEntries> </policyMap> </destinationPolicy> <managementContext> <managementContext connectorPort="1099" jmxDomainName="org.apache.activemq"/> </managementContext> <persistenceAdapter> <amqPersistenceAdapter directory="${activemq.base}/data" directoryArchive="${activemq.base}/data/archive" /> </persistenceAdapter> <systemUsage> <systemUsage> <memoryUsage> <memoryUsage limit="200 mb"/> </memoryUsage> <storeUsage> <storeUsage limit="5 gb" /> </storeUsage> <tempUsage> <tempUsage limit="500 mb"/> </tempUsage> </systemUsage> </systemUsage> <transportConnectors> <transportConnector name="openwire" uri="tcp://localhost:61616" discoveryUri="multicast://default"/> </transportConnectors> </broker> <jetty xmlns="http://mortbay.com/schemas/jetty/1.0"> <connectors> <nioConnector port="8161"/> </connectors> <handlers> <webAppContext contextPath="/admin" resourceBase="${activemq.base}/webapps/admin" logUrlOnStart="true"/> <webAppContext contextPath="/demo" resourceBase="${activemq.base}/webapps/demo" logUrlOnStart="true"/> <webAppContext contextPath="/fileserver" resourceBase="${activemq.base}/webapps/fileserver" logUrlOnStart="true"/> </handlers> </jetty> </beans> 2009-04-06 13:09:41,048 [erSimpleAppMain] INFO BrokerService - Using Persistence Adapter: AMQPersistenceAdapter(C:\Tools\ActiveMQ\5.2.0\bin\win32\..\..\data) 2009-04-06 13:09:41,048 [erSimpleAppMain] INFO AMQPersistenceAdapter - AMQStore starting using directory: C:\Tools\ActiveMQ\5.2.0\bin\win32\..\..\data 2009-04-06 13:09:41,079 [erSimpleAppMain] INFO KahaStore - Kaha Store using data directory C:\Tools\ActiveMQ\5.2.0\bin\win32\..\..\data\kr-store\state 2009-04-06 13:09:41,126 [erSimpleAppMain] INFO AMQPersistenceAdapter - Active data files: [23, 22, 13] 2009-04-06 13:09:41,173 [erSimpleAppMain] INFO BrokerService - ActiveMQ 5.2.0 JMS Message Broker (localhost) is starting 2009-04-06 13:09:41,173 [erSimpleAppMain] INFO BrokerService - For help or more information please see: http://activemq.apache.org/ 2009-04-06 13:09:41,220 [JMX connector ] INFO ManagementContext - JMX consoles can connect to service:jmx:rmi:///jndi/rmi://localhost:1099/jmxrmi 2009-04-06 13:09:41,345 [erSimpleAppMain] INFO KahaStore - Kaha Store using data directory C:\Tools\ActiveMQ\5.2.0\bin\win32\..\..\data\kr-store\data 2009-04-06 13:09:44,532 [erSimpleAppMain] INFO TransportServerThreadSupport - Listening for connections at: tcp://WSLV-LKBLYTF:61616 2009-04-06 13:09:44,532 [erSimpleAppMain] INFO TransportConnector - Connector openwire Started 2009-04-06 13:09:44,548 [erSimpleAppMain] INFO BrokerService - ActiveMQ JMS Message Broker (localhost, ID:WSLV-LKBLYTF-3774-1239048581220-0:0) started 2009-04-06 13:09:44,579 [erSimpleAppMain] INFO log - Logging to org.slf4j.impl.JCLLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2009-04-06 13:09:44,595 [erSimpleAppMain] INFO log - jetty-6.1.9 2009-04-06 13:09:44,845 [erSimpleAppMain] INFO WebConsoleStarter - ActiveMQ WebConsole initialized. 2009-04-06 13:09:44,939 [erSimpleAppMain] INFO /admin - Initializing Spring FrameworkServlet 'dispatcher' 2009-04-06 13:09:45,048 [erSimpleAppMain] INFO log - ActiveMQ Console at http://0.0.0.0:8161/admin 2009-04-06 13:09:45,142 [erSimpleAppMain] INFO log - ActiveMQ Web Demos at http://0.0.0.0:8161/demo 2009-04-06 13:09:45,220 [erSimpleAppMain] INFO log - RESTful file access application at http://0.0.0.0:8161/fileserver 2009-04-06 13:09:45,235 [erSimpleAppMain] INFO log - Started selectchannelconnec...@0.0.0.0:8161 2009-04-06 13:10:51,345 [/127.0.0.1:3782] ERROR DataManagerImpl - Looking for key 25 but not found in fileMap: {49=data-topic-data-49 number = 49 , length = 1117930 refCount = 18031, 48=data-topic-data-48 number = 48 , length = 2097088 refCount = 33824, 46=data-topic-data-46 number = 46 , length = 2097088 refCount = 32195, 47=data-topic-data-47 number = 47 , length = 2097088 refCount = 33824} 2009-04-06 13:10:51,345 [/127.0.0.1:3782] ERROR MapContainerImpl - Failed to get value for offset=1047948, key=(25, 1908884, 47), value=(25, 1908936, 63), previousItem=1047642, nextItem=-1 java.io.IOException: Could not locate data file data-topic-data-25 at org.apache.activemq.kaha.impl.data.DataManagerImpl.getDataFile(DataManagerImpl.java:129) at org.apache.activemq.kaha.impl.data.SyncDataFileReader.readItem(SyncDataFileReader.java:65) at org.apache.activemq.kaha.impl.data.DataManagerImpl.readItem(DataManagerImpl.java:141) at org.apache.activemq.kaha.impl.container.MapContainerImpl.getValue(MapContainerImpl.java:481) at org.apache.activemq.store.kahadaptor.KahaTopicReferenceStore.recoverNextMessages(KahaTopicReferenceStore.java:254) at org.apache.activemq.store.amq.AMQTopicMessageStore.recoverNextMessages(AMQTopicMessageStore.java:59) at org.apache.activemq.broker.region.cursors.TopicStorePrefetch.doFillBatch(TopicStorePrefetch.java:94) at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:227) at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:100) at org.apache.activemq.broker.region.cursors.StoreDurableSubscriberCursor.reset(StoreDurableSubscriberCursor.java:233) at org.apache.activemq.broker.region.PrefetchSubscription.dispatchPending(PrefetchSubscription.java:566) at org.apache.activemq.broker.region.DurableTopicSubscription.activate(DurableTopicSubscription.java:130) at org.apache.activemq.broker.region.TopicRegion.addConsumer(TopicRegion.java:105) at org.apache.activemq.broker.region.RegionBroker.addConsumer(RegionBroker.java:375) at org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:86) at org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:86) at org.apache.activemq.advisory.AdvisoryBroker.addConsumer(AdvisoryBroker.java:83) at org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:86) at org.apache.activemq.broker.MutableBrokerFilter.addConsumer(MutableBrokerFilter.java:93) at org.apache.activemq.broker.TransportConnection.processAddConsumer(TransportConnection.java:541) at org.apache.activemq.command.ConsumerInfo.visit(ConsumerInfo.java:345) at org.apache.activemq.broker.TransportConnection.service(TransportConnection.java:305) at org.apache.activemq.broker.TransportConnection$1.onCommand(TransportConnection.java:179) at org.apache.activemq.transport.TransportFilter.onCommand(TransportFilter.java:68) at org.apache.activemq.transport.WireFormatNegotiator.onCommand(WireFormatNegotiator.java:143) at org.apache.activemq.transport.InactivityMonitor.onCommand(InactivityMonitor.java:206) at org.apache.activemq.transport.TransportSupport.doConsume(TransportSupport.java:84) at org.apache.activemq.transport.tcp.TcpTransport.doRun(TcpTransport.java:203) at org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:185) at java.lang.Thread.run(Unknown Source) 2009-04-06 13:10:51,345 [/127.0.0.1:3782] ERROR AbstractStoreCursor - Failed to fill batch org.apache.activemq.kaha.RuntimeStoreException: java.io.IOException: Could not locate data file data-topic-data-25 at org.apache.activemq.kaha.impl.container.MapContainerImpl.getValue(MapContainerImpl.java:484) at org.apache.activemq.store.kahadaptor.KahaTopicReferenceStore.recoverNextMessages(KahaTopicReferenceStore.java:254) at org.apache.activemq.store.amq.AMQTopicMessageStore.recoverNextMessages(AMQTopicMessageStore.java:59) at org.apache.activemq.broker.region.cursors.TopicStorePrefetch.doFillBatch(TopicStorePrefetch.java:94) at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:227) at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:100) at org.apache.activemq.broker.region.cursors.StoreDurableSubscriberCursor.reset(StoreDurableSubscriberCursor.java:233) at org.apache.activemq.broker.region.PrefetchSubscription.dispatchPending(PrefetchSubscription.java:566) at org.apache.activemq.broker.region.DurableTopicSubscription.activate(DurableTopicSubscription.java:130) at org.apache.activemq.broker.region.TopicRegion.addConsumer(TopicRegion.java:105) at org.apache.activemq.broker.region.RegionBroker.addConsumer(RegionBroker.java:375) at org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:86) at org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:86) at org.apache.activemq.advisory.AdvisoryBroker.addConsumer(AdvisoryBroker.java:83) at org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:86) at org.apache.activemq.broker.MutableBrokerFilter.addConsumer(MutableBrokerFilter.java:93) at org.apache.activemq.broker.TransportConnection.processAddConsumer(TransportConnection.java:541) at org.apache.activemq.command.ConsumerInfo.visit(ConsumerInfo.java:345) at org.apache.activemq.broker.TransportConnection.service(TransportConnection.java:305) at org.apache.activemq.broker.TransportConnection$1.onCommand(TransportConnection.java:179) at org.apache.activemq.transport.TransportFilter.onCommand(TransportFilter.java:68) at org.apache.activemq.transport.WireFormatNegotiator.onCommand(WireFormatNegotiator.java:143) at org.apache.activemq.transport.InactivityMonitor.onCommand(InactivityMonitor.java:206) at org.apache.activemq.transport.TransportSupport.doConsume(TransportSupport.java:84) at org.apache.activemq.transport.tcp.TcpTransport.doRun(TcpTransport.java:203) at org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:185) at java.lang.Thread.run(Unknown Source) Caused by: java.io.IOException: Could not locate data file data-topic-data-25 at org.apache.activemq.kaha.impl.data.DataManagerImpl.getDataFile(DataManagerImpl.java:129) at org.apache.activemq.kaha.impl.data.SyncDataFileReader.readItem(SyncDataFileReader.java:65) at org.apache.activemq.kaha.impl.data.DataManagerImpl.readItem(DataManagerImpl.java:141) at org.apache.activemq.kaha.impl.container.MapContainerImpl.getValue(MapContainerImpl.java:481) ... 26 more 2009-04-06 13:10:51,455 [/127.0.0.1:3782] ERROR AbstractStoreCursor - Failed to fill batch java.lang.RuntimeException: org.apache.activemq.kaha.RuntimeStoreException: java.io.IOException: Could not locate data file data-topic-data-25 at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:230) at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:100) at org.apache.activemq.broker.region.cursors.StoreDurableSubscriberCursor.reset(StoreDurableSubscriberCursor.java:233) at org.apache.activemq.broker.region.PrefetchSubscription.dispatchPending(PrefetchSubscription.java:566) at org.apache.activemq.broker.region.DurableTopicSubscription.activate(DurableTopicSubscription.java:130) at org.apache.activemq.broker.region.TopicRegion.addConsumer(TopicRegion.java:105) at org.apache.activemq.broker.region.RegionBroker.addConsumer(RegionBroker.java:375) at org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:86) at org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:86) at org.apache.activemq.advisory.AdvisoryBroker.addConsumer(AdvisoryBroker.java:83) at org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:86) at org.apache.activemq.broker.MutableBrokerFilter.addConsumer(MutableBrokerFilter.java:93) at org.apache.activemq.broker.TransportConnection.processAddConsumer(TransportConnection.java:541) at org.apache.activemq.command.ConsumerInfo.visit(ConsumerInfo.java:345) at org.apache.activemq.broker.TransportConnection.service(TransportConnection.java:305) at org.apache.activemq.broker.TransportConnection$1.onCommand(TransportConnection.java:179) at org.apache.activemq.transport.TransportFilter.onCommand(TransportFilter.java:68) at org.apache.activemq.transport.WireFormatNegotiator.onCommand(WireFormatNegotiator.java:143) at org.apache.activemq.transport.InactivityMonitor.onCommand(InactivityMonitor.java:206) at org.apache.activemq.transport.TransportSupport.doConsume(TransportSupport.java:84) at org.apache.activemq.transport.tcp.TcpTransport.doRun(TcpTransport.java:203) at org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:185) at java.lang.Thread.run(Unknown Source) Caused by: org.apache.activemq.kaha.RuntimeStoreException: java.io.IOException: Could not locate data file data-topic-data-25 at org.apache.activemq.kaha.impl.container.MapContainerImpl.getValue(MapContainerImpl.java:484) at org.apache.activemq.store.kahadaptor.KahaTopicReferenceStore.recoverNextMessages(KahaTopicReferenceStore.java:254) at org.apache.activemq.store.amq.AMQTopicMessageStore.recoverNextMessages(AMQTopicMessageStore.java:59) at org.apache.activemq.broker.region.cursors.TopicStorePrefetch.doFillBatch(TopicStorePrefetch.java:94) at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:227) ... 22 more Caused by: java.io.IOException: Could not locate data file data-topic-data-25 at org.apache.activemq.kaha.impl.data.DataManagerImpl.getDataFile(DataManagerImpl.java:129) at org.apache.activemq.kaha.impl.data.SyncDataFileReader.readItem(SyncDataFileReader.java:65) at org.apache.activemq.kaha.impl.data.DataManagerImpl.readItem(DataManagerImpl.java:141) at org.apache.activemq.kaha.impl.container.MapContainerImpl.getValue(MapContainerImpl.java:481) ... 26 more -- View this message in context: http://www.nabble.com/Could-not-locate-data-file-data-topic-data-X-tp22916586p22916586.html Sent from the ActiveMQ - User mailing list archive at Nabble.com.