Bumping this request. This issue is hindering us using ActiveMQ in our
enterprise.
Thanks so much!
Sharma
On Wed, Jan 26, 2011 at 5:34 PM, S Sharma <sspr...@gmail.com> wrote:
> Hi all,
>
> I am getting significant message drops in activemq-5.4.2 pure master-slave
> configuration. I am testing topics using the simple producer & asynchronous
> consumer from the activemq-cpp-library-3.2.4 (code attached).
>
> The master and slave configurations are also attached. I am testing
> (persistent) message drops by:
>
> 1. Create four producers from SimpleProducer.cpp, having line 135 as:
> string text = (string)("App1 Seq No: ") + ix_str;
> string text = (string)("App2 Seq No: ") + ix_str;
> string text = (string)("App3 Seq No: ") + ix_str; and
> string text = (string)("App4 Seq No: ") + ix_str;
>
> 2. Create four consumers (identical binaries) from SimpleAsyncConsumer.cpp
> all listening to topic "TEST.FOO".
>
> 3. Start all consumers:
> ./simple_async_consumer1 > consumer1, ./simple_async_consumer2 > consumer2,
> ./simple_async_consumer3 > consumer3, ./simple_async_consumer4 > consumer4
>
> 4. Then start all producers:
> ./simple_producer1 > producer1 & ./simple_producer2 > producer2 &
> ./simple_producer3 > producer3 & ./simple_producer4 > producer4 &
>
> 5. Terminate master broker: kill -9 <MasterPID>
>
> In both slave configurations: shutdownOnMasterFailure="true" and
> shutdownOnMasterFailure="false" with manual copying kahadb, I am noticing
> that the four consumers do not receive several messages which are sent
> (likely during the failover process). For instance, attached consumer1.txt
> file has <40001 messages received.
>
> Can someone please help me decipher what is going wrong? If you need any
> clarification on the test case, please let me know.
>
> Master:
>
> <beans
> xmlns="http://www.springframework.org/schema/beans";
> xmlns:amq="http://activemq.apache.org/schema/core";
> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
> xsi:schemaLocation="http://www.springframework.org/schema/beans
> http://www.springframework.org/schema/beans/spring-beans-2.0.xsd
> http://activemq.apache.org/schema/core
> http://activemq.apache.org/schema/core/activemq-core.xsd";>
>
> <broker
> xmlns="http://activemq.apache.org/schema/core";
> brokerName="master"
> dataDirectory="/home/activemq/activemq/data"
> waitForSlave="false" >
> <destinationPolicy>
> <policyMap>
> <policyEntries>
> <policyEntry topic=">" producerFlowControl="false"
> memoryLimit="1500mb">
> <pendingSubscriberPolicy>
> <vmCursor />
> </pendingSubscriberPolicy>
> </policyEntry>
> <policyEntry queue=">" producerFlowControl="false"
> memoryLimit="1500mb">
> </policyEntry>
> </policyEntries>
> </policyMap>
> </destinationPolicy>
>
>
> <managementContext>
> <managementContext createConnector="false"/>
> </managementContext>
>
>
> <persistenceAdapter>
> <kahaDB directory="${activemq.base}/data/kahadb"
> cleanupInterval="300000" checkpointInterval="50000"
> journalMaxWriteBatchSize="6400k"
> journalMaxFileLength="100g"
> indexCacheSize="100000" indexWriteBatchSize="100000"
> />
> </persistenceAdapter>
>
> <transportConnectors>
> <transportConnector name="openwire" uri="tcp://
> 0.0.0.0:61616?wireFormat.maxInactivityDuration=0"/>
> </transportConnectors>
>
> </broker>
>
> <import resource="jetty.xml"/>
>
> </beans>
>
>
> Slave:
>
> <beans
> xmlns="http://www.springframework.org/schema/beans";
> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
> xsi:schemaLocation="http://www.springframework.org/schema/beans
> http://www.springframework.org/schema/beans/spring-beans-2.0.xsd
> http://activemq.apache.org/schema/core
> http://activemq.apache.org/schema/core/activemq-core.xsd
> http://camel.apache.org/schema/spring
> http://camel.apache.org/schema/spring/camel-spring.xsd";>
>
> <bean
> class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer"/>
>
> <broker masterConnectorURI="tcp://masterIPAddress:61616"
> brokerName="slave" xmlns="http://activemq.apache.org/schema/core";
> shutdownOnMasterFailure="false" >
>
> <destinationPolicy>
> <policyMap>
> <policyEntries>
> <policyEntry queue=">" optimizedDispatch="true" />
> <policyEntry topic=">" optimizedDispatch="true" />
> </policyEntries>
> </policyMap>
> </destinationPolicy>
>
> <persistenceAdapter>
> <kahaDB directory="${activemq.base}/data/kahadb"
> cleanupInterval="300000" checkpointInterval="50000"
> journalMaxWriteBatchSize="6400k"
> journalMaxFileLength="100g"
> indexCacheSize="100000" indexWriteBatchSize="100000"
> />
> </persistenceAdapter>
> <transportConnectors>
> <transportConnector uri="tcp://0.0.0.0:61616"/>
> </transportConnectors>
> </broker>
> </beans>
>
>
