Re: ActiveMQ Master Slave with ZooKeeper Session Expiration

2014-11-20 Thread James Black
Hi, I had the same issue with 2 ActiveMq 5.10 nodes and 3 ZooKeeper nodes. At first everything worked well but after long running stress tests we had the same situation were the master would step down and no node would become the new master. This would break our application and we were glad not

Re: JMS Exception in dlqDeliveryFailureCause

2014-09-12 Thread James Black
I have just encountered the above problem after starting to use the latest connection pool. Out of 10,000 messages in our tests we saw 10 going onto the DLQ and it did not take long for this to occur. org.apache.activemq activemq-pool 5.10.0 This was addressed by moving back to using

AMQ 5.10 Replication LevelDB 2 nodes

2014-09-11 Thread James Black
Hi, we are looking to move to using LevelDB replication after having performance problems with KahaDb and replication. This is on servers running Windows. Is replicated leveldb supported or recommended on Windows? We will only have 2 nodes to run ActiveMq on, one for the master and one for the

Re: Consumer performance problem with Tx

2014-09-08 Thread James Black
Hi Matt, we don't use JmsTemplate in this particular bit of code. I have done some testing this morning and the problem seems to be contention with the shared connection. The Spring DMLC is configured to cache at Connection, Session and Consumer level. If caching is enabled at all (connection+)

Re: Consumer performance problem with Tx

2014-09-04 Thread James Black
Hi Matt, thanks for the response. The reason that we have not migrated to a later version of ActiveMq is that we are looking to move away from using ActiveMq due to the problems we have had. Therefore, we wanted to avoid going through the whole testing process for a later version of ActiveMq. W

Consumer performance problem with Tx

2014-09-02 Thread James Black
Hi, I have a problem that when using transactions all my consumers for a particular queue are getting blocking waiting for the commit. We are using the Spring DMLC and are caching at the consumer level. This is ActiveMQ 5.5.1 All threads end up at a WAITING state with the same stack trace as be

Message Consumers slow, seemingly idle

2014-07-29 Thread James Black
Hi, we have a broker running good old ActiveMq 5.5.1. In the scenario I see a large number of messages on the queue: 5000, but when I do a thread dump to see the status of the consumers threads they are nearly always doing nothing: There are more producers than consumers, is this some sort of

Re: Client side producer flow control exception never thrown

2014-02-19 Thread James Black
After clearing down the queues using the admin console I can see that the store percent used is back to zero. However, this did not cause the blocking in our application to exit. After restarting our applications but not ActiveMq they were still blocked and unable to receive API requests. -- V

Client side producer flow control exception never thrown

2014-02-19 Thread James Black
Hi, sadly we once again find some problems with ActiveMq. We are using 5.5.1 but won't be upgrading as we'll probably move to a different message broker. Anyway the current issue is that with producer flow control enabled and with sendFailIfNoSpaceAfterTimeout set to 15000 (15s) we see no except

Producer flow control per queue

2014-01-16 Thread James Black
Hi, I have producer flow control enabled for all queues. My question is: if the memory limit for a specific queue is reached, is the producer client send an exception due to the setting of: sendFailIfNoSpaceAfterTimeout="15000" on the Broker. Or is the failure only sent if the broker limits are

Re: KahaDB indexCacheSize question

2012-07-20 Thread James Black
Should of added that this ActiveMQ 5.5.1 we are using. -- View this message in context: http://activemq.2283324.n4.nabble.com/KahaDB-indexCacheSize-question-tp4654198p4654202.html Sent from the ActiveMQ - User mailing list archive at Nabble.com.

KahaDB indexCacheSize question

2012-07-20 Thread James Black
Hi basically for KahaDB what is the exact meaning and implication of changing indexCacheSize? This defaults to 10,000 and I see our performance issues go away when it is increased to 50,000. Is this because there are active consumers and our messages can be acknowledged without having to write t

Client has different prefetch value from Broker, messages never consumed

2011-10-12 Thread James Black
Ok so we are trying to configure a prefetch of 0 on a few of our queues as it makes no sense for these to use prefetch. The default should still remain 1000. We have set the destinationPolicy for these queues with a wildcard:

Re: Spring JmsTemplate Messages not consumed depending on session ID

2011-10-06 Thread James Black
Hi as I said above we use the DMLC for nearly all of our consumption. However, the throttling requirements mean that we need more control over when messages are consumed for these particular elements of our application and we therefore turned to jmsTemplate. -- View this message in context: htt

Spring JmsTemplate Messages not consumed depending on session ID

2011-10-05 Thread James Black
Hello, we have an issue with our Spring application consuming from queues in ActiveMQ. Versions: Spring 3.0.5 ActiveMQ 5.5.0 All messages are persistent. We have a need to throttle the rate at which messages are consumed from 1 part of our application therefore we use the jmsTemplate to consume

Re: systemUsage and destinationPolicy config

2011-10-04 Thread James Black
Hi guys I have just tried this and the results do not match what you specified. *Test 01* If I set systemUsage -> memoryUsage = 20 MB and destinationPolicy -> memoryLimit = 1MB (globally to all queues with the < character) We are using the default cursor and ActiveMQ 5.5.0. We are using the NIO

systemUsage and destinationPolicy config

2011-10-03 Thread James Black
Hello, looking for some help around systemUsage and destinationPolicy configuration as I'm having some difficulty fully understanding the relationship between systemUsage, destinationPolicy, and flow control. All our messages are persistent! producerFlowControl is on. So we give ActiveMQ say a

Re: ActiveMQ JDBC Storage Slow down

2011-08-03 Thread James Black
Hi Gary, thanks again. Yes some of the queues grow larger than previously in terms of pending messages just before the tmp store is created. So we need to increase our memoryUsage under the systemUsage element of the broker configuration? Currently it will just be using the defaults. I was not

Re: ActiveMQ JDBC Storage Slow down

2011-08-03 Thread James Black
Hi, no there are no slow advisory messages in the logs. We used to receive these when using the topic and it would block our producers that added to the topic, but we have not seen this since we changed to a virtual topic. I'll try and arrange to capture some stack traces, the help is appreciate

Re: ActiveMQ JDBC Storage Slow down

2011-08-02 Thread James Black
Hi Gary, thanks for the info: AMQ journalling is disabled due to master/slave requirement. 8 queues, 1 topic with a virtual topic set up so we can have multiple consumers consuming from the topic at once. There are multiple consumers on every queue. All messages on all queues are persistent an

ActiveMQ JDBC Storage Slow down

2011-08-02 Thread James Black
Hi, we are testing Master/slave using a JDBC connection to Sql Server 2008R2. Everything is fine, though performance is not amazing but better than shared nothing, for the first roughly 20 hours. At a point about 20 hours in, the size of the queues just keeps growing and growing. It is at this

Using Apache Commons Daemon with ActiveMQ (Windows)

2011-06-29 Thread James Black
Hi does anyone have a way of using Apache Commons Daemon with ActiveMQ. I have followed the tutorial here: http://blog.bigrocksoftware.com/2010/10/07/commons-daemon-procrun-as-a-java-service-wrapper-for-activemq/ However, there is still an error: Error 109: The pipe has been ended when shutti

Re: Transaction not started XA problems

2011-06-13 Thread James Black
Ok ignore my previous message as that appears to be a separate issue. The problem with the transaction not started errors had not gone away but was simply not occurring, it came back on Friday but I now believe I have the root cause of the issue. The Atomikos JTA Properties documentation defines

ActiveMQ 5.5.0 Memory Leak / Spring DMLC

2011-06-10 Thread James Black
Hi issues with a possible memory leak in ActiveMQ 5.5.0. I've decided to open a new thread but this relates to my previous problem here: http://activemq.2283324.n4.nabble.com/Transaction-not-started-XA-problems-td3565540.html The issue we are seeing is that ActiveMQ (broker) is holding onto mem

Re: Transaction not started XA problems

2011-06-09 Thread James Black
Hi ok the problems seems to be that the connection is getting dropped by the ActiveMQ broker on the server. I have now verified that the issue occurs when ActiveMQ runs out of heap available. I have ran two specific tests. Note: Although these tests do not allocate that much heap to AMQ we have

Re: Transaction not started XA problems

2011-06-02 Thread James Black
Hi, first of thanks very much for the prompt suggestions. I have enabled Atomikos, ActiveMQ, and Spring JMS logging. The posts below show the logs both for a transaction that succeeds and one that fails. In both cases there is nothing on the queues to consume. In both cases the transaction is

Transaction not started XA problems

2011-06-01 Thread James Black
Hello, The situation is we want to use XA transactions for ActiveMQ and Hibernate (Sql Server 2008). We are using: Spring 3.0.5 Hibernate 3.6.2 ActiveMQ 5.5.0 Atomikos 3.7 We are seeing the following errors getting generated in the log file related to the transaction has not been started. Thes