offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello, 

We are using activemq version : 5.15.8

We are creating topics via config and also persisting the data via config : 

  

  


  

  

  


While doing so, we have noticed the below
1. Creation of topics via config is fast
2. But this leads to creation of "Offline Durable Topic Subscribers" with a
wrong state. 
3. From my understanding 1 client id is mapped to one subscription id which
is mapped to one topic. But this mapping always ends up in a different state
after a restart of the broker
Example : 
 
>From the above image you will see that after the restart of the broker,
correct client id goes in offline state and a wrong client id gets created
as active subscriber.

This causes incoming event to pile up, even though the config is correct.
The broker treats the active subscriber as non-active. 

Has anyone faced the same issue ?

Regards
Ashish




--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello Jean, 

I also noticed that even a simple restart of the broker, causes an
inconsistent stage of offline durable subscriber. 

Did you managed to find anything?

Regards
Ashish



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello JB, 

Were you able to reproduce the issue?

Regards
Ashish



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello JB, 

Just a info, i am creating topics from config as well. 

Today, I tried the below 
Replaced 

by

.

 
in my mkahadb config. I will still not able to solve the issue

Regards
Ashish



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello JB, 

Can you send me the config that you are using for persistence ? Have you
enabled any parameters ?

Regards
Ashish



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello JB, 

Do i need to create a Jira issue for the same or the issue created here is
more than enough?

Once you have a working config where you dont face the issue, please let me
know

Regards
Ashish 



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello Tim,

I have tried to change mkahadb to standard kahadb as well in my dev
environment. I still face the same issue. 

   
  


I will create a JIRA bug for the same. 

@JB would it be possible to share your config?

Regards
Ashish



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

I also created a ticket https://issues.apache.org/jira/browse/AMQ-7350



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello Tim,

Please find below the config 

Config with kahadb

http://www.springframework.org/schema/beans";
xmlns:amq="http://activemq.apache.org/schema/core";
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
xsi:schemaLocation="http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans.xsd
http://activemq.apache.org/schema/core
http://activemq.apache.org/schema/core/activemq-core.xsd";>

  

  file:${activemq.conf}/credentials.properties

  

  http://activemq.apache.org/schema/core";
brokerName="MQ-MY-BROKER-NAME" dataDirectory="${activemq.data}"
schedulerSupport="false" persistent="true">








  

  

  

  

  
  

  

  

  



  



  




  

  


  


  

  





  
  




  http://www.springframework.org/schema/beans";
class="org.apache.activemq.hooks.SpringContextHook" />

  
  
  





Config with mkahadb

http://www.springframework.org/schema/beans";
xmlns:amq="http://activemq.apache.org/schema/core";
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
xsi:schemaLocation="http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans.xsd
http://activemq.apache.org/schema/core
http://activemq.apache.org/schema/core/activemq-core.xsd";>

  

  file:${activemq.conf}/credentials.properties

  

  http://activemq.apache.org/schema/core";
brokerName="MQ-MY-BROKER-NAME" dataDirectory="${activemq.data}"
schedulerSupport="false" persistent="true">








  

  

  

  

  
  

  

  

  



  



  

  

  

  

  




  

  


  


  

  





  
  




  http://www.springframework.org/schema/beans";
class="org.apache.activemq.hooks.SpringContextHook" />

  
  
  


Regards
Ashish



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello Tim, 

I am setting the clientid in the file integration.camel.routes.xml, so that
on each restart my durable susbcriber is always recognized and unique. 

Regards
Ashish 



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello Tim, 

In reference to https://activemq.apache.org/sample-camel-routes 
Please find attached the config  camel.xml
  

my brokers are running in different jvm. i have a master slave setup in the
backend, so at one time only one if active. 

Regards
Ashish 



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello Tim, 

Sorry for the confusion. In my setup there are a lot of brokers which have a
similar config. WRT to hello/world example that i refered, the config would
look like
broker-1 : 

  
  


broker-2:

  
  


broker-3:

  
  

...

Regards
Ashish



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello JB, 

I have not set offlineDurableSubscriberTaskSchedule or
offlineDurableSubscriberTimeout explicitly in my activemq.xml file. 

Regards
Ashish 



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello Tim,

Your assumption is correct. And yes,*" reconnection logic the subscription
name is being 
constructed incorrectly "*

And yes : All my camel routes associated to a single broker run in a single
jvm. 

Regards
Ashish 






--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello Tim/JB,

Also one more information. I tried to reproduce the issue with 1 frontend
(with 1 topic) and 1 backend (with 1 camel route) and I was not able to
reproduce it. 

I saw the issue after 7/8 backend brokers with a lot of routes. 

Regards
Ashish 



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello Tim, 

What I meant wrt to 7/8 broker is as follows: 

1. I have one frontend broker which only have topics. These topics are then
subscribed by the backend broker
2. Each backend broker can have many routes, which means that a single
backend broker(with n number of queues) can subscribe to a lot of topics
which has its own subscription id.
3. I was not able to see the issue with one backend broker. So I started to
create more backend brokers. and when it reached 7 or 8 backend brokers, I
was able to see the issue. 
4. So *7/8* only means after starting 7 to 8 backend broker, I was able to
see the issue. 
5. So I just wanted to inform you that if you have one frontend broker and
one backend broker, then you might now be able to reproduce the issue

I am attaching a image that might be able to explain my setup 
 

All my camel routes associated to a single broker run in a single jvm.

We do not have any non-brokers/applications which subscribe to the topics.
All the subscriptions are only made by the backend broker queues.

Regards
Ashish  



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello Tim,

Did you see my comments?

Regards
Ashish 



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello Tim,

I have updated https://issues.apache.org/jira/browse/AMQ-7350, so that you
can reproduce the issue

Regards
Ashish 



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

https://issues.apache.org/jira/browse/AMQ-7350

[Ashish Vaishno]

Hello Tim, 

Can someone in your team pick up
https://issues.apache.org/jira/browse/AMQ-7350

Regards
Ashish 



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: offline Durable Topic Subscribers issue in activemq 5.15.8

[Ashish Vaishno]

Hello Tim, 

Did you manage to have a look on the issue?

Regards 
Ashish 



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

https://issues.apache.org/jira/browse/AMQ-7350

[Ashish Vaishno]

Hello All,

Can someone pick up this issue? I am unable to reach out to the
Jean-Baptiste Onofré or Christopher L. Shannon or Tim

Regards
Ashish



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html