Hello Ted,
Regarding Are the od-broker-1-[ms] connections configured via connectors or
listeners? ---> They are configured via connectors only below is an example.
#od-broker-1-m connector
connector{
name: od-broker-1-m
host: activemq-test-1.odprivatecloud.com
port: 61618
role: route-container
linkCapacity: 40
sslProfile: od-router-2-test-ssl-profile
verifyHostName: no #Since we have cert/hostname mismatches
#saslMechanisms: PLAIN
}
Ekta Awasthi,
________________________________
From: Ted Ross <[email protected]>
Sent: Tuesday, January 3, 2023 10:43 AM
To: Ekta Awasthi <[email protected]>
Cc: [email protected] <[email protected]>; Ajit Tathawade (CompuCom)
<[email protected]>; Nilesh Khokale (Contractor)
<[email protected]>; EAIOpsSupport <[email protected]>
Subject: Re: More than configured consumers count
[CAUTION: EXTERNAL SENDER]
Another question...
Are the od-broker-1-[ms] connections configured via connectors or listeners?
-Ted
On Tue, Jan 3, 2023 at 10:14 AM Ted Ross
<[email protected]<mailto:[email protected]>> wrote:
Happy New Year Ekta,
Are your micro-services message producers or consumers?
When you see the more-than-expected consumers in Hawtio, get the link status
from the routers using "qdstat -l". There _should_ be one link for each
auto-link as long as the targeted broker is reachable. This should provide
some clue as to what is happening.
-Ted
On Tue, Jan 3, 2023 at 10:01 AM Ekta Awasthi
<[email protected]<mailto:[email protected]>> wrote:
Hello Ted,
Thank you for your response.
We are using AutoLinks for our addresses. Below is an example of a autolink
queue in qdrouterd.conf for one activemq broker pair. Thanks
address {
prefix: test-queue
waypoint: yes
}
autoLink {
connection: od-broker-1-m
addr: test-queue
dir: in
}
autoLink {
connection: od-broker-1-m
addr: test-queue
dir: out
}
autoLink {
connection: od-broker-1-s
addr: test-queue
dir: in
}
autoLink {
connection: od-broker-1-s
addr: test-queue
dir: out
}
Ekta Awasthi,
________________________________
From: Ted Ross <[email protected]<mailto:[email protected]>>
Sent: Tuesday, January 3, 2023 8:47 AM
To: [email protected]<mailto:[email protected]>
<[email protected]<mailto:[email protected]>>
Cc: Ajit Tathawade (CompuCom)
<[email protected]<mailto:[email protected]>>; Nilesh
Khokale (Contractor)
<[email protected]<mailto:[email protected]>>;
EAIOpsSupport
<[email protected]<mailto:[email protected]>>
Subject: Re: More than configured consumers count
[CAUTION: EXTERNAL SENDER]
Hi Etka,
Can you tell us how you have configured the qdrouters to act as consumers? Are
you using auto-links or are you using link-routed addresses?
-Ted
On Wed, Dec 28, 2022 at 11:20 AM Ekta Awasthi
<[email protected]> wrote:
Hello,
Is this the right mailing DL for QPID related queries.
Just wondering as I have not heard back but given it is a holiday season, so I
will sit back and wait patiently for someone to reply.
Thanks In Advance.
Ekta Awasthi
________________________________
From: Ekta Awasthi
<[email protected]<mailto:[email protected]>>
Sent: Thursday, December 22, 2022 1:00 AM
To: [email protected]<mailto:[email protected]>
<[email protected]<mailto:[email protected]>>
Cc: Ajit Tathawade (CompuCom) <[email protected]>; Nilesh Khokale
(Contractor) <[email protected]>; EAIOpsSupport
<[email protected]<mailto:[email protected]>>
Subject: More than configured consumers count
Hi There,
We have few issues with the qpid-dispatch router where we are seeing multiple
consumers are getting created randomly by our qpid dispatch routers. We are
unable to trace nor able to replicate this issue in our lower env's. Below is
the architecture diagram.
I apologize if this isn't the right place to ask this question. In case there
is another place to communicate, do let me know as this is my first time
reaching out regarding qpid query😀 Please provide any suggestions or feedback
to help us understand this issue better. Thanks
Flow:
Microservice (Kubernetes) ---> NLB (Load balancer) ---> 2 Qpid-Dispatch Routers
acting up as consumers in front of brokers (1.16 version) ---> 4 Broker pairs
of activemq(2.18 version) masters and slaves (independent pairs)
Problem statement # 1
We are seeing more than the configured number of consumers count in our
activemq hawtio console causing messages to sit in delivering count which are
Un browsable since those messages are currently being delivered to its
consumers. Having only two qpid dispatch routers(acting as consumers) infront
of our activemq brokers, the count should always remain 2 but at times it is
going 3 sometimes 4. To resolve this issue, we are having to bounce the qpid’s
to release the stuck/bad consumer so that messages can be processed/consumed.
Problem statement # 2
At times we see messages going to delivering count even when there are only two
configured consumers(2qpids) showing in activemq hawtio console. We don't know
the cause to why the messages get stuck in delivering count. To resolve this,
we tried restarting the consumer service but that did not help. Next up we
tried restarting the brokers, that did not help and noticed that all the stuck
delivering messages, the broker slowly replayed back and Eventually the stuck
messages came back to delivering count post broker restart. To resolve this
issue, we are having to bounce the qpid’s to release the messages and that
fixes the issue.
Version of qpid-dispatch router
qpid-dispatch-router-1.16.0-1.el7.x86_64.rpm
qpid-dispatch-tools-1.16.0-1.el7.noarch.rpm
Ekta Awasthi
CONFIDENTIALITY NOTICE: The information contained in this email and attached
document(s) may contain confidential information that is intended only for the
addressee(s). If you are not the intended recipient, you are hereby advised
that any disclosure, copying, distribution or the taking of any action in
reliance upon the information is prohibited. If you have received this email in
error, please immediately notify the sender and delete it from your system.
