Re: Artemis JMX authorization in broker.xml

2024-04-08 Thread Gary Tully
Good news, thanks for closing the loop. thanks for your feedback. I have updated the doc a little to make the need to remove the authorisation section more clear. in particular, replaced should with MUST https://github.com/apache/activemq-artemis/commit/4d6fc39560d0d26fdbecea14de74eee35f2941f9 th

Re: Artemis JMX authorization in broker.xml

2024-04-03 Thread Gary Tully
inline On Wed, 3 Apr 2024 at 15:43, MILOVIDOV Aleksandr wrote: > Hi Team, > > I'm trying to enable and test new feature which was developed in > ARTEMIS-4582 - add view and edit permissions to extend security-settings > rbac for management operations. > great :-) > > I tried to configure JMX a

Re: Message loss on ActiveMQ Artemis

2023-10-03 Thread Gary Tully
I think you are seeing a bug that I resolved in the past few weeks - https://issues.apache.org/jira/browse/ARTEMIS-4418 the openwire client prefetched messages can get out of sequence and the delivery count can get updated in error. I think 2.31.0 will help. an alternative approach would be to use

Re: Artemis MQ with JDBC persistence not starting since 2.22 update

2022-05-31 Thread Gary Tully
it looks like you may need to delete the lock table, that column has changed type in 2.22 see: https://github.com/apache/activemq-artemis/commit/101c0d2cd0f4127592f1817c52ab595359bc9b85#diff-6b567f39f4a9afa111f142768da46e6139b53ac2879517ca2c3745c2481b5f07R40 On Tue, 31 May 2022 at 17:04, Stephen

Re: Artemis duplicate detection

2022-02-17 Thread Gary Tully
he.org/components/artemis/documentation/latest/configuration-index.html > https://github.com/apache/activemq-artemis/blob/main/artemis-server/src/main/resources/schema/artemis-configuration.xsd > > Thanks > Brad > > -Original Message- > From: Gary Tully > Sent: Wednesd

Re: Artemis duplicate detection

2022-02-16 Thread Gary Tully
The fix in https://issues.apache.org/jira/browse/ARTEMIS-3521 gives you the option to disable the use of duplicate id by the openwire protocol adapter. see example usage in the test: https://gitbox.apache.org/repos/asf?p=activemq-artemis.git;a=blob;f=tests/integration-tests/src/test/java/org/apache

Re: Artemis high availability in Kubernetes

2022-02-14 Thread Gary Tully
if you are using multiple brokers, it is best to distribute across pods, such that a single pod failure do not result in a complete outage. On Fri, 11 Feb 2022 at 15:10, Thai Le wrote: > > Hi guys > Thank you very much for sharing. > @Vilius I have tried the artemis-operator and the setup is much

Re: Artemis high availability in Kubernetes

2022-02-11 Thread Gary Tully
Hello, the reconnect issue? How are your clients configured? Do they get topology from the pair of brokers on kube? -- On re-connection: failover with the Artemis jms client will only occur between pairs. It is restricted in that way to protect users of temp queues and durable subs, b/c those re

Re: Artemis - dealing with variable consumer performance on a large cluster

2022-01-26 Thread Gary Tully
Hi Graham, I have a lot of questions, in particular on the need for 32 brokers but those can wait! this is tricky, redistribution based on remote demand when local demand is low is very difficult to get right. The fundamental problem is moving messages (data) to consumers, trying to do it fast (w

Re: Confusion with Persistence

2022-01-25 Thread Gary Tully
It does not keep two copies of the data, is is more that journal files that are candidates for deletion are archived or retained rather than being deleted. if the data is still in the journal, then it won't exist in the retention folder. send and consume more messages such that compaction would cl

Re: Artemis cluster topology and external clients

2022-01-13 Thread Gary Tully
(master -> > slave -> master)? > > -- > Vilius > > -Original Message- > From: Gary Tully > Sent: Wednesday, January 12, 2022 7:30 PM > To: users@activemq.apache.org > Subject: Re: Artemis cluster topology and external clients > > that makes sens

Re: Artemis cluster topology and external clients

2022-01-12 Thread Gary Tully
you have ideas what could be going on? We are using Camel library with > Spring Framework for our messaging. My theory is that without > reconnectAttempt parameter Artemis client itself doesn't try to reconnect, > but Camel (or Spring) somehow takes addresses from URL and reconnect

Re: Artemis cluster topology and external clients

2022-01-12 Thread Gary Tully
there is a problem here, currently there is no way to "transform" the host information in the topology update commands. the topology is used for ha and for loadbalancing and the client will always end up with the internal dns name via the topology update. This needs an enhancement, some thing alon

Re: Question about charset supported by Artemis

2021-12-02 Thread Gary Tully
I think so, a test is the only way to be sure. my bet is sending a text message from openwire with a mix of UTF-8 and UTF-16 characters will end up in the same state. Openwire will marshallUTF (not it is not 8 or 16) that will use 2 or 3 or N bytes as required. the UTF8 decoder on the server that

Re: Question about charset supported by Artemis

2021-11-30 Thread Gary Tully
can you post some code and/or the exception stack trace? On Tue, 30 Nov 2021 at 08:46, BRASSEUR Pierre-Henry wrote: > > > Hello, > > I would like to know if Artemis can support other charset than UTF-8? > > The post of message in charset ISO-8859-15 was working with previous version > ActiveMQ 5

Re: ArtemisMQ 2.15 Messages stuck internal cluster connection queue $artemis.internal...

2021-11-12 Thread Gary Tully
I would have thought redistributionDelay > 0 would be the answer here, but I have not verified. On Fri, 12 Nov 2021 at 16:40, foo bar wrote: > > Hello, > > We lost one of the nodes in our cluster. After we recreated it, we noted > that there are cluster connection queues ($artemis.internal queues

Re: ActiveMQ redeliveryPolicy not working as documented?

2021-11-12 Thread Gary Tully
note, in Artemis, there is only broker side redelivery, so it is easier to comprehend and configure at the address level https://activemq.apache.org/components/artemis/documentation/latest/undelivered-messages.html On Fri, 12 Nov 2021 at 10:10, Gary Tully wrote: > > the doc may not be

Re: ActiveMQ redeliveryPolicy not working as documented?

2021-11-12 Thread Gary Tully
the doc may not be in the correct place, your link if for client side redelivery. There are two types of redelivery, client side and server side via the plugin. Server side kicks in when the client side ends. Note from one of the tests, to have 'only' the server side plugin do work, the client sid

Re: Network of brokers and priority network links

2021-11-04 Thread Gary Tully
; > > Tim > > > > On Tue, Nov 2, 2021, 4:56 AM Paul Burgess > > wrote: > > > > > Hi Gary, > > > > > > Thank you for the reply, both solutions would be perfect for what I need. > > > > > > With the first suggestion, I am

Re: Network of brokers and priority network links

2021-11-02 Thread Gary Tully
there is one tweak with org.apache.activemq.network.NetworkBridgeConfiguration#setConsumerPriorityBase which could be used to bias the fast links, set that to -1 for the fast links and the others will default to -5, so even with more brokers the fast links will have "higher" priority. the other op

Re: Artemis 2.18.0 is filling all the disc with oldreplica files

2021-10-29 Thread Gary Tully
r 80 GB on oldreplica," how are > >>>>> you > >>>>> measuring this? Can you provide a listing of the files? > >>>>> > >>>>> Can you provide steps to reproduce the behavior you're observing? > >>>>>

Re: Keycloak confidential access type for Artemis admin console

2021-10-26 Thread Gary Tully
yes. see the detail at: https://github.com/hawtio/hawtio-oauth it utilises the keycloak javascript client - https://www.keycloak.org/docs/latest/securing_apps/#_javascript_adapter On Mon, 25 Oct 2021 at 18:30, Thai Le wrote: > > Hello, > > In the security-keycloak example, the client artemis-cons

Re: Unable to validate user from Management. Username: null; SSL certificate subject DN: unavailable

2021-10-20 Thread Gary Tully
I think it may be that the user/pass used for the send comes from the preferences panel in hawtio and it seems it is null in this case. from the readme - https://github.com/apache/activemq-artemis/tree/main/examples/features/standard/security-keycloak#readme "Navigate to the Info address and send a

Re: Plans for OpenWire Protocol Feature in Artemis

2021-10-20 Thread Gary Tully
Openwire protocol support is an important part of the migration strategy, it is being actively maintained and there are no plans to deprecate it. the good news too, because all of the protocols are nicely modularised in Artemis, it can have a life of its own to some extent and be added anywhere it

Re: Artemis 2.18.0 is filling all the disc with oldreplica files

2021-10-19 Thread Gary Tully
use max-saved-replicated-journals-size=0 may be your best option. first: understand the value in max-saved-replicated-journals-size > 0 I can be used to limit data loss in the case of catastrophic failure. One scenario where it can be useful is as follows: A primary is active, a backup begins to

Re: Some questions about artemis

2021-10-12 Thread Gary Tully
can you post your client code that I presume is currently using and Advisory Consumer just so we can understand exactly what information is being used? the equivalent in Artemis are notifications[1]. Is the use case an existing OpenWire consumer that must be retained? it may be possible to use a d

Re: Does Artemis call System.exit(*) on the JVM after logging the message: AMQ221002: Apache ActiveMQ Artemis Message Broker version 2.11.0 [9f2633f9-78a1-11ea-8d51-0050569d6b43] stopped, uptime 3 day

2021-09-02 Thread Gary Tully
note the doc: https://activemq.apache.org/components/artemis/documentation/latest/critical-analysis.html - it should just log the error unless configured to do otherwise On Mon, 30 Aug 2021 at 23:06, Youyu Shao wrote: > > Hi, > > We have being using Artemis 2.11.0 for a while. Recently we had an

Re: question on ActiveMQ advisory messages for large cluster

2021-05-21 Thread Gary Tully
09:14, Dondorp, Erwin wrote: > > Gary, > > How does that work when a duplex connection is used... > Are the dynamicallyIncludedDestinations then applied in both directions? > > thx, > Erwin > > -Oorspronkelijk bericht- > Van: Gary Tully > Verzonden: dond

Re: question on ActiveMQ advisory messages for large cluster

2021-05-20 Thread Gary Tully
peek at: https://github.com/apache/activemq/blob/main/activemq-broker/src/main/java/org/apache/activemq/network/NetworkBridgeConfiguration.java#L308 when dynamicallyIncludedDestinations are configured, the set of advisories that are subscribed to, will be restricted to just those. On Thu, 20 May

Re: How to disable producerFlowControl in Apache Artemis

2021-05-10 Thread Gary Tully
That configuration is not exposed in the Artemis OpenWire protocol implementation, it is false by default. Async sends will not accumulate in memory when there is no credit/resources on the broker. what behaviour do you wish the control with this setting? On Sat, 8 May 2021 at 15:22, Imran Raza K

Re: Seeing some AIO issues in artemis-2.16.0 and artemis-2.17.0

2021-04-30 Thread Gary Tully
>From peeking at the fix: we wait 60 seconds, warn and give up if a close seems to be stalled/pending. However the stack trace will be for the waiter, rather for the initial close call. before the change the broker would exit. please open an issue with the stack trace, there is no point printing t

Re: Problems/inconsistency displaying message content for "large messages" in Apache Artemis 2.17.0 including hawtio 2 console

2021-04-28 Thread Gary Tully
Hi Magnus, I recently limited the amount of data that is returned via JMX/management, with a default of 256 bytes[1]. For large messages, the body should be a string "large message", ensuring that just to browse large messages does not require us to load the message body into memory on the broker o

Re: downstream federation and ssl in artemis

2021-04-19 Thread Gary Tully
I think it should work, the TLS configuration is independent. the callback is the "name" of the connector/locator I guess if you can narrow it down a little, and maybe generate logging with system property -Djavax.net.debug=all it may be clear what is going wrong. On Sun, 18 Apr 2021 at 16:49, Do

Re: question on expiry of paged messages

2021-03-31 Thread Gary Tully
I see the related jira. some further comments on there https://issues.apache.org/jira/browse/ARTEMIS-3214?focusedCommentId=17312236&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17312236 On Wed, 31 Mar 2021 at 00:52, Clebert Suconic wrote: > > Just a heads up. > >

Re: send message

2021-03-23 Thread Gary Tully
maybe take inspiration from https://github.com/apache/activemq-artemis/blob/master/tests/integration-tests/src/test/java/org/apache/activemq/artemis/tests/integration/client/MessageBufferTest.java that passes a string, but there are corresponding byte[] or buffer variants in the api. If you want to

Re: Artemis divert from a queue to a topic

2021-03-09 Thread Gary Tully
I *think* you may need to specify the routing type on the divert, coming from a queue it may default to ANY_CAST. use: my_queue my_topic false MULTICAST On Tue, 9 Mar 2021 at 09:49, Petrenko, Vadim wrote: > > Dear Artemis developers, > > I'd like to set up Artemis in suc

Re: Artemis and ActiveMQ 5.x advisory messages

2021-03-09 Thread Gary Tully
: org.apache.activemq.artemis.tests.integration.divert.DivertTest#testDivertedNotificationMessagePropertiesOpenWire https://github.com/apache/activemq-artemis/blob/master/tests/integration-tests/src/test/java/org/apache/activemq/artemis/tests/integration/divert/DivertTest.java#L68 On Wed, 3 Mar 2021 at 12:55, Gary Tully wrote

Re: Artemis and ActiveMQ 5.x advisory messages

2021-03-03 Thread Gary Tully
not at the moment. There are a subset of advisory messages produced, but those are around temp destination creation. ideally the full set of advisories would be implemented via a broker plugin. https://activemq.apache.org/components/artemis/documentation/latest/broker-plugins.html for the consume

Re: Stability issue

2021-02-08 Thread Gary Tully
I resolved some issues with negative address sizes in 2.16.0, it related to multicast wildcard addresses which could apply to advisory messages. https://issues.apache.org/jira/browse/ARTEMIS-2768 I would suggest moving to 2.16.0 There were also some known issues with openwire advisory support re

CVE-2021-26117: ActiveMQ: LDAP-Authentication does not verify passwords on servers with anonymous bind

2021-01-27 Thread Gary Tully
Description: The optional ActiveMQ LDAP login module can be configured to use anonymous access to the LDAP server. In this case, for Apache ActiveMQ Artemis prior to version 2.16.0 and Apache ActiveMQ prior to versions 5.16.1 and 5.15.14, the anonymous context is used to verify a valid users passw

CVE-2021-26118: Flaw in ActiveMQ Artemis OpenWire support

2021-01-27 Thread Gary Tully
Description: While investigating ARTEMIS-2964 it was found that the creation of advisory messages in the OpenWire protocol head of Apache ActiveMQ Artemis 2.15.0 bypassed policy based access control for the entire session. Production of advisory messages was not subject to access control in error.

Re: Does Artemis expose the version of embedded web server software?

2020-11-10 Thread Gary Tully
it does not: see: https://issues.apache.org/jira/browse/ARTEMIS-1826 added same to the jira On Tue, 10 Nov 2020 at 03:16, Tim Bain wrote: > > https://issues.apache.org/jira/browse/AMQ-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17228718#comment-172

Re: ActiveMQ Artemis Roadmap

2020-08-26 Thread Gary Tully
Hi Weihao Li, Can you expand on the features that you require that are missing? We are still committed to making migration as easy as possible. Kind regards, gary On Wed, 26 Aug 2020 at 15:23, Weihao Li wrote: > Hi, > > Sorry if this is not the correct mailing list. > > We are loyal Active MQ u

Re: Why do my messages get stuck (in StoreQueueCursor?)

2020-08-20 Thread Gary Tully
There is a lot of relevant detail in https://issues.apache.org/jira/browse/AMQ-6215 and a test case that shows how to best achieve true priority dispatch. It is always a trade off between page in from the store for dispatch (or other reasons to have messages in memory) and prefetch to active consum

[ANNOUNCE] CVE-2020-13932 Apache ActiveMQ Artemis - Remote XSS in Web console Diagram Plugin

2020-07-20 Thread Gary Tully
Apache ActiveMQ Artemis - Remote XSS in Web console Diagram Plugin Severity: Medium Vendor: The Apache Software Foundation Affected Version: Apache ActiveMQ Artemis 2.5.0 to 2.13.0 Vulnerability details: A specifically crafted MQTT packet which has an XSS payload as client-id or topic name can

Re: How to access KahaDB db.data in activeMQ-5.15.0 ?

2020-05-20 Thread Gary Tully
there is: https://github.com/apache/activemq-cli-tools/tree/master/activemq-kahadb-exporter On Wed, 20 May 2020 at 10:16, Jean-Baptiste Onofre wrote: > > Hi, > > You can: > > 1. Use JMX to browse the queue (directly or via REST thanks to Jolokia) > 2. Use admin console > 3. Use any client (inclu

Re: Artemis JMX connection

2020-02-26 Thread Gary Tully
I gave that a whirl on a new build today. I added a user during artemis create.. and I used that identity with the insecure jconsole connection using service:jmx:rmi:///jndi/rmi://localhost:1099/jmxrmi providing user/password credentials the mbean server has an authenticator that delegates to jaas

Re: JMS QueueBrowser does not return actual number of messages in the queue

2019-06-25 Thread Gary Tully
with optimizedDispatch=true, the queue dispatch thread is redundant (the thread that reads a message does the dispatch) and does not get to service a browse repeatedly. it turns a browse into a one shot operation. The benefits of optimizedDispatch=true are really only apparent with straight through

Re: JMS QueueBrowser does not return actual number of messages in the queue

2019-06-25 Thread Gary Tully
there is a policyEntry maxBrowsePageSize with default value 400, increase that value to see a different result. ` On Mon, 24 Jun 2019 at 16:11, cooshal wrote: > > Hi again: > > I checked further stuffs on this issue, and I think I am not able to fetch > JMS Messages > 400, because of optimizedDi

Re: [artemis] clustering & msg redistribution design questions

2019-06-20 Thread Gary Tully
Hi Dan, how far did you go with qpid dispatch? http://qpid.2158936.n2.nabble.com/Dispatch-Router-questions-td7664965.html To my mind, having an intermediary (qpid dispatch) route messages from their source with end to end flow control, rather than doing store and forward is the best approach. Or

Re: Is it possible to retrieve more than 400 messages from ActiveMQ queue via Jolokia API?

2019-04-16 Thread Gary Tully
that maxBrowsePageSize limit is exposed as a destination policyEntry, you can raise it very high and then a browse will be limited by the memory usage limits. the point of the limit is that the messages are dispatched from memory, there is no browser implementations that will query the message stor

Re: weird sql jdbc statements

2018-03-02 Thread Gary Tully
that 'sequence' is for migration, when the PK exists and needs to be modified. you should simplify if you are going to specify statements via configuration. On Sun, 25 Feb 2018 at 17:09 Илья Шипицин wrote: > hello, > > I'm struggling with mssql, the following lines are strange > > > https://git

Re: Question about rollbackOnlyOnAsyncException (AMQ-3166)

2018-02-14 Thread Gary Tully
XA transactions? normally the transaction is on the session and connection... so any async call will complete before the commit.. unless maybe nio is mixing this up some. do you have some code that will show the rollbackOnlyOnAsyncException case where the tx is null. There is a test case that can

Re: Question about rollbackOnlyOnAsyncException (AMQ-3166)

2018-02-14 Thread Gary Tully
in addition, try the latest Artemis release, there has been a bunch of work on latency w.r.t gc on exactly that flat send latency (reliable enqueue) use case. On Wed, 14 Feb 2018 at 14:29 Gary Tully wrote: > transaction commit is a sync operation... if an async send in a > transaction

Re: Question about rollbackOnlyOnAsyncException (AMQ-3166)

2018-02-14 Thread Gary Tully
transaction commit is a sync operation... if an async send in a transaction fails, then the commit will rollback via: rollbackOnlyOnAsyncException w.r.t spikes in send, have you enabled the preallocation strategy on kahadb, it may be worth toggling to see the effect in your env. Also, ackCompactio

Re: what value of networkTTL need to use for synchronous request and reply in network connectors

2018-02-14 Thread Gary Tully
In the event of connection failures there is a good chance of loosing messages. If you are about messages and replies then use real queues, maybe have a reply queue per process or per application and use selectors based on the correlation id if you need to multiplex. The lifetime of a temp queue i

Re: Performance issue with Oracle backed AMQ

2018-02-02 Thread Gary Tully
there was some work on limiting queries: https://issues.apache.org/jira/browse/AMQ-6049 also - the statements can be configured - so you can provide your own statement via configuration. http://activemq.2283324.n4.nabble.com/Statements-in-Activemq-Xml-Jdbcpersistence-adapter-td4668983.html On Fr

Re: Async Writer Thread Shutdown error adding a message on 5.15.2 broker

2018-01-16 Thread Gary Tully
the storage to which the temp files are written. > > Tim > > On Jan 12, 2018 4:04 AM, "Gary Tully" wrote: > > > this looks like an instance of the regression from > > https://issues.apache.org/jira/browse/AMQ-6815 > > > > On Wed, 10 Jan 2018 at 19:42 ne

Re: Async Writer Thread Shutdown error adding a message on 5.15.2 broker

2018-01-12 Thread Gary Tully
this looks like an instance of the regression from https://issues.apache.org/jira/browse/AMQ-6815 On Wed, 10 Jan 2018 at 19:42 neon18 wrote: > We run the broker with max heap of 4G and initial of 1G (-Xmx4G -Xms1G). > We use non-persistent messages on these particular queues (3 of them in > this

Re: UseDedicatedTaskRunner configuration

2018-01-04 Thread Gary Tully
that looks like a bug, the default configuration should be consistent across the start scripts On Wed, 3 Jan 2018 at 13:41 alprausch77 wrote: > Hello. > > The documentation > ( > http://activemq.apache.org/how-do-i-configure-10s-of-1000s-of-queues-in-a-single-broker-.html > ) > states that the D

Re: ActimeMQ runtimeConfigurationPlugin doesn't work as expected

2017-12-07 Thread Gary Tully
it may be tricky, simplest may be to cycle the broker when permissions are removed or remove/add the transportconnector such that all connections recycle. There are no system topics that allow modification in that way, the advisory topics are read only. JMX gives an alternative route to explore if

Re: ActimeMQ runtimeConfigurationPlugin doesn't work as expected

2017-12-06 Thread Gary Tully
That is as expected. There auth happens at new connection time, there is nothing that tracks existing connections and boots them out. On Tue, 5 Dec 2017 at 22:52 zaptos wrote: > Hello! > I've been configured ActimeMQ as MQTT broker using > *jaasAuthenticationPlugin > & runtimeConfigurationPlugin

Re: Why the source package of “selector” is empty?

2017-12-05 Thread Gary Tully
those are generated classes from https://github.com/apache/activemq/blob/master/activemq-client/src/main/grammar/SelectorParser.jj On Mon, 4 Dec 2017 at 14:23 softwbc wrote: > < > http://activemq.2283324.n4.nabble.com/file/t377159/QQ%E6%88%AA%E5%9B%BE20171204161238.jpg > > > > I look at several

Re: Artemis Disaster Recovery options

2017-11-30 Thread Gary Tully
> > > What if any file/directory management would need to be done on the > secondary DC file structure if doing a straight file copy. I wouldn't want > to copy the whole directory every 15 minutes for example, but rather just > reflect the changes. > > There is a challenge with just copying change

Re: [DISCUSS] Confusion surrounding the ActiveMQ project roadmap

2017-11-23 Thread Gary Tully
I think ActiveMQ needs a roadmap for sure and I think Artemis is the future for a bunch of technical reasons. Without a clear direction going forward we will loose adoption because I don't know anyone who likes making a choice. If you are an existing ActiveMQ user there should be a clear path for

Re: ActiveMQ DLQ issues

2017-11-20 Thread Gary Tully
dlqDeliveryFailureCause java.lang.Throwable: TopicSubDiscard. ID:localhost->fmiuseastp01-63022-1486246061090-100948:1:1:2 The cause indicates the a subscriber is full and has been configured to discard messages[1]. See policyEntry from the default config [2] https://github.com/apache/activemq/blo

Re: Re-ordering of messages - Artemis

2017-11-17 Thread Gary Tully
It is interesting... the entire index is in memory, and I noticed a jmx operation that will swap the priority of a message, it just means moving it between priority lists in the in memory index[1]. Ordering would be more expensive by far, but by replacing the priority lists with some sort of ordere

Re: Virtual destination subscription durability and message recovery

2017-11-15 Thread Gary Tully
#2 is a problem - when the name of the subscription queue will be unknown. If you know the names in advance then statically creating the destinations will work. You could go down the plugin route and implement/manage a shared retroactive queue SRQ Intercept send to the virtual topic to forward a

Re: Using failover with updateClusterClients, which one has precedence?

2017-11-02 Thread Gary Tully
It is sorted by the order in which brokers network to each other. A newly restarted broker will be appended to that list. With rebalance, each new connection gets a different first element. see: https://git-wip-us.apache.org/repos/asf?p=activemq.git;a=blob;f=activemq-broker/src/main/java/org/apach

Re: Using failover with updateClusterClients, which one has precedence?

2017-10-26 Thread Gary Tully
yes, that is the intent. The broker makes the decision and when it does round robin or random there should be a reasonable distribution. The issue when it is left to clients is they can all behave the same - as in non random random. With updateClusterClients the only random selection lives in the b

Re: StorePercentUsage not reported when running Broker embedded

2017-06-21 Thread Gary Tully
there are some smarts in xbean that set the persistence adapter reference for the storeUsage. I think in your case that link is lost. Start with: SystemUsage usage = org.apache.activemq.broker.BrokerService#getSystemUsage then make your mods to the members in that and there necessary associations

Re: Virtual Destination fowarding with Selectors in ActiveMQ 5.14

2017-05-10 Thread Gary Tully
that would require a different plugin. one thought, you could have a wildcard consumer of sorts that would cause a match (if it is possible to exclude all other know selector properties) and the selector cache plugin would keep that chap alive. In that way these messages could get trapped in a dest

Re: Need help to Improve ActiveMQ performance

2016-07-04 Thread Gary Tully
to have a guarantee the fsync is necessary. possibly move the index to a separate disk to reduce contention. To boost throughput, have multiple connections publishing at the same time. In this way, multiple parallel sends will get the benefit of a batched fsync. On Sat, 2 Jul 2016 at 19:32 RaghuB

Re: How fileCursor works? AMQ5.9.1

2016-02-10 Thread Gary Tully
any chance persistent=false is set on the broker? post your full xml config and peek at the unit test source for flow controll of memory limit tests to get working examples On Thu 4 Feb 2016 4:21 AM fengcanyue <153133...@qq.com> wrote: >

Re: What is duplicate delivery poison ack?

2015-12-08 Thread Gary Tully
I think https://issues.apache.org/jira/browse/AMQ-5854 is what you need. In short, it is not feasible to try and retain transaction integrity for consumed messages when a failover event happens. In your case, the transaction will rollback and the message will go to the dlq. The scenario is that th

Re: Stress & Load Testing Tools

2015-12-04 Thread Gary Tully
have a read of http://blog.christianposta.com/benchmarking-your-jms-layer-with-an-open-source-jmstester-tool-from-fusesource/ On Mon 30 Nov 2015 2:28 PM Basmajian, Raffi wrote: > I'm looking for test harnesses to produce various types of load for soak, > stress, and performance testing. Quick go

Re: What happens with JMSRedelivered when server moves message to DLQ

2015-11-12 Thread Gary Tully
} > > should also set md.setRollbackCause(e) in the else clause? > > - Martin > > -- > *From:* Martin Lichtin > *To:* Gary Tully ; ActiveMQ Users < > users@activemq.apache.org> > *Sent:* Wednesday, November 4, 2015 12:32 PM > > > *Sub

Re: What happens with JMSRedelivered when server moves message to DLQ

2015-11-04 Thread Gary Tully
that is intended. the dlq enqueue is a new message. the poison cause property will have some good information but it would make sense to add a property that captures the value of that counter. the only issue is that the value is typically interpreted client side and remains 1 on the broker so it ma

Re: Priority Support

2015-09-22 Thread Gary Tully
the jdbc store supports 0-9. in kahadb there is an index per priority which makes queries a little slower. Currently there is no way to disable the priority checks in kahadb. Supporting 3 priorities is a trade off between functionality and perf in the general case. On Tue, 8 Sep 2015 at 11:59 Mart

Re: Rfresh org.apache.activemq.broker.SslContext from disk/jks content

2015-06-25 Thread Gary Tully
it is a limitation. the thread local allows the different connectors to find the brokers context, so that network connector and discovered transports can find an appropriate context. This makes it simple to configure (broker wide) but difficult to modify and difficult to have per endpoint ssl optio

Re: Tracing ActiveMQ requests...

2015-06-05 Thread Gary Tully
have you run with trace=true on the transport urls. this will log4j trace each openwire command on a per connection logger so that you can at least identify the actual command that is taking time. connection creation. producer creation, message send etc. On 30 May 2015 at 00:06, Kevin Burton wrot

Re: Memory leak in JDBC Message Store

2015-05-15 Thread Gary Tully
did you try running without the journal? ie: replace ... with: On 15 May 2015 at 09:17, Denary wrote: > Hello. Recently I've faced with weird problem, actually I'm not sure if it's > a bug or misconfiguration or something else. But since my broker has > "almost" def

Re: “Usage" and other performance improvements by avoiding CopyOnWriteArrayList.

2015-05-07 Thread Gary Tully
those changes look ok to me, as in they won't break anything and you have numbers that can make your case. Please splash in a patch or PR. On 2 May 2015 at 23:08, Kevin Burton wrote: > I’ve found 3 places where CopyOnWriteArrayList was being used and causing > significant performance impact O(N^2

Re: Does JMS priority work with “small" maxPageSize ?

2015-05-06 Thread Gary Tully
that is true, the dispatch goes through the cursors in batches once memory (or the cursor cache) is exhausted. For durable subs, there is the ability to bypass the paged in messages, see: https://github.com/apache/activemq/blob/165959e25007271f8cdfdcf72641b9a92483ef40/activemq-unit-tests/src/test/j

Re: Message Grouping Retry Policy

2015-04-24 Thread Gary Tully
he message is in a message group or not." Does that cover it? > > Tim > > On Fri, Apr 24, 2015 at 7:43 AM, Gary Tully wrote: > >> there is some good info in https://issues.apache.org/jira/browse/AMQ-1853 >> >> short answer: the ordered blocking consumer side is

Re: Message Grouping Retry Policy

2015-04-24 Thread Gary Tully
there is some good info in https://issues.apache.org/jira/browse/AMQ-1853 short answer: the ordered blocking consumer side is configurable but it is independent of jms message groups On 6 April 2015 at 11:09, cduvvuri wrote: > Would ActiveMq holds ordered messages delivery until the first messag

Re: DLQ, cause:null

2015-04-24 Thread Gary Tully
ny other possible causes of > redelivery that I don't know about? > > Tim > On Apr 24, 2015 4:59 AM, "Gary Tully" wrote: > >> to avoid the redelivered messages getting sent to the DLQ, changing >> the default redelivery policy max from 6 to infinite will help. &

Re: DLQ, cause:null

2015-04-24 Thread Gary Tully
latest hawt.io jar and connected to this broker, > however the Health and Threads parts are entirely blank. The queues are all > visible yet "browse" of ActiveMQ.DLQ shows none of the 3,000+ accumulated > messages. Wondering where to go next? > > Thanks, > > James > &

Re: DLQ, cause:null

2015-04-23 Thread Gary Tully
what sort of timeout is on the receive(...) from spring dmlc, and what is the prefetch for that consumer. It appears that the message is getting dispatched but not consumed, the connection/consumer dies and the message is flagged as a redelivery. then the before delivery check on the delivery count

Re: selectors don't browse?

2015-04-22 Thread Gary Tully
the maxPageSize destination policy entry controls how many messages are in memory to be dispatched. That value needs to be large enough to deal with sparse selectors. Essentially at the moment, selectors only match in memory. There is nothing that will iterate over the store to find matches. On 22

Re: Monitoring producer flow control.

2015-04-22 Thread Gary Tully
https://issues.apache.org/jira/browse/AMQ-4635 may lelp. there is also a destination statistic for blocked sends that could be monitored and there is an advisory that fires when a dest is full. On 17 April 2015 at 03:25, Kevin Burton wrote: > I’m looking at implementing producer flow control so t

Re: DOS attack on activemq setup

2015-04-14 Thread Gary Tully
I am thinking of a consumer that subscribes to a wildcard that will match all destinations, the mqtt support has made that possible. It is easy to consume all messages. Or subscribe to a composite will all dests in there. It could make sense to deny composites or multi matching wildcards if they wo

Re: DOS attack on activemq setup

2015-04-14 Thread Gary Tully
correct, there is only storeUsageHighWaterMark On 14 April 2015 at 12:01, xabhi wrote: > Hi gary, > In http://activemq.apache.org/per-destination-policies.html > the > *memoryLimit* option refers to only memoryUsage part of systemUsage

Re: DOS attack on activemq setup

2015-04-13 Thread Gary Tully
Abhi, that is a problem. The best we have at the moment is via https://issues.apache.org/jira/browse/AMQ-2668 Having per adapter limits respected by the broker in the mkahadb case would be a nice enhancement. On 13 April 2015 at 15:10, xabhi wrote: > I just thought of another case where broker

Re: DOS attack on activemq setup

2015-04-09 Thread Gary Tully
some work has been done in this area. there are connection limits (on a transport connector) and message size limits on openwire. there are currently no destination or producer/consumer number limits. Flow control helps but in a very dynamic environment it is difficult to get appropriate limits t

Re: Does MessageStore.getMessage need to be fast?

2015-04-07 Thread Gary Tully
peek at org.apache.activemq.broker.region.cursors.VMPendingMessageCursor and the use of PrioritizedPendingList On 6 April 2015 at 22:57, Kevin Burton wrote: > How are messages served now.. I *think* they’re served based on message ID > and sequence and served with the lowest ID first. Which is

Re: What’s the state of apollo?

2015-03-13 Thread Gary Tully
with respect to the hornetq donation, check out the dev list[1], we are busy working towards a first apache release. [1] http://mail-archives.apache.org/mod_mbox/activemq-dev/ On 13 March 2015 at 07:41, Geurt Schimmel wrote: > ...and what about HornetQ ? > > Sent from my iPhone > >> On 13 mrt. 2

Re: Lots of small ActiveMQ instances or one big one?

2015-03-13 Thread Gary Tully
and +1 to what Tim says ;-) On 13 March 2015 at 12:17, Gary Tully wrote: > kevin - peek at https://issues.apache.org/jira/browse/AMQ-5578 it > gives a big win in terms of OS system work per journal write, it is > however kahadb focused at the moment. > > To drive the disk, the mor

Re: Lots of small ActiveMQ instances or one big one?

2015-03-13 Thread Gary Tully
kevin - peek at https://issues.apache.org/jira/browse/AMQ-5578 it gives a big win in terms of OS system work per journal write, it is however kahadb focused at the moment. To drive the disk, the more parallel work that the brokers can introduce the better. In other words, to get max throughput, yo

Re: Replicated LevelDB status (production worthy?)

2015-03-11 Thread Gary Tully
I think you are correct here. The rebuild should work so long as the session has not expired. On 11 March 2015 at 20:51, James A. Robinson wrote: > So I think the problem is that > > org.linkedin.zookeeper.tracker.ZooKeeperTreeTracker > > doesn't appear to handle the event of a session disconnect

  1   2   3   4   5   6   7   8   9   10   >