Re: ActiveMQ and Artemis reliability - Messages lost

2020-01-12 Thread Clebert Suconic
Did you pre create the queues (which is a production scenario ) On Sat, Jan 11, 2020 at 10:53 PM Justin Bertram wrote: > Just to follow up on the mailing list... > > I've closed ARTEMIS-2173 with a long comment about my failed efforts to > reproduce lost messages. I don't believe there is any

Re: ActiveMQ and Artemis reliability - Messages lost

2020-01-11 Thread Justin Bertram
Just to follow up on the mailing list... I've closed ARTEMIS-2173 with a long comment about my failed efforts to reproduce lost messages. I don't believe there is any reliability issue here. Please follow-up on the Jira if you have additional questions and/or comments. Thanks! Justin On Mon,

Re: ActiveMQ and Artemis reliability - Messages lost

2018-11-14 Thread veaceslavdoina
Hello, Added ActiveMQ test results using xa: https://github.com/veaceslavdoina/messages-brokers-testing/blob/master/RESULTS.md#test-activemq-5157-standalone-xa-20181114-090010 Slava. -- Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: ActiveMQ and Artemis reliability - Messages lost

2018-11-13 Thread jgenender
Hi Erik, Thank you for responding. Your tool certainly is useful from a client/application perspective. However to be clear, I wasn’t knocking your tool, but it was what was used to state that AMQ and Artemis (and Rabbit?) are losing/duplicating messages, then bugs were opened on this, which I

Re: ActiveMQ and Artemis reliability - Messages lost

2018-11-13 Thread erik-wramner
I'm the author of JmsTools. I don't have the time to deep-dive into this issue now, I just want to point out a few things. The tool simulates an application, so it ignores whatever is in ActiveMQ/Artemis. So will a real application. If a message is lost to the tool it is also lost to the real

Re: ActiveMQ and Artemis reliability - Messages lost

2018-11-12 Thread jgenender
I looked at the jmstool, and I am not convinced of any bugs in Artemis and AMQ. It uses an external logging mechanism to consider the state of messages, which is likely not what will be in ActiveMQ or Artemis, nor may it be truly representative of messages that have been passed (or not). What

Re: ActiveMQ and Artemis reliability - Messages lost

2018-11-12 Thread veaceslavdoina
Justin, thank you for advice! Just run a test using a single instance for the broker and producer/consumer. All communication was done using localhost. Got similar results:

Re: ActiveMQ and Artemis reliability - Messages lost

2018-11-12 Thread Justin Bertram
I strongly recommend you simplify your test for this. Whatever the issue is (assuming an issue actually exists), it will need to be replicated with a test in the Artemis test-suite (i.e. using one or more embedded brokers on a single machine). I'd start with peeling back infrastructure layers

Re: ActiveMQ and Artemis reliability - Messages lost

2018-11-12 Thread veaceslavdoina
The issue for Artemis was raised: https://issues.apache.org/jira/browse/ARTEMIS-2173 Slava. -- Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: ActiveMQ and Artemis reliability - Messages lost

2018-11-12 Thread veaceslavdoina
Hello, Project with description and all required data for tests reproducing were posted on Github: https://github.com/veaceslavdoina/messages-brokers-testing The issue was raised in Jira: https://issues.apache.org/jira/browse/AMQ-7096 Slava. -- Sent from:

Re: ActiveMQ and Artemis reliability - Messages lost

2018-10-30 Thread veaceslavdoina
Tim, I'm not a developer at the moment... This is why I tried to find the right tool for such tests. I have tried more than 10 from the publicly accessible. And also asked in the initial post which tool may be used for such type of tests, maybe someone know a good one. Currently, for the tests,

Re: ActiveMQ and Artemis reliability - Messages lost

2018-10-29 Thread Tim Bain
Can you post the code for your producer? Is it sending persistent messages? Does it set a TTL on the messages when it sends them? Your ActiveMQ 5.x console screenshot shows that those queues were never used. What is the screenshot expected to show? Tim On Mon, Oct 29, 2018, 9:26 AM

Re: ActiveMQ and Artemis reliability - Messages lost

2018-10-29 Thread veaceslavdoina
jbertram, Almost all things were done using Ansible and shell script. 1. Ansible - Create AWS environment. 2. Ansible - Install AMQ/Artemis. 3. Shell - script for Jms Tools to produce the tests and generate the reports. 4. A line of code to restart systemd service. If you are interested, I may

Re: ActiveMQ and Artemis reliability - Messages lost

2018-10-29 Thread veaceslavdoina
Reuploaded all 3 images because of overlaps in resulting filenames:

Re: ActiveMQ and Artemis reliability - Messages lost

2018-10-29 Thread Justin Bertram
Is there a project or anything set up where users can easily reproduce the results you're seeing (e.g. using their own machine)? Justin On Mon, Oct 29, 2018 at 9:56 AM veaceslavdoina wrote: > Hello Tim, > > Yes, you are right, thank you for observation! > I've added one more line in the

Re: ActiveMQ and Artemis reliability - Messages lost

2018-10-29 Thread veaceslavdoina
Hello Tim, Yes, you are right, thank you for observation! I've added one more line in the table - 'Messages remained'. During the test, each iteration uses its own queue name. The consumer is configured to consume all messages from the queue with a 30 seconds timeout. At the end of the test, I

Re: ActiveMQ and Artemis reliability - Messages lost

2018-10-29 Thread Tim Bain
When you end the test, how do you ensure that your consumer gets to finish consuming the remaining messages on the broker, without the producer producing new messages? Put another way: you assert that messages are lost, but I don't see anything in your results that prove that they're actually lost

Re: ActiveMQ and Artemis reliability - Messages lost

2018-10-29 Thread veaceslavdoina
Found a typo: Hardware: | ActiveMQ/Artemis| m5.large | 2vCPU / 8GiB | | Producer/Consumer | t3.medium | 2vCPU / 2GiB | Thank you! Slava. -- Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

ActiveMQ and Artemis reliability - Messages lost

2018-10-28 Thread veaceslavdoina
Hello everyone, As was recently mentioned [1], we started to analyze the currently used queue system. During the first iteration, we started to test reliability. Testing environment: AWS Hardware: | Producer | m5.large | 2vCPU / 8GiB | | Consumer | t3.medium | 2vCPU / 2GiB | Software: OS: