AW: Measurement points of "enqueue time" metric

2017-06-05 Thread Oliver Wulff
Hey Tim, thanks for the feedback. If the waiting time on the consumer side is included in enqueue time I'm wondering what the measurement points are for dequeue time. Thanks Oli Von: tbai...@gmail.com im Auftrag von Tim Bain Gesendet: Freitag, 2. Juni 2017

Re: Migrating storage from 5.10.0 to 5.14.5

2017-06-05 Thread Tim Bain
What Chris described is how to load the existing messages into your new broker. That has always seemed clunky to me because there is no way to store messages in multiple OpenWire formats (which means your new broker's store is stuck forever on the old broker's OpenWire version), so the option that

RE: How do I Set Up Multiple ActiveMQ Services on one Windows Machine

2017-06-05 Thread Tim Bain
Great, I'm glad to hear that 5.14.5 works for you. Thanks for letting us know. Tim On Jun 5, 2017 7:25 AM, "adnan" wrote: > Thanks Tim for the response. Apperantly it looks like this is an issue with > AMQ 4.1.2 and 5.8.0. Upon looking for ports being invoked in both of these > versions found a

Re: why AvtiveMq is slowly than Kafka?

2017-06-05 Thread Christopher Shannon
Justin, Thanks for linking the design document for the benchmark test I will need to take a look and see how what the test is for the results to come up with that kind of speed. Based on my own experience using several types of brokers a typical message rate under any scenario (non-persistent and

Re: why AvtiveMq is slowly than Kafka?

2017-06-05 Thread Michael André Pearce
I totally agree. Just be good to somehow quantify and highlight that hard work and how much the project has improved from what was compared to today. And I guess next year again. I guess if running that spec is too expensive re resource it's not worth it. Sent from my iPhone > On 5 Jun 2017

Re: ActiveMQ: How to retain inflight messages post consumer restart

2017-06-05 Thread Tim Bain
Can you please describe what you see in JConsole that tells you that the messages are lost? (And can you please define the word "lost" as you're using it here? Do you mean that they are acked - but not by your code - or that they end up in the DLQ or something else?) When your consumer disconnects

Re: why AvtiveMq is slowly than Kafka?

2017-06-05 Thread andytaylor
well said On 5 June 2017 at 12:31, christopher.l.shannon [via ActiveMQ] < ml+s2283324n4727011...@n4.nabble.com> wrote: > You can't compare Kafka to a JMS type message broker. Kafka is completely > different. > > Kafka is a system that scales horizontally and is essentially a big > write-ahead lo

Re: why AvtiveMq is slowly than Kafka?

2017-06-05 Thread Clebert Suconic
@Michael Pearce: The native module on Artemis is totally rewritten... hornetq libaio used a lot of malloc. Artemis is only calling malloc once and reusing them on a pool... a lot less locking happening... just the libaio is better.. For instance.. an issue that you had with 512 bytes blocks recen

Re: why AvtiveMq is slowly than Kafka?

2017-06-05 Thread Justin Bertram
I'm not aware of any SpecJMS results using any branch of Artemis. It'd be nice to have, but one basically has to set up a lab with dedicated hardware, set up the software, run it, etc. It's a fairly involved process from what I understand. Justin - Original Message - From: "Michael

Re: why AvtiveMq is slowly than Kafka?

2017-06-05 Thread Michael André Pearce
@Justin As you noted, with all the changes since hornetq became artemis, is there an updated run of that same JMSspec but on 2.x artemis? It be great if there was. Just to see. Sent from my iPhone > On 5 Jun 2017, at 16:53, Justin Bertram wrote: > > Couple of things... > > 1) I agree 100%

Re: why AvtiveMq is slowly than Kafka?

2017-06-05 Thread Justin Bertram
Couple of things... 1) I agree 100% that comparing Kafka to message brokers like ActiveMQ is like comparing apples to oranges. They are really quite different. 2) My point wasn't necessarily to compare Artemis' performance with Kafka. My reply was simply in response to your assertion that,

Re: artemis 2.2.0 logging disaster

2017-06-05 Thread IlarioM
hi, i've found this bug about netty UnpooledByteBuffer: https://groups.google.com/forum/#!topic/netty/Ve4lnRvFXjM if i've well understand disabling netty recyclers should solve the problem: -Dio.netty.recycler.maxCapacity=0 -Dio.netty.recycler.maxCapacity.default=0 -- View this message in con

Re: artemis 2.2.0 logging disaster

2017-06-05 Thread hwaastad
Hi, yes, Im working my way through the artemis it tests to model my own for testing. What I do know now is that many of the mqtt messsages are ~22k size So what I did to reproduce: 1. artemis create 2. model any spec in artemis.profile (ex xmx/xms=1024M) 3. make a 22k test file 4. running a JMS

ActiveMQ: How to retain inflight messages post consumer restart

2017-06-05 Thread khandelwalanuj
Hi, Using Topics with durable subscribers. I am using client acknowledgement for my durable consumer. I acknowledge the message after every nth message. Which takes care of acknowledging all the messages received before that. I am facing an issue where consumer receives some messages (http://ac

Re: why AvtiveMq is slowly than Kafka?

2017-06-05 Thread Christopher Shannon
That may be what the benchmark says but there is zero chance of hitting 8 million messages per second, especially persistent messages. Take a look at Clebert's blog: http://clebertsuconic.blogspot.com/2016/12/50k-persistent-messages-per-second-on.html And that required making the producer complet

RE: How do I Set Up Multiple ActiveMQ Services on one Windows Machine

2017-06-05 Thread adnan
Thanks Tim for the response. Apperantly it looks like this is an issue with AMQ 4.1.2 and 5.8.0. Upon looking for ports being invoked in both of these versions found a JAVA resource that wasn't part of the AMQ code hooking on to any new service that was started. When did the changes and ran multip

Re: why AvtiveMq is slowly than Kafka?

2017-06-05 Thread Justin Bertram
> Any standalone broker like ActiveMQ, Artemis, etc is going to be measured at > a rate of thousands per second. For what it's worth, HornetQ (upon which Artemis is based) achieved over 8 million messages per second on SpecJMS [1]. I would expect Artemis' performance to be comparable (or bette

Re: The benifit for multiple Queues?

2017-06-05 Thread Justin Bertram
To be clear, there's really only 1 addressing model, but that model supports lots of different use-cases. It's very flexible and supports traditional pub-sub and point-to-point (as you noted). The benefit of supporting multiple "anycast" queues on a single address is simply that if you need th

Re: JDBC persistence for postgresql

2017-06-05 Thread Tim Bain
Each message your producer publishes has to have the persistent flag set, otherwise the (non-persistent) message will be stored in the memory store. Are you setting that flag when you publish your messages? On Jun 5, 2017 1:11 AM, "Bill Chen" wrote: > Hi All, > > I am using ActiveMQ 5.14.5 as MQ

Re: Switch to Artemis from ActiveMQ v5.14.4?

2017-06-05 Thread Christopher Shannon
Artemis is intended to be the follow on to ActiveMQ 5.x. It is currently being actively developed to add new features to it with the goal that the useful features from ActiveMQ will also be added to Artemis. Most of the development effort is being done there and ActiveMQ 5.x is basically in maint

Switch to Artemis from ActiveMQ v5.14.4?

2017-06-05 Thread xabhi
What is the difference between Artemis and current ActiveMQ versions? When should one be preferred over another? Is there any difference between features? Artemis docs say it has outstanding performance - should this be preferred over ActiveMQ? How stable Artemis is in production environments? I h

Re: artemis 2.2.0 logging disaster

2017-06-05 Thread Martyn Taylor
A reproducer is the best way for us to help diagnose/fix the issue. Failing that, are you able to profile the broker to see which objects are getting leaked? There are a couple of MQTT specific things to check such as retained messages and session state. The life cycle of these is controlled by t

Re: why AvtiveMq is slowly than Kafka?

2017-06-05 Thread Claus Ibsen
Hi I just wanted to point out to Jakub's new book (which is free) that talks about both ActiveMQ and Kafka and how they are different http://www.jakubkorab.net/2017/06/new-book-understanding-message-brokers.html On Mon, Jun 5, 2017 at 1:45 PM, Christopher Shannon wrote: > You can't compare Kafk

Re: why AvtiveMq is slowly than Kafka?

2017-06-05 Thread Christopher Shannon
You can't compare Kafka to a JMS type message broker. Kafka is completely different. Kafka is a system that scales horizontally and is essentially a big write-ahead log and breaks up the topics into partitions across many servers so they can be scanned concurrently. This allows insane message r

Re: ARTEMIS - java.lang.NullPointerException switching subscription with #

2017-06-05 Thread francesco81
Hi, just an update. We found out that there was a client subscribed to the incriminated topic with a double wildcard char: "/prj/plantid/+/gwid/+/connection_state". So, there is a step 0 to add to the ones in my previous post: "0) connect a client and subscribe the topic /prj/plantid/+/gwid/+/conne

JDBC persistence for postgresql

2017-06-05 Thread Bill Chen
Hi All, I am using ActiveMQ 5.14.5 as MQTT broker, and I would like to use postgres as database. My configuration in activemq.xml: When I start ActiveMQ, I check the tables(activemq_acks, activemq_lock, activemq_msgs) has created in postgres. But,