Re: camel-pulsar performance

2023-04-19 Thread Steve973
Thanks, Neal. This is my first foray into Pulsar, so you are probably right. On Wed, Apr 19, 2023 at 3:34 PM Neal Feierabend wrote: > Hello Steve, > > I'm a relative novice with both Pulsar and Camel so I could be completely > wrong, but I wonder if this may have more to do with Pulsar than

Re: camel-pulsar performance

2023-04-19 Thread Neal Feierabend
Hello Steve, I'm a relative novice with both Pulsar and Camel so I could be completely wrong, but I wonder if this may have more to do with Pulsar than Camel. What kind of hardware are you testing on? Most of the benchmarks I've seen that talk about 1 million or more messages/second are usually

Re: camel-pulsar performance

2023-04-19 Thread Steve973
Thanks, Claus. I have also tried Kafka in my app for comparison purposes, and it seems to be a little bit more performant. I saw something called Starlight for JMS that does JMS over Pulsar, and gets about a million messages per second. I'm considering writing a camel component for that. Im

Re: camel-pulsar performance

2023-04-19 Thread Claus Ibsen
Hi I think camel-pulsar does an ACK per message at the end of routing. Then the performance may become slower. kafka uses async commit every 5 sec in the background (by default). for camel-pulsar you can also use manual ack, and then find a way to batch acks. But maybe there is a way in pulsar

camel-pulsar performance

2023-04-17 Thread Steve973
Hello. I have been experimenting with the Camel Pulsar component as a more performant alternative to traditional JMS brokers. I have seen performance comparisons that set Pulsar even above Kafka in most cases. It is reported that Pulsar can handle (~3.5) millions of messages per second. In my