Re: camel-pulsar performance

2023-04-19 Thread Steve973
Thanks, Neal. This is my first foray into Pulsar, so you are probably right. On Wed, Apr 19, 2023 at 3:34 PM Neal Feierabend wrote: > Hello Steve, > > I'm a relative novice with both Pulsar and Camel so I could be completely > wrong, but I wonder if this may have more to do with Pulsar than

Re: camel-pulsar performance

2023-04-19 Thread Neal Feierabend
Hello Steve, I'm a relative novice with both Pulsar and Camel so I could be completely wrong, but I wonder if this may have more to do with Pulsar than Camel. What kind of hardware are you testing on? Most of the benchmarks I've seen that talk about 1 million or more messages/second are usually

Re: camel-pulsar performance

2023-04-19 Thread Steve973
Thanks, Claus. I have also tried Kafka in my app for comparison purposes, and it seems to be a little bit more performant. I saw something called Starlight for JMS that does JMS over Pulsar, and gets about a million messages per second. I'm considering writing a camel component for that. Im

RE: Camel in Action: Microsoft Azure Files over public Internet

2023-04-19 Thread Petr Kuzel
Thank you Andrea for the hint, I have sketched https://issues.apache.org/jira/browse/CAMEL-19279 Hope it helps Cc. -Original Message- From: Andrea Cosentino Sent: Tuesday, April 18, 2023 09:21 To: users@camel.apache.org Subject: Re: Camel in Action: Microsoft Azure Files over

Re: camel-pulsar performance

2023-04-19 Thread Claus Ibsen
Hi I think camel-pulsar does an ACK per message at the end of routing. Then the performance may become slower. kafka uses async commit every 5 sec in the background (by default). for camel-pulsar you can also use manual ack, and then find a way to batch acks. But maybe there is a way in pulsar

Re: How to clear the cache of MemoryIdempotentRepository

2023-04-19 Thread Claus Ibsen
Hi If you use JMX then there is JMX operations to clear. Otherwise you can create an instance of the memory repo, and use in the route, and from java code you can invoke its clear method to clear the cache. You can make that code also be executed by the end of the route if you add it as

How to clear the cache of MemoryIdempotentRepository

2023-04-19 Thread Reto Peter
Hi all I have a route, which checks for uniqueness of a certain value (find duplicates, and in case of duplicates, the route will throw an exception). That works fine so far. At the end of the route, I want to clear the cache, so next time the route gets executed, it shall start with an empty