AggregationStrategy and multiple consumers

2019-12-05 Thread Valdis Andersons
Hi All, I've searched for this topic now a fair bit and I'm not quite getting a conclusive answer to my issue. What we've noticed the last while is that in some cases under high enough load with multiple consumers on the Aggregator route some messages get overwritten in the aggregation result

RE: camel-rabbitmq sheduled route acks all messages when shutting down

2019-11-05 Thread Valdis Andersons
tead of the body expression and it still wouldn't populate the header. From: Valdis Andersons Sent: 05 November 2019 21:54 To: users@camel.apache.org Subject: RE: camel-rabbitmq sheduled route acks all messages when shutting down CAUTION: This email originated from outside of VHI. Do not click link

RE: camel-rabbitmq sheduled route acks all messages when shutting down

2019-11-05 Thread Valdis Andersons
sing for each archived item (since they can go different ways and also fail in all sorts of different ways). Any help/advice/hint on the above would be greatly appreciated. Thanks and Regards, Valdis From: Valdis Andersons Sent: 05 November 2019 15:59 To: users@camel.apache.org Subject: camel-

camel-rabbitmq sheduled route acks all messages when shutting down

2019-11-05 Thread Valdis Andersons
Hi All, Not sure I understand the issue fully, but I have scheduled route with this config (it's throttled as well): CronScheduledRoutePolicy emailSchedulingPolicy = new CronScheduledRoutePolicy(); emailSchedulingPolicy.setRouteStartTime(emailNotificationsStartSchedule);

RE: Pipelining : Camel routes vs. Microservice architecture

2019-10-30 Thread Valdis Andersons
Hi Ron, While I haven't refactored an existing solution to use Camel, I've build one from scratch and will be building another one (just a lot smaller) shortly. I've also worked on a good few systems that use custom built flow logic. The pros I can see from Camel are: 1. Much easier flow

RE: Throttling from direct to bean

2019-07-02 Thread Valdis Andersons
Please disregard, the issue was with the bindings in the Rabbit exchanges. Feeling silly now, apologies for the spam. Thanks, Valdis From: Valdis Andersons Sent: 02 July 2019 18:06 To: users@camel.apache.org Subject: Throttling from direct to bean Hi All, Would anyone know if this is possible

Throttling from direct to bean

2019-07-02 Thread Valdis Andersons
Hi All, Would anyone know if this is possible to do with the Camel Throttler? Here is the routing: --- from AbstractRouteBuilder--- from("rabbitmq:bufferedExchange?connectionFactory=rabbitConnectionFactory=false=bufferQueue") .startupOrder(startOrder)

RE: Intermittent RejectedExecutionException

2019-06-25 Thread Valdis Andersons
Hi Claus, Is there a way to handle the RejectedExecutionException when using a DynamicRouter? I'm not quite ready yet to refactor my router to static endpoints. Here is the setup I have for it: public void configure() throws Exception { from(inputEndpoint)

RE: Intermittent RejectedExecutionException

2019-06-14 Thread Valdis Andersons
Hi Claus, Michael, I've seen this with 21.3 as well in the RabbitMQ component. Since the Rabbit component is heavily based on the JMS component then I would suspect the issue is the same for both. Doesn't happen very often but enough to be of concern. In production that means I'd move any

RE: Camel + Spring Boot as a backend?

2019-04-17 Thread Valdis Andersons
Hi Ron, No issues with what you want to do with Camel and Spring Boot. You don't even need a container to run the application in (though Tomcat is small, simple and reliable). Using direct, bean and seda mappings you can achieve pretty much any sort of routing you would need for your app. If

RE: DeadLetterChannel handle option

2019-03-06 Thread Valdis Andersons
Hey, That's pretty much how I would understand it was well. Though I'm not setting the handled option explicitly anywhere in my route builders. To make the exchange go somewhere else in case of an exception you'd really just have to specify the deadLetterChannel in the errorHandler of your

RE: [DISCUSS] - Apache Camel 3 - A new tagline

2019-02-20 Thread Valdis Andersons
+1 for "Integrate Everything!" -Original Message- From: Francois Papon [mailto:francois.pa...@openobject.fr] Sent: 20 February 2019 10:19 To: users@camel.apache.org Subject: Re: [DISCUSS] - Apache Camel 3 - A new tagline Hi, I'm agree with Guillaume about not focuses too much on cloud,

RE: camel-rabbitmq automated recovery

2019-01-03 Thread Valdis Andersons
ubject: Re: camel-rabbitmq automated recovery Hi Have you been able to try with a newer release such as Camel 2.23.0, as the camel-rabbitmq component etc may been improved / bug fixed since that version you are using. On Mon, Nov 12, 2018 at 5:34 PM Valdis Andersons wrote: > > Hi All, > &

RE: How to read messages from a queue in parallel

2018-12-20 Thread Valdis Andersons
nt to risk dropping messages, for > example during a service restart. > > I'll experiment and come back with my results. > > Thanks. > > On Mon, Dec 17, 2018 at 4:41 PM Valdis Andersons > > wrote: > >> Hi Peter, >> >> Given you have a header alrea

RE: How to read messages from a queue in parallel

2018-12-17 Thread Valdis Andersons
Hi Peter, Given you have a header already identifying the message categories, you could try to look into the Aggregator EIP: http://camel.apache.org/aggregator2.html It will allow you to group all the messages by the header into 'batches' for each of the groups. Each batch can then be

camel-rabbitmq automated recovery

2018-11-12 Thread Valdis Andersons
Hi All, Hoping someone with more experience with RabbitMQ and Camel might be able to tell me what's going on with the below scenario as I'm not sure I understand it right. We have now 3 servers in a test environment with RabbitMQ installed (v3.6.12, Elang 20.1), we're using camel-rabbitmq

RE: Apache camel rest dsl RestBindingMode.json is throwing exception

2018-10-25 Thread Valdis Andersons
Hi Rahul, Could you try simplifying the route to determine where it's starting to break down for you? Initially just declare something trivial with just the endpoint, mapping and processor. restConfiguration().component("spark-rest").bindingMode(RestBindingMode.json);

RE: throttling/backpressure on a route

2018-10-17 Thread Valdis Andersons
ill :) I just found ThrottlingInflightRoutePolicy, reading its description it seems to be what I'm looking for. I will double-check tomorrow. Thanks for all the tips so far. Valdis Andersons writes: > Hi Peter, > > Could you potentially use a message broker (RabbitMQ, ActiveMQ etc.)

RE: throttling/backpressure on a route

2018-10-17 Thread Valdis Andersons
Hi Peter, Could you potentially use a message broker (RabbitMQ, ActiveMQ etc.) downstream from the aggregator that is causing you concern? Mongo -> Aggregator -> Message Broker Queue -> Consumer -> ... -> Mongo With the consumer counts it's quite easy to restrict throughput to the max your

RE: REST endpoint to rabbitmq queue connection timeout

2018-10-05 Thread Valdis Andersons
. zoran [1] https://scanmail.trustwave.com/?c=6600=prK32zpd-TqvMeNzuqm1P9sl2_MVSbEt5EF_ffZc_A=33=https%3a%2f%2fgithub%2ecom%2fapache%2fcamel%2fblob%2fmaster%2fcomponents%2fcamel-rabbitmq%2fsrc%2fmain%2fdocs%2frabbitmq-component%2eadoc On Thu, Oct 4, 2018 at 6:15 PM, Valdis Andersons wrote

RE: Integration tests with Spring annotations

2018-10-04 Thread Valdis Andersons
uot; as a bean in my configuration, but It is not referenced in the application context of the test.. Le lun. 1 oct. 2018 à 13:04, Valdis Andersons a écrit : > Hi Damien, > > In your test you need specify the configuration your Camel context is > supposed to use. This is how we're setting

REST endpoint to rabbitmq queue connection timeout

2018-10-04 Thread Valdis Andersons
Hi All, Would anyone know how to configure the timeout values for the below connection pool or the connection pool itself? Been having some issues lately in a test environment with this and the timeout check seems to happen every few milliseconds producing huge amounts of log files. We're

RE: Integration tests with Spring annotations

2018-10-01 Thread Valdis Andersons
. Dependency annotations: {@org.springframework.beans.factory.annotation.Autowired(required=true)} Le lun. 1 oct. 2018 à 09:59, Valdis Andersons a écrit : > Hi Damien, > > We use Spring annotations in our integrations quite a lot and it's > working rather well for us. In ord

RE: Integration tests with Spring annotations

2018-10-01 Thread Valdis Andersons
Hi Damien, We use Spring annotations in our integrations quite a lot and it's working rather well for us. In order to invoke the RouteBuilder instance we just provide a class name for it in the ApplicationContext of the test createApplicationContext method and then use a test configuration

camel-rabbitmq clustering failover issue

2018-09-24 Thread Valdis Andersons
Hi All, Hopefully someone can help me out here. In the project I'm working on we're using the camel-rabbitmq component to connect to a cluster of three RabbitMQ nodes. We're using the addresses parameter in the URL configuration of the RabbitMQ facing endpoints, like this:

Early reply received with correlationID

2018-09-06 Thread Valdis Andersons
Hi All, Not sure if this is of any concern but looks kind of strange given the comments in the camel-rabbitmq component code itself. When looking in some production logs today I spotted a load of these sort of messages: - Early reply received with correlationID

RE: Camel with Rabbitmq: messages in temp reply queue not being acked

2018-08-22 Thread Valdis Andersons
a solution for this issue now. On Tue, Aug 21, 2018 at 5:58 PM, Valdis Andersons wrote: > Hi Claus, > > That seems to work as expected, deployed a local build to test and no more > stale messages in un-acked states in the temp reply queues and in addition it > doesn't seem to brake a

RE: Camel with Rabbitmq: messages in temp reply queue not being acked

2018-08-21 Thread Valdis Andersons
, Valdis -Original Message- From: Claus Ibsen [mailto:claus.ib...@gmail.com] Sent: 21 August 2018 11:22 To: users@camel.apache.org Subject: Re: Camel with Rabbitmq: messages in temp reply queue not being acked On Tue, Aug 21, 2018 at 10:05 AM, Valdis Andersons wrote: > Hi Cl

RE: Camel with Rabbitmq: messages in temp reply queue not being acked

2018-08-21 Thread Valdis Andersons
you could modify the source code and try to "fix this" yourself and give it some testing, and then if so you are welcome to log a JIRA and provide a patch / github PR with the fix. Anyone else have other thoughts or comments? On Fri, Aug 17, 2018 at 5:31 PM, Valdis Andersons wrote

RE: Camel with Rabbitmq: messages in temp reply queue not being acked

2018-08-17 Thread Valdis Andersons
It might just maybe give me an idea or two of what I might be missing in my routing setup and how to get this working or at least how to work around this issue. Thanks, Valdis From: Valdis Andersons Sent: 16 August 2018 16:10 To: users@camel.apache.org Subject: Camel with Rabbitmq: messages in

Camel with Rabbitmq: messages in temp reply queue not being acked

2018-08-16 Thread Valdis Andersons
Hi All, Hopefully someone here can educate me on the below matter. Here is a rather long-winded description of the issue: https://stackoverflow.com/questions/51875646/apache-camel-with-rabbitmq-messages-in-temp-reply-queue-not-being-acked-when-au The essence of it is that in an InOut route