Re: JMS Batch Consumer

2023-09-21 Thread Claus Ibsen
Hi You can use the aggregator to batch X before sending it to kafka. However I know that then this is decoupled from JMS and those batched messages are stored in-memory by the camel aggregator before they send to kafka. There are some JIRA about batching kafka support (consumer side). And in gene

JMS Batch Consumer

2023-09-18 Thread Billah Farouk (BD/POI2)
Hello, I am looking for a way how to consume messages in Batches from a JMS Broker. Messages will be processed and sent batched in a single request to a Kafka topic. Before Camel 3.7, it was possible to implement such a behaviour using the sjms-batch component. However this component was disco

SQL Batch Consumer

2016-07-27 Thread Vince Iglehart
Hello, I have a route with batch consumer that I want to execute manually. The route will read information using a SQL statement, aggregate the result rows by ticket_nbr, and force complete each aggregated group after all the rows have been aggregated. Here is what I have so far: from

Re: consumerTemplate threading worries when having a Batch Consumer

2012-06-22 Thread ldam
.465427.n5.nabble.com/consumerTemplate-threading-worries-when-having-a-Batch-Consumer-tp5714904p5714915.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: consumerTemplate threading worries when having a Batch Consumer

2012-06-22 Thread Claus Ibsen
nly poll 1 file at a time. > kr. ldam > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/consumerTemplate-threading-worries-when-having-a-Batch-Consumer-tp5714904p5714912.html > Sent from the Camel - Users mailing list archi

Re: consumerTemplate threading worries when having a Batch Consumer

2012-06-22 Thread ldam
-worries-when-having-a-Batch-Consumer-tp5714904p5714912.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: consumerTemplate threading worries when having a Batch Consumer

2012-06-22 Thread Claus Ibsen
for 47 > > I included these for search engines, in case other gets similar problems. > > > kr. Lars Dam > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/consumerTemplate-threading-worries-when-having-a-Batch-Consumer-tp5714904.html >

Re: consumerTemplate threading worries when having a Batch Consumer

2012-06-22 Thread ldam
I forgot: The test code of course requires an sftp server and bunch of files for it to work (fail) -- View this message in context: http://camel.465427.n5.nabble.com/consumerTemplate-threading-worries-when-having-a-Batch-Consumer-tp5714904p5714906.html Sent from the Camel - Users mailing list

consumerTemplate threading worries when having a Batch Consumer

2012-06-22 Thread ldam
ost session] INFO org.apache.camel.component.file.remote.SftpOperations - JSCH -> Received SSH_MSG_UNIMPLEMENTED for 47 I included these for search engines, in case other gets similar problems. kr. Lars Dam -- View this message in context: http://camel.465427.n5.nabble.com/consumerTemplate-threading-worries-when-having-a-Batch-Consumer

Re: Batch Consumer

2012-02-21 Thread Hervé BARRAULT
, but I'm afriad current camel jms component doesn't support. > > Camel JMS Consumer is based Spring JMS Listener, it process the message > one by one. > It's hard to support the request/response model in the JMS batch consumer. > But it could b

Re: Batch Consumer

2012-02-20 Thread Willem Jiang
equest/response model in the JMS batch consumer. But it could be easy to implement one by extendes the ScheduledBatchPollingConsumer yourself, if your message from the jms doesn't request any response. On Mon Feb 20 21:24:54 2012, Hervé BARRAULT wrote: Hi, I have a simple mission which

Batch Consumer

2012-02-20 Thread Hervé BARRAULT
the ratio envelope/Data (I think also that the target application is more efficient with big messages than small ones). I thought using a batch consumer (read all available messages with obviously a max number of message) then an aggregation (based on the batch size) before processing the "b

Re: Last Aggregated Exchange lost - Aggregator with a Batch-Consumer and persistent AggregationRepository

2011-01-18 Thread Claus Ibsen
gt;> >> I've noticed a problem of "loosing last aggregated exchange", when using a >> certain combination of Camel components. I've got a testcase attached to >> reproduce the problem. >> >> Camel Version: 2.5.0 >> Components: "

Re: Last Aggregated Exchange lost - Aggregator with a Batch-Consumer and persistent AggregationRepository

2011-01-18 Thread Claus Ibsen
when using a > certain combination of Camel components. I've got a testcase attached to > reproduce the problem. > > Camel Version: 2.5.0 > Components: "any batch-consumer", aggregator, (hawtdb | > jdbc)-aggregation-repository > > What I'm doing: > C

Last Aggregated Exchange lost - Aggregator with a Batch-Consumer and persistent AggregationRepository

2011-01-18 Thread Sebastian Jancke
Hello Camel-People, I've noticed a problem of "loosing last aggregated exchange", when using a certain combination of Camel components. I've got a testcase attached to reproduce the problem. Camel Version: 2.5.0 Components: "any batch-consumer", aggregator