Hi You can use the aggregator to batch X before sending it to kafka. However I know that then this is decoupled from JMS and those batched messages are stored in-memory by the camel aggregator before they send to kafka.
There are some JIRA about batching kafka support (consumer side). And in general for Camel messaging components ala JMS, but its a bit tricky as camel-jms is based on spring jms that does not have too well support for batching. On Mon, Sep 18, 2023 at 5:37 PM Billah Farouk (BD/POI2) <farouk.bil...@bosch.com.invalid> wrote: > Hello, > > I am looking for a way how to consume messages in Batches from a JMS > Broker. Messages will be processed and sent batched in a single request to > a Kafka topic. > > Before Camel 3.7, it was possible to implement such a behaviour using the > sjms-batch component. However this component was discontinued. > > Reasons for using batching consumers are mainly: > > - Process a high throughput without needing to create too many JMS > Concurrent consumers ( current value: maxConcurrentConsumers=20) > - Achieve a high number records per Kafka request as the latency to the > Kafka cluster is quite high (Number of records per request was around 75 > when using the sjms-batch component) > > Two questions: > > 1- Are there are any news whether the possibility to consume message in > Batches from a JMS Broker will be reinstated in Camel 4? > > 2- Do you guys have any proposals how the desired behavior can be > otherwise achieved? > > Regards > Farouk > -- Claus Ibsen ----------------- @davsclaus Camel in Action 2: https://www.manning.com/ibsen2
