I am using camel 2.24.0, and kafka 1.0, so the config value(group.initial.rebalance.delay.ms ) does exist in that version according to the kafka documentation, but it's not in the camel documentation that I see. I searched the latest camel code and didn't find the value(group.initial.rebalance.delay.ms) anywhere. This isn't critical for an immediate fix for me, but would be nice in the coming months if possible.
The compression not working is a larger issue, and It's probably just me missing something. I'm setting "compressionCodec=snappy" which camel accepts, but no compression is done when I look at the data stored in the topics. -----Original Message----- From: Claus Ibsen [mailto:claus.ib...@gmail.com] Sent: Tuesday, June 25, 2019 12:10 AM To: users@camel.apache.org Subject: Re: Help with camel and kafka consumer/producer. [[ SEI WARNING *** This email was sent from an external source. Do not open attachments or click on links from unknown or suspicious senders. *** ]] Hi What version of Camel and Kafka do you use? If you can find the option "group.initial.rebalance.delay.ms" in the kafka consumer docs (eg from apache kafka) and find out what's its name is then we can very likely set it too in camel-kafka as they are 1:1. But it may be that when a new option is added to kafka we may miss that in camel-kafka. See the docs at what options you can set https://github.com/apache/camel/blob/master/components/camel-kafka/src/main/docs/kafka-component.adoc On Mon, Jun 24, 2019 at 7:33 PM Hart, James W. <jwh...@seic.com> wrote: > > I'm having some trouble with a couple of items in consuming and production of > messages with kafka using camel. Any help is appreciated. > > > > Is there a way that I can set the kafka config item > group.initial.rebalance.delay.ms for the camel kafka consumer? The default > of 3000 msecs isn’t long enough as I launch on multiple machines and want > them to have more time to sync and prevent re-sync. > > > > Also I'm can't seem to get compression working on the topic I'm forwarding > to. I'm setting "compressionCodec=snappy" which the program accepts, but no > compression is done. I'm consuming from a topic that is not compressed and > sending to a topic where I want it compressed. I see the snappy jar is > part of the classpath and don't get any errors in startup or execution. > > -- Claus Ibsen ----------------- http://davsclaus.com @davsclaus Camel in Action 2: https://www.manning.com/ibsen2
