On Tue, Jun 25, 2019 at 4:20 PM Hart, James W. <jwh...@seic.com> wrote: > > I am using camel 2.24.0, and kafka 1.0, so the config > value(group.initial.rebalance.delay.ms ) does exist in that version according > to the kafka documentation, but it's not in the camel documentation that I > see. I searched the latest camel code and didn't find the > value(group.initial.rebalance.delay.ms) anywhere. This isn't critical for an > immediate fix for me, but would be nice in the coming months if possible. >
Okay you are welcome to log a JIRA with an improvement to add that option > The compression not working is a larger issue, and It's probably just me > missing something. I'm setting "compressionCodec=snappy" which camel > accepts, but no compression is done when I look at the data stored in the > topics. > Yeah not sure, for snappy you may need some native libraries as well than just the JARs. Try to research a bit more how it works and should be configured with just kafka. > > -----Original Message----- > From: Claus Ibsen [mailto:claus.ib...@gmail.com] > Sent: Tuesday, June 25, 2019 12:10 AM > To: users@camel.apache.org > Subject: Re: Help with camel and kafka consumer/producer. > > [[ SEI WARNING *** This email was sent from an external source. Do not open > attachments or click on links from unknown or suspicious senders. *** ]] > > > Hi > > What version of Camel and Kafka do you use? > > If you can find the option "group.initial.rebalance.delay.ms" in the > kafka consumer docs (eg from apache kafka) and find out what's its > name is then we can very likely set it too in camel-kafka as they are > 1:1. But it may be that when a new option is added to kafka we may > miss that in camel-kafka. > > See the docs at what options you can set > https://github.com/apache/camel/blob/master/components/camel-kafka/src/main/docs/kafka-component.adoc > > On Mon, Jun 24, 2019 at 7:33 PM Hart, James W. <jwh...@seic.com> wrote: > > > > I'm having some trouble with a couple of items in consuming and production > > of messages with kafka using camel. Any help is appreciated. > > > > > > > > Is there a way that I can set the kafka config item > > group.initial.rebalance.delay.ms for the camel kafka consumer? The default > > of 3000 msecs isn’t long enough as I launch on multiple machines and want > > them to have more time to sync and prevent re-sync. > > > > > > > > Also I'm can't seem to get compression working on the topic I'm forwarding > > to. I'm setting "compressionCodec=snappy" which the program accepts, but > > no compression is done. I'm consuming from a topic that is not compressed > > and sending to a topic where I want it compressed. I see the snappy jar > > is part of the classpath and don't get any errors in startup or execution. > > > > > > > -- > Claus Ibsen > ----------------- > http://davsclaus.com @davsclaus > Camel in Action 2: https://www.manning.com/ibsen2 -- Claus Ibsen ----------------- http://davsclaus.com @davsclaus Camel in Action 2: https://www.manning.com/ibsen2
