Hi Otavio, Claus,
Thank you very much for your hands. I tried upgrading to 3.18.3. I didn't
increase the offset.
Best regards,
Yuttana
On 2022/11/10 06:36:08 Otavio Rodolfo Piske wrote:
> Hi, before I go ahead and investigate this further ... Could you
> possibly try with Camel 3.18.3? We have made a bunch of fixes for Kafka in
> 3.18.3.
>
> Kind regards
>
> On Wed, Nov 9, 2022 at 3:56 PM Claus Ibsen <cl...@gmail.com> wrote:
>
> > Hi
> >
> > I am not sure, there are some improvements and refactorings going on
> > in camel-kafka and offset management.
> > I think Otavio would be better to help look into this.
> >
> > On Wed, Nov 9, 2022 at 11:36 AM Sangchoei, Yuttana
> > <yu...@anz.com.invalid> wrote:
> >
> > > Hi All,
> > >
> > > I'm upgrading Camel from 3.16 to 3.17 and found a problem that
> > > OffsetRepository didn't get update after manual commit.
> > > It is a Spring boot project and MemoryStateRepository as follows.
> > >
> > > @Bean
> > > public MemoryStateRepository offsetRepo() {
> > > MemoryStateRepository stateRepository = new
> > > MemoryStateRepository();
> > > stateRepository.setState(topic + "/0", "");
> > > return stateRepository;
> > > }
> > >
> > > Here is the method I use when commit:
> > >
> > > private void commitOffsetToKafka(Exchange exchange) {
> > > KafkaManualCommit manual =
> > > exchange.getIn().getHeader(KafkaConstants.MANUAL_COMMIT,
> > > KafkaManualCommit.class);
> > > manual.commit();
> > > }
> > >
> > > Here is my Kafka endpoint
> > >
> > > kafka:integration_test _topic?brokers=127.0.0.1:41478
> > >
> > &autoCommitEnable=false&allowManualCommit=true&seekTo=beginning&maxP
> > ollRecords=2&groupId=ANE&autoOffsetReset=earliest&offsetRepository=#
> > offsetRepo&kafkaManualCommitFactory=#class:org.apache.camel.componen
> > t.kafka.consumer.DefaultKafkaManualCommitFactory
> > >
> > > It is working fine in 3.16. When
> > > DefaultkafkaManualSyncCommit.commit() is invoked. The
> > > offsetRepository.setState() get invoked so the offset increased.
> > > However, in 3.17, DefaultkafkaManualSyncCommit.commit() doesn't
> > > have a reference to offsetRepository so the offset in
> > > offsetRepository won't get increased.
> > >
> > > Is this a bug or there is a different way to get the offset after
> > > committing. Could you please suggest what I should do to test if
> > > the
> > offset
> > > get increased after manual commit?
> > >
> > > Best regards,
> > > Yuttana Sangchoei
> > >
> > > This e-mail and any attachments to it (the "Communication") is,
> > > unless otherwise stated, confidential, may contain copyright
> > > material and is for the use only of the intended recipient. If you
> > > receive the Communication
> > in
> > > error, please notify the sender immediately by return e-mail,
> > > delete the Communication and the return e-mail, and do not read,
> > > copy, retransmit or otherwise deal with it. Any views expressed in
> > > the Communication are
> > those
> > > of the individual sender only, unless expressly stated to be those
> > > of Australia and New Zealand Banking Group Limited ABN 11 005 357
> > > 522, or
> > any
> > > of its related entities including ANZ Bank New Zealand Limited
> > > (together "ANZ"). ANZ does not accept liability in connection with
> > > the integrity of or errors in the Communication, computer virus,
> > > data corruption, interference or delay arising from or in respect of the
> > > Communication.
> > >
> >
> >
> > --
> > Claus Ibsen
> > -----------------
> > @davsclaus
> > Camel in Action 2: https://www.manning.com/ibsen2
> >
>
>
> --
> Otavio R. Piske
> http://orpiske.net
>
This e-mail and any attachments to it (the "Communication") is, unless
otherwise stated, confidential, may contain copyright material and is for the
use only of the intended recipient. If you receive the Communication in error,
please notify the sender immediately by return e-mail, delete the Communication
and the return e-mail, and do not read, copy, retransmit or otherwise deal with
it. Any views expressed in the Communication are those of the individual sender
only, unless expressly stated to be those of Australia and New Zealand Banking
Group Limited ABN 11 005 357 522, or any of its related entities including ANZ
Bank New Zealand Limited (together "ANZ"). ANZ does not accept liability in
connection with the integrity of or errors in the Communication, computer
virus, data corruption, interference or delay arising from or in respect of the
Communication.
