Thanks. I can't confirm whether it's an user error, bug or anything else,
but I created a ticket so I can investigate this:
https://issues.apache.org/jira/browse/CAMEL-18717
I also can't provide an ETA yet, as I have a busy week ahead, but I'll keep
it on my radar. In the meantime, please do feel free to contribute with a
reproducer or even propose a bug fix if you want as any of those will
certainly make the resolution faster. We love receiving contributions.
Kind regards
On Fri, Nov 11, 2022 at 10:28 AM Sangchoei, Yuttana
<yuttana.sangch...@anz.com.invalid> wrote:
> Hi Otavio, Clays,
>
>
> Thank you very much for your hands. I tried 3.18.3. It didn't increase the
> offset.
>
> Best regards,
> Yuttana
>
>
> On 2022/11/10 06:36:08 Otavio Rodolfo Piske wrote:
> > Hi, before I go ahead and investigate this further ... Could you possibly
> > try with Camel 3.18.3? We have made a bunch of fixes for Kafka in 3.18.3.
> >
> > Kind regards
> >
> > On Wed, Nov 9, 2022 at 3:56 PM Claus Ibsen <cl...@gmail.com> wrote:
> >
> > > Hi
> > >
> > > I am not sure, there are some improvements and refactorings going on in
> > > camel-kafka and offset management.
> > > I think Otavio would be better to help look into this.
> > >
> > > On Wed, Nov 9, 2022 at 11:36 AM Sangchoei, Yuttana
> > > <yu...@anz.com.invalid> wrote:
> > >
> > > > Hi All,
> > > >
> > > > I'm upgrading Camel from 3.16 to 3.17 and found a problem that
> > > > OffsetRepository didn't get update after manual commit.
> > > > It is a Spring boot project and MemoryStateRepository as follows.
> > > >
> > > > @Bean
> > > > public MemoryStateRepository offsetRepo() {
> > > > MemoryStateRepository stateRepository = new
> > > > MemoryStateRepository();
> > > > stateRepository.setState(topic + "/0", "");
> > > > return stateRepository;
> > > > }
> > > >
> > > > Here is the method I use when commit:
> > > >
> > > > private void commitOffsetToKafka(Exchange exchange) {
> > > > KafkaManualCommit manual =
> > > > exchange.getIn().getHeader(KafkaConstants.MANUAL_COMMIT,
> > > > KafkaManualCommit.class);
> > > > manual.commit();
> > > > }
> > > >
> > > > Here is my Kafka endpoint
> > > >
> > > > kafka:integration_test _topic?brokers=127.0.0.1:41478
> > > >
> > >
> &autoCommitEnable=false&allowManualCommit=true&seekTo=beginning&maxPollRecords=2&groupId=ANE&autoOffsetReset=earliest&offsetRepository=#offsetRepo&kafkaManualCommitFactory=#class:org.apache.camel.component.kafka.consumer.DefaultKafkaManualCommitFactory
> > > >
> > > > It is working fine in 3.16. When
> DefaultkafkaManualSyncCommit.commit() is
> > > > invoked. The offsetRepository.setState() get invoked so the offset
> > > > increased.
> > > > However, in 3.17, DefaultkafkaManualSyncCommit.commit() doesn't have
> a
> > > > reference to offsetRepository so the offset in offsetRepository
> won't get
> > > > increased.
> > > >
> > > > Is this a bug or there is a different way to get the offset after
> > > > committing. Could you please suggest what I should do to test if the
> > > offset
> > > > get increased after manual commit?
> > > >
> > > > Best regards,
> > > > Yuttana Sangchoei
> > > >
> > > > This e-mail and any attachments to it (the "Communication") is,
> unless
> > > > otherwise stated, confidential, may contain copyright material and
> is for
> > > > the use only of the intended recipient. If you receive the
> Communication
> > > in
> > > > error, please notify the sender immediately by return e-mail, delete
> the
> > > > Communication and the return e-mail, and do not read, copy,
> retransmit or
> > > > otherwise deal with it. Any views expressed in the Communication are
> > > those
> > > > of the individual sender only, unless expressly stated to be those of
> > > > Australia and New Zealand Banking Group Limited ABN 11 005 357 522,
> or
> > > any
> > > > of its related entities including ANZ Bank New Zealand Limited
> (together
> > > > "ANZ"). ANZ does not accept liability in connection with the
> integrity of
> > > > or errors in the Communication, computer virus, data corruption,
> > > > interference or delay arising from or in respect of the
> Communication.
> > > >
> > >
> > >
> > > --
> > > Claus Ibsen
> > > -----------------
> > > @davsclaus
> > > Camel in Action 2: https://www.manning.com/ibsen2
> > >
> >
> >
> > --
> > Otavio R. Piske
> > http://orpiske.net
> >
>
> Get Outlook for Android<https://aka.ms/AAb9ysg>
> This e-mail and any attachments to it (the "Communication") is, unless
> otherwise stated, confidential, may contain copyright material and is for
> the use only of the intended recipient. If you receive the Communication in
> error, please notify the sender immediately by return e-mail, delete the
> Communication and the return e-mail, and do not read, copy, retransmit or
> otherwise deal with it. Any views expressed in the Communication are those
> of the individual sender only, unless expressly stated to be those of
> Australia and New Zealand Banking Group Limited ABN 11 005 357 522, or any
> of its related entities including ANZ Bank New Zealand Limited (together
> "ANZ"). ANZ does not accept liability in connection with the integrity of
> or errors in the Communication, computer virus, data corruption,
> interference or delay arising from or in respect of the Communication.
>
--
Otavio R. Piske
http://orpiske.net
