Hi Lorenzo, Sounds like it is caused by this bug: https://issues.apache.org/jira/browse/KAFKA-13636 If you're not in the versions of fixed version list or newer, please try to upgrade it.
Thanks. Luke On Fri, Oct 7, 2022 at 5:36 PM Lorenzo Rovere <l.rov...@reply.it> wrote: > Hi everyone, I have a simple question about Kafka offsets. > > We have 1 producer and 1 consumer. > > Imagine the consumer reading till offset 5 (for example) and then suddenly > stops for some hours. In the meantime the producer keeps writing messages > and the offset of the last message is 10 (always for example). When we > restart the microservice that contains the consumer, where does it start to > read from, if we have auto.offset.reset=latest? > > > > I ask this because one of our costumers complains about starting reading > from 10, thus losing messages between 5 and 10. Is that correct? > > > > Other configs: > enable.auto.commit = true > > auto.commit.interval.ms = 5000 > > log.retention.hours=168 > > offsets.retention.minutes (7d) > > > > We also noticed that on the "__consumer_offsets” topic offset is always > set to NULL > > [consumer_group, topic_name,partition]::NULL > > > > Can you help me understanding what’s happening? Thanks a lot > > > Lorenzo Rovere > > Technology Reply > Via Avogadri, 2 > 31057 - Silea (TV) - ITALY > phone: +39 0422 1836521 > l.rov...@reply.it > www.reply.it > > [image: Technology Reply] >
