Message-
From: Matthias J. Sax [mailto:mj...@apache.org]
Sent: 27 July 2023 22:05
To: users@kafka.apache.org
Subject: Re: Consuming an entire partition with control messages
Well, `kafka-consumer-group.sh` can only display the difference between
"committed offset" and "en
Well, `kafka-consumer-group.sh` can only display the difference between
"committed offset" and "end offset". It cannot know what the "right"
offset to be committed is. It's really the responsibility of the
consumers to commit correctly.
-Matthias
On 7/27/23 1:03 AM, Vincent Maurin wrote:
Thank you Matthias for your answer, I open an issue on the aiokafka
project as follow up, let's see how we can resolve it there
https://github.com/aio-libs/aiokafka/issues/911
As mentioned in the issue, some tools like kafka-consumer-groups.sh also
display a lag of "1" in this kind of
Sounds like a bug in aiokafka library to me.
If the last message in a topic partition is a tx-marker, the consumer
should step over it, and report the correct position after the marker.
The official KafkaConsumer (ie, the Java one), does the exact same thing.
-Matthias
On 5/30/23 8:41 AM,
Hello !
I am working on an exactly once stream processors in Python, using
aiokafka client library. My program stores a state in memory, that is
recovered from a changelog topic, like in kafka streams.
On each processing loop, I am consuming messages, producing messages
to an output topics and
