Manish Kumar Sinha created KAFKA-17872:
------------------------------------------
Summary: Kafka stream job does not commit offset when packets are
getting ignored intentionally
Key: KAFKA-17872
URL: https://issues.apache.org/jira/browse/KAFKA-17872
Project: Kafka
Issue Type: Bug
Components: streams
Reporter: Manish Kumar Sinha
Hi,
We are using kafka stream to consume messages from one kafka topic.
Due to some business logic, we ignore all the packets before 8am by returning
{{-1L}} from {{CustomTimestampExtractor}} for all such packets.
We start consuming all the packets after 8am.
Everything is running fine, but consumer lag on my consumer group before 8am
keeps increasing and goes to 0 after 8am.
{{{}[commit.interval.ms|http://commit.interval.ms/]{}}}{{{}=1000{}}} commit
interval is set to 1s
--
This message was sent by Atlassian Jira
(v8.20.10#820010)