Michael Bingham created KAFKA-9209:
--------------------------------------
Summary: Avoid sending unnecessary offset updates from consumer
after KIP-211
Key: KAFKA-9209
URL: https://issues.apache.org/jira/browse/KAFKA-9209
Project: Kafka
Issue Type: Improvement
Components: consumer
Affects Versions: 2.3.0
Reporter: Michael Bingham
With KIP-211
([https://cwiki.apache.org/confluence/display/KAFKA/KIP-211%3A+Revise+Expiration+Semantics+of+Consumer+Group+Offsets]),
offsets will no longer expire as long as the consumer group is active.
If the consumer has {{enable.auto.commit=true}}, and if no new events are
arriving on subscribed partition(s), the consumer still sends offsets
(unchanged) to the group coordinator just to keep them from expiring. This is
no longer necessary, and an optimization could potentially be implemented to
only send offsets with auto commit when there are actual updates to be made
(i.e., when new events have been processed).
This would require detecting whether the broker supports the new expiration
semantics in KIP-211, and only apply the optimization when it does.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
