[ https://issues.apache.org/jira/browse/KAFKA-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302980#comment-17302980 ]
A. Sophie Blee-Goldman edited comment on KAFKA-12485 at 3/17/21, 12:04 AM: --------------------------------------------------------------------------- Side note: if we get this optimization in then we should be able to skip the last(\?) followup for KIP-572: handling TimeoutExceptions thrown from the mainConsumer#committed call when reinitializing offsets for corrupted tasks in TaskManager#closeAndRevive. cc [~mjsax] was (Author: ableegoldman): Side note: if we get this optimization in then we should be able to skip the last (\?) followup for KIP-572: handling TimeoutExceptions thrown from the mainConsumer#committed call when reinitializing offsets for corrupted tasks in TaskManager#closeAndRevive. cc [~mjsax] > Speed up Consumer#committed by returning cached offsets for owned partitions > ---------------------------------------------------------------------------- > > Key: KAFKA-12485 > URL: https://issues.apache.org/jira/browse/KAFKA-12485 > Project: Kafka > Issue Type: Improvement > Components: consumer > Reporter: A. Sophie Blee-Goldman > Priority: Major > Labels: newbie++ > > All of the KafkaConsumer#committed APIs will currently make a remote blocking > call to the server to fetch the committed offsets. This is typically used to > reset the offsets after a crash or restart, or to fetch offsets for other > consumers in the group. However some users may wish to invoke this API on > partitions which are currently owned by the Consumer, in which case the > remote call is unnecessary since it should be able to just keep track of what > it has itself committed. > We should consider optimizing these APIs to just return the cached offsets in > place of the remote call when passed in only partitions that are currently > owned. This is similar to what we do in Consumer#position, although there we > have a guarantee that the partitions are owned by the Consumer whereas in > #committed we do not -- This message was sent by Atlassian Jira (v8.3.4#803005)