[ 
https://issues.apache.org/jira/browse/KAFKA-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954406#comment-16954406
 ] 

ASF GitHub Bot commented on KAFKA-9065:
---------------------------------------

dajac commented on pull request #7554: KAFKA-9065; Loading offsets and group 
metadata loops forever 
URL: https://github.com/apache/kafka/pull/7554
 
 
   When the metadata manager loads the groups and the offsets of a partition of 
the `__consumer-offsets` topic, `GroupMetadataManager.doLoadGroupsAndOffsets` 
could loop forever if the start offset of the partition is smaller than the end 
offset and no records are effectively read from the partition.
   
   While the conditions leading to this issue are not clear, I've got the case 
where a partition was having two segments which were both empty in a cluster. 
This could theoretically happen when all the tombstones in the first are 
expired and the second is truncated or when the partition is accidentally 
corrupted.
   
   As a side effect, the `doLoadGroupsAndOffsets` spins forever, blocks the 
single thread of the scheduler, blocks the loading of all the groups and 
offsets which are after in the queue, and blocks the expiration of the offsets.
   
   ### Committer Checklist (excluded from commit message)
   - [ ] Verify design and implementation 
   - [ ] Verify test coverage and CI build status
   - [ ] Verify documentation (including upgrade notes)
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Loading offsets and group metadata loops forever
> ------------------------------------------------
>
>                 Key: KAFKA-9065
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9065
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: David Jacot
>            Assignee: David Jacot
>            Priority: Major
>
> When the metadata manager loads the groups and the offsets of a partition of 
> the __consumer-offsets topic, `GroupMetadataManager.doLoadGroupsAndOffsets` 
> could loop forever if the start offset of the partition is smaller than the 
> end offset and no records are effectively read from the partition.
> While the conditions leading to this issue are not clear, I've got the case 
> where a partition was having two segments which were both empty in a cluster. 
> This could theoretically happen when all the tombstones in the first are 
> expired and the second is truncated or when the partition is accidentally 
> corrupted.
> As a side effect, the `doLoadGroupsAndOffsets` spins forever, blocks the 
> single thread of the scheduler, blocks the loading of all the groups and 
> offsets which are after in the queue, and blocks the expiration of the 
> offsets.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to