[ https://issues.apache.org/jira/browse/KAFKA-9662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17053731#comment-17053731 ]
ASF GitHub Bot commented on KAFKA-9662: --------------------------------------- mumrah commented on pull request #8227: KAFKA-9662: Wait for consumer offset reset in throttle test to avoid losing early messages URL: https://github.com/apache/kafka/pull/8227 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Throttling system test fails when messages are produced before consumer > starts up > --------------------------------------------------------------------------------- > > Key: KAFKA-9662 > URL: https://issues.apache.org/jira/browse/KAFKA-9662 > Project: Kafka > Issue Type: Bug > Components: system tests > Reporter: Rajini Sivaram > Assignee: Rajini Sivaram > Priority: Major > Fix For: 2.5.0 > > > The tests produces large records using producer performance tool and then > starts another validating produce/consume loop for integer records. Consumer > starts consuming from the latest offset to avoid consuming the large records > produced earlier by the first producer. If the second producer starts > producing records before the consumer has reset its offset to latest offset, > then the consumer misses some records produced and the test fails: > {quote} > AssertionError: 762 acked message did not make it to the Consumer. They are: > 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19...plus > 742 more. Total Acked: 174330, Total Consumed: 173568. We validated that the > first 762 of these missing messages correctly made it into Kafka's data > files. This suggests they were lost on their way to the consumer. > {quote} -- This message was sent by Atlassian Jira (v8.3.4#803005)