ganesh-sadanala opened a new pull request, #16080: URL: https://github.com/apache/kafka/pull/16080
## Description This pull request improves the documentation for the `offset.lag.max` configuration in Apache Kafka's MirrorMaker. The current documentation is brief and lacks context about the role of this configuration in offset translation and potential use cases. The updated documentation provides a more comprehensive explanation of `offset.lag.max` and its impact on the synchronization between source and remote partitions. It clarifies that `offset.lag.max` determines the maximum allowed lag between the source and remote partitions before MirrorMaker initiates a resync operation to catch up the remote partition. The documentation also covers the following aspects: - How the lag is calculated (the difference between the latest offset in the source partition and the last committed offset in the remote partition) - The resync operation process (reading records from the source partition starting from the last committed offset in the remote partition and writing them to the remote partition) - Use cases for setting a lower `offset.lag.max` value (scenarios where records may not flow constantly or at a consistent rate, ensuring remote partitions stay more closely in sync during periods of low throughput or inactivity) - Use cases for setting a higher `offset.lag.max` value (when the source topic has high throughput and remote partitions can tolerate a larger lag) - The possibility of setting `offset.lag.max` to 0 (initiating a resync operation as soon as the remote partition falls behind the source partition, useful for strict synchronization requirements but may increase the load on the source cluster due to frequent resync operations) ### Committer Checklist (excluded from commit message) - [x] Verify design and implementation - [x] Verify test coverage and CI build status - [x] Verify documentation (including upgrade notes) Note: The contribution is my original work and I license the work to the project under the project's open source license. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
