nicktelford opened a new pull request, #20954: URL: https://github.com/apache/kafka/pull/20954
Instead of reading Task state offsets for non-open Tasks from the `.checkpoint` file, we now maintain an in-memory cache of the latest changelog offsets for every Task on the instance. On start-up, this cache is seeded with the changelog offsets for every on-disk StateStore. Running Active and Standby Tasks then update this cache on every checkpoint to ensure it always reflects the offsets on-disk. This breaks the tight coupling between `TaskManager` and `.checkpoint` files, which will enable us to remove `.checkpoint` files in a later commit as part of KIP-1035. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
