[
https://issues.apache.org/jira/browse/KAFKA-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Divij Vaidya updated KAFKA-17995:
---------------------------------
Description:
If a user has configured value of "retention.ms" to a value > current unix
timestamp epoch, then at this line of code [1] , cleanupUntilMs becomes
negative. This is because cleanupUntilMs is calculated as current unix epoch -
retention.ms [1].
This leads to cleaner failures at
[https://github.com/apache/kafka/blob/5a5239770ff3565233e5cbecf11446e76339f8fe/core/src/main/java/kafka/log/remote/RemoteLogManager.java#L2218]
and hence, all cleaning for that topic partition stops.
[1]
[https://github.com/apache/kafka/blob/5a5239770ff3565233e5cbecf11446e76339f8fe/core/src/main/java/kafka/log/remote/RemoteLogManager.java#L1397]
was:
If a user has configured value of "retention.ms" to a value > current unix
timestamp epoch, then at this line of code [1] , cleanupUntilMs becomes
negative. This is because cleanupUntilMs is calculated as current unix epoch -
retention.ms [1].
This leads to cleaner failures at
[https://github.com/apache/kafka/blob/5a5239770ff3565233e5cbecf11446e76339f8fe/core/src/main/java/kafka/log/remote/RemoteLogManager.java#L2218]
and hence, all cleaning stops.
[1]
[https://github.com/apache/kafka/blob/5a5239770ff3565233e5cbecf11446e76339f8fe/core/src/main/java/kafka/log/remote/RemoteLogManager.java#L1397]
> Large value for `retention.ms` could prevent remote data cleanup in Tiered
> Storage
> ----------------------------------------------------------------------------------
>
> Key: KAFKA-17995
> URL: https://issues.apache.org/jira/browse/KAFKA-17995
> Project: Kafka
> Issue Type: Bug
> Components: Tiered-Storage
> Affects Versions: 3.8.1
> Reporter: Divij Vaidya
> Priority: Major
>
> If a user has configured value of "retention.ms" to a value > current unix
> timestamp epoch, then at this line of code [1] , cleanupUntilMs becomes
> negative. This is because cleanupUntilMs is calculated as current unix epoch
> - retention.ms [1].
> This leads to cleaner failures at
> [https://github.com/apache/kafka/blob/5a5239770ff3565233e5cbecf11446e76339f8fe/core/src/main/java/kafka/log/remote/RemoteLogManager.java#L2218]
> and hence, all cleaning for that topic partition stops.
> [1]
> [https://github.com/apache/kafka/blob/5a5239770ff3565233e5cbecf11446e76339f8fe/core/src/main/java/kafka/log/remote/RemoteLogManager.java#L1397]
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
