Kamal Chandraprakash created KAFKA-15352:
--------------------------------------------

             Summary: Ensure consistency while deleting the remote log segments
                 Key: KAFKA-15352
                 URL: https://issues.apache.org/jira/browse/KAFKA-15352
             Project: Kafka
          Issue Type: Task
            Reporter: Kamal Chandraprakash


In Kafka-14888, the remote log segments are deleted which breaches the 
retention time/size before updating the log-start-offset. In middle of 
deletion, if the consumer starts to read from the beginning of the topic, then 
it will fail to read the messages and UNKNOWN_SERVER_ERROR will be thrown back 
to the consumer.

To ensure consistency, similar to local log segments where the actual segments 
are deleted after {{segment.delete.delay.ms}}, we should update the 
log-start-offset first before deleting the remote log segment.

See the [PR#13561|https://github.com/apache/kafka/pull/13561] and 
[comment|https://github.com/apache/kafka/pull/13561#discussion_r1293086543] for 
more details.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to