iit2009060 commented on PR #15060:
URL: https://github.com/apache/kafka/pull/15060#issuecomment-1877528171

   > Thanks @iit2009060 for the PR.
   > 
   > Let us say there are two segments in remote storage and subsequents 
segments in local storage. remote-seg-10[10, 20], remote-seg-21[21, 30] : 
offsets 25 to 30 are compacted. local-seg-31[31, 40]
   > 
   > When a fetch request comes for offsets with in [25, 30] then it should 
move to the local segment as those offsets might have been compacted earlier. 
Did you also cover this scenario in this PR?
   
   @satishd  I am trying to reproduce the case  when last offsets of the 
segment  earlier than the active segment is compacted away. 
   I tried locally but not able to reproduce the above scenario ? 
   There always exist a last offset  in the segment earlier than the active 
segment. 
   As per the article 
   
https://towardsdatascience.com/log-compacted-topics-in-apache-kafka-b1aa1e4665a7
   All records in the active segment are never compacted. 
   @satishd  Do you have a step in mind to regenerate the above scenario ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to