clintropolis opened a new pull request, #20338:
URL: https://github.com/apache/druid/pull/20338

   ### Description
   Follow-up to #20267, this PR makes bootstrap when virtual storage mode with 
partial loads is enabled migrate any existing full cache v10 entries (with a 
load spec that is range capable) into partial layout using 
`DirectoryBackedRangeReader` pointed at the existing segment files. This 
trades-off some overhead during boot to convert these cache entries in exchange 
for nicer behavior if the rule changes to a partial load rule (currently we 
have to drop then load). This happens during bootstrap so we don't have to deal 
with swapping mmap files and cache entries with the same id and such. This 
conversion does require extra startup time to do the conversion, and there 
needs to be a bit of extra space since it needs to basically duplicate the 
segment into its partial format before it can remove the old one, but these 
seemed like acceptable trade-offs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to