jpountz opened a new pull request, #13216: URL: https://github.com/apache/lucene/pull/13216
The variable-gaps terms format uses the legacy storage layout of storing metadata at the end of the index file, and storing the start pointer of the metadata as the last 8 bytes of the index files (just before the footer). This forces an awkward access pattern at open time when we first need to seek towards the end to check that a footer is present, then seek some more bytes backwards to read metadata, and finally read the content of the index that sits before metadata. To fix this, meta data and index data are now split into different files. This way, both files have a clean sequential and read-once access pattern, and can take advantage of the `ChecksumIndexInput` abstraction for checksum validation. This further helps clean up `IOContext` by removing the ability to set `readOnce` to `true` on an existing `IOContext`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
