prashantwason commented on pull request #2487: URL: https://github.com/apache/hudi/pull/2487#issuecomment-875308439
This is a very comprehensive implementation for the record-level index. There are some changes required to the current Metadata Table design to enable record-level-index: 1. Synchronous updates of metadata table 2. Performance improvement for multi key-lookups (requires for tagLocation) 3. In-line file system for point lookup of keys from HFile Blocks in log files so we dont have to load the entire log block in memory I am working on these changes and should be complete before end of July. @nsivabalan I will be happy to collaborate with your to take this draft towards the Hoodie Metadata Table based record-level-index. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
