GeorgeJahad opened a new pull request, #5104: URL: https://github.com/apache/ozone/pull/5104
## What changes were proposed in this pull request? Currently the compaction pauses lasts for the entire duration of the tarball creation/network transfer. By copying the compaction logs and linking the backup sst files to temp directories, we can reduce this to just the time of the copy/link and the checkpointing of the active fs. ### A few details: The pause code was in the generic bootstrap superclass, DBCheckpointServlet. That code is used for bootstrapping all ratis followers, not just the OM, so I moved the code into the OM specific subclass, OMDBCheckpointServlet. The file walker code that gets the files and links has been modified to skip the real directories, (after the copy,) and read from the temp dirs. In the previous PR the waitForTarballCreation() was only called from the onCompactionComplete listener. Since the sst files are backed up in the onCompactionBegin() listener I added a waitForTarballCreation() there as well I also changed copyFiles, (the collection of files to be copied,) from a Set to a Map. I needed to keep track of both the source and the destination of the files to be copied. Previously they were the same. Now the source could be one of the temp directories, or it could be a real directory. ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-9064 ## How was this patch tested? added unit tests -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
