SaketaChalamchala opened a new pull request, #10250:
URL: https://github.com/apache/ozone/pull/10250

   ## What changes were proposed in this pull request?
   
   After [HDDS-14829](https://issues.apache.org/jira/browse/HDDS-14829) 
snapshot diff cleanup has been decoupled with snapshot diff job re-submission. 
So, the job does not need to be aggressively cleaned up to allow re-submission 
and risk missing the actual job status because it has been cleaned up.
   If a snapshot diff job generates a partial report before it is classified as 
failed / is cancelled then, the cleanup skips removal of the report entries 
because `totalDiffEntries` is not updated for these jobs and cleanup only 
cleans jobs with `totalDiffEntries > 0`.
   
   Proposed to
   1. Increase the snapshot diff cleanup interval to 1h. Job status of 
failed/rejected/cancelled jobs can be retrieved for up to 1h before it is 
cleaned up. Job status of completed job is still retained for the configured 
time. 
   2. Diff cleanup cleans up all entries of jobs in the purged table regardless 
of whether `totalDiffEntries > 0` i.e., cleanup job does a deleteRange for all 
jobs in the purged table.
    
   ## What is the link to the Apache JIRA
   
   https://issues.apache.org/jira/browse/HDDS-15166
   
   ## How was this patch tested?
   
   Unit tests
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to