jerqi opened a new issue, #282: URL: https://github.com/apache/incubator-uniffle/issues/282
### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) ### Search before asking - [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no similar issues. ### Describe the feature Because we don't use strict lock strategy, we will delete some shuffle data normally. If we use strict lock strategy, the performance will be bad. So we want to add a period local storage cleaner thread. The thread examine which application is in the disk and judge whether the app exists the memory data structure `ShuffleTaskManager#shuffleTaskInfos`. If memory data structure don't exist, we will delete the data in the disk. ### Motivation Reduce the garbage data. The data won't be deleted unless the shuffle server is restarted. ### Describe the solution _No response_ ### Additional context _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
