fatmanverse commented on issue #18295: URL: https://github.com/apache/dolphinscheduler/issues/18295#issuecomment-5011498487
I would like to share my opinion after reading the related discussions. I understand the concerns about automatically deleting user data and why hard deletion is being considered for the MVP. However, from a customer/operator perspective, different users may have different retention requirements. Some users may want to delete old logs directly, while others may need to keep them for auditing, troubleshooting, or compliance purposes. In my opinion, the retention policy could eventually provide options such as: 1. Delete instance logs older than a configured number of days. 2. Archive instance logs older than a configured number of days and keep the archives locally. 3. Archive instance logs older than a configured number of days and move the archives to configured remote storage. For archived logs, it would also be useful to preserve enough metadata to locate and understand them after the original instance records are cleaned up. I am not suggesting that all of these options must be implemented in the MVP. Even if the first version supports only deletion, keeping the design extensible for future archive and remote-storage options would be valuable. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
