Re: [I] Data files which are still useful are mistakenly cleaned up when trying to expire a specified snapshot [iceberg]

2024-09-09 Thread via GitHub
hantangwangd closed issue #10982: Data files which are still useful are mistakenly cleaned up when trying to expire a specified snapshot URL: https://github.com/apache/iceberg/issues/10982 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] Data files which are still useful are mistakenly cleaned up when trying to expire a specified snapshot [iceberg]

2024-08-21 Thread via GitHub
hantangwangd commented on issue #10982: URL: https://github.com/apache/iceberg/issues/10982#issuecomment-2301489759 As I understand, we should not directly clean a file in a DELETE entry of the expired snapshot, but can only clean it safely when one of the following conditions are met:

[I] Data files which are still useful are mistakenly cleaned up when trying to expire a specified snapshot [iceberg]

2024-08-20 Thread via GitHub
hantangwangd opened a new issue, #10982: URL: https://github.com/apache/iceberg/issues/10982 ### Apache Iceberg version 1.6.0 (latest release) ### Query engine None ### Please describe the bug 🐞 When using the policy of `IncrementalFileCleanup` to expire a s