paul-bormans-pcgw commented on issue #11695:
URL: https://github.com/apache/iceberg/issues/11695#issuecomment-2548089198
I did another test run with more debug info but it doesn't make sense to me;
it seems when a snapshot expires which has operation="delete", the
findFilesToDelete doesn't find any entries inside the manifest with status
DELETED?
```
SplitRunner-20241216_162336_00244_5v5h5.0.0.0-1-2254
org.apache.iceberg.IncrementalFileCleanup Expired snapshot:
BaseSnapshot{id=3231194833683786375, timestamp_ms=1734355116274,
operation=delete, summary={trino_query_id=20241216_131810_00097_5v5h5,
added-position-delete-files=94, added-delete-files=94,
added-files-size=14250935, added-position-deletes=10695387,
changed-partition-count=1, total-records=66602999,
total-files-size=10931827904, total-data-files=573, total-delete-files=94,
total-position-deletes=10695387, total-equality-deletes=0,
iceberg-version=Apache Iceberg 1.6.1 (commit
8e9d59d299be42b0bca9461457cd1e95dbaad086)},
manifest-list=s3://demobucket/ts.db/pack/metadata/snap-3231194833683786375-2-07d2a425-cbbd-45f2-b63b-7411726a1e75.avro,
schema-id=1}
<...>
org.apache.iceberg.IncrementalFileCleanup Evaluate manifests to find
files to delete; manifestsToScan: [
GenericManifestFile{content=DATA,
path=s3://demobucket/ts.db/pack/metadata/07d2a425-cbbd-45f2-b63b-7411726a1e75-m2.avro,
length=492480, partition_spec_id=1, added_snapshot_id=3231194833683786375,
added_data_files_count=null, added_rows_count=null,
existing_data_files_count=null, existing_rows_count=null,
deleted_data_files_count=null, deleted_rows_count=null, partitions=null,
key_metadata=null, sequence_number=0, min_sequence_number=0},
SplitRunner-20241216_162336_00244_5v5h5.0.0.0-1-2254
org.apache.iceberg.IncrementalFileCleanup Files to delete: []
```
What am i missing here? Why doesn't a DELETE query on Trino result in
Manifest entries with status DELETED?
Paul
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
