dramaticlly opened a new pull request, #15003:
URL: https://github.com/apache/iceberg/pull/15003
Currently iceberg commit does not expose the manifest level information, so
it's difficult to see how metadata will evolve with given snapshot.
Now snapshot summary will also include following information about the table
commit
- `manifests-created`: new manifest was created by the same snapshot
- `manifests-replaced`: manifest was filtered (in-place rewrite)/merged by
the merging snapshot producer
- `manifest-kept`: existing manifest was carried over where it's created by
the older snapshot prior to the commit
```java
// append create 1 manifest for 2 files
table.newAppend().appendFile(FILE_A).appendFile(FILE_B).commit()
assertThat(appendFile.summary())
.containsEntry(SnapshotSummary.CREATED_MANIFESTS_COUNT, "1")
.containsEntry(SnapshotSummary.REPLACED_MANIFESTS_COUNT, "0")
.containsEntry(SnapshotSummary.KEPT_MANIFESTS_COUNT, "0");
// delete will copy-on-write to replace one of the manifest-entry for the
existing manifest
table.newDelete().deleteFile(FILE_A).commit()
assertThat(deleteFile.summary())
.containsEntry(SnapshotSummary.CREATED_MANIFESTS_COUNT, "1")
.containsEntry(SnapshotSummary.REPLACED_MANIFESTS_COUNT, "1")
.containsEntry(SnapshotSummary.KEPT_MANIFESTS_COUNT, "0");
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
