aokolnychyi commented on code in PR #9454:
URL: https://github.com/apache/iceberg/pull/9454#discussion_r1484844316
##########
core/src/main/java/org/apache/iceberg/ManifestFilterManager.java:
##########
@@ -289,13 +321,38 @@ private void invalidateFilteredCache() {
cleanUncommitted(SnapshotProducer.EMPTY_SET);
}
+ private void recordPartitionMinDataSequenceNumber(ManifestFile manifest) {
Review Comment:
Okay, I think we all agree that we should use partition stats if they are
available and read manifests otherwise. We may think about extending our
regular writes to check if there is a partition stats file available and drop
the delete files per partition rather than globally, like it is done today. We
shouldn't open manifests during writes. We can only do that in a distributed
fashion, meaning it has to be part of an action. There we either can add a new
action or integrate this logic into the existing action.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
