zhongyujiang commented on issue #6694: URL: https://github.com/apache/iceberg/issues/6694#issuecomment-1408449585
> But flink's new added position deletes should only appy to the new added data files, not history (rewritting) data files, so this should not hinder the rewrite operation if it works corrctly. Unfortunately, 6313 cannot completely solve this problem. It is not enough to use the upper bound and lower bound of `file_path` to detect whether there is a conflict. Even if metrics are complete, DeleteFileIndex.canContainPosDeletesForFile() still cannot completely filter out unmatched delete files. There is another PR #5760 trying to fix this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
