yingjianwu98 opened a new pull request, #15017:
URL: https://github.com/apache/iceberg/pull/15017
This PR adds the row filter expression to CommitReport, enabling
observability into what data was targeted by delete and overwrite operations.
Currently, CommitReport captures operation metrics (files added/removed,
records affected, etc.) but lacks context about what data was targeted. For
delete and overwrite operations that use row filters (e.g., DELETE FROM table
WHERE id > 100), there's no way to know what filter was used from the commit
report alone.
This information is valuable for:
- Audit & Compliance: Track what data was deleted or overwritten for
regulatory requirements
- Observability & Debugging: Understand the scope of changes when
investigating issues
- Data Lineage: Capture the intent behind data mutations, not just the
outcome
ScanReport already captures the filter expression for read operations.
This PR brings parity to write operations.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
