[ https://issues.apache.org/jira/browse/IMPALA-11388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793344#comment-17793344 ]
Gabor Kaszab commented on IMPALA-11388: --------------------------------------- FYI, I decided to make this an EPIC and split the work up to multiple items so that we can deliver functionality gradually. > Add support for equality-based deletes > -------------------------------------- > > Key: IMPALA-11388 > URL: https://issues.apache.org/jira/browse/IMPALA-11388 > Project: IMPALA > Issue Type: Epic > Components: Frontend > Reporter: Zoltán Borók-Nagy > Assignee: Gabor Kaszab > Priority: Major > Labels: impala-iceberg > > Iceberg V2 adds support for row-level modifications. > One way to implement this is via equality based delete files: > https://iceberg.apache.org/spec/#equality-delete-files > https://iceberg.apache.org/spec/#scan-planning > We could implement this via doing ANTI HASH JOIN between data and delete > files. Similarly to what we do for Hive full ACID tables: > https://github.com/apache/impala/blob/f5fc08573352d0a1943296209791a4db17268086/fe/src/main/java/org/apache/impala/planner/SingleNodePlanner.java#L1729-L1735 > The complexity comes when different delete files use different set of > columns. In that case we will need multiple ANTI HASH JOINs on top of each > other. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org