Zoltan Borok-Nagy has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/24270 )
Change subject: IMPALA-14937: (part 2) Enable MERGE for Iceberg V3 ...................................................................... IMPALA-14937: (part 2) Enable MERGE for Iceberg V3 This is the second part of a multi-part implementation adding MERGE support for Iceberg V3 tables with deletion vectors. This change enables MERGE for Iceberg V3 tables, IcebergMergeQueryGenerator is extended with V3 row-lineage support, the format-version gate is bumped to V3. The getShuffleExprs method is adapted to handle unpartitioned cases correctly as each data file must be referenced by only one deletion vectors, previously MERGE was allowed to create multiple delete files for each data file. Testing: - added iceberg-v3-merge.test Change-Id: Ie5813d293c35cb084bda89aa0cf6df5cb420d2ea Reviewed-on: http://gerrit.cloudera.org:8080/24270 Tested-by: Impala Public Jenkins <[email protected]> Reviewed-by: Zoltan Borok-Nagy <[email protected]> --- M fe/src/main/java/org/apache/impala/analysis/IcebergMergeImpl.java M fe/src/main/java/org/apache/impala/analysis/IcebergMergeQueryGenerator.java M fe/src/main/java/org/apache/impala/analysis/MergeCase.java M fe/src/main/java/org/apache/impala/analysis/MergeImpl.java M fe/src/main/java/org/apache/impala/analysis/MergeStmt.java M fe/src/main/java/org/apache/impala/util/IcebergUtil.java M fe/src/test/java/org/apache/impala/analysis/MergeInsertTest.java A testdata/workloads/functional-query/queries/QueryTest/iceberg-v3-merge.test M testdata/workloads/functional-query/queries/QueryTest/iceberg-v3-negative.test M tests/query_test/test_iceberg.py 10 files changed, 1,421 insertions(+), 19 deletions(-) Approvals: Impala Public Jenkins: Verified Zoltan Borok-Nagy: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/24270 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Ie5813d293c35cb084bda89aa0cf6df5cb420d2ea Gerrit-Change-Number: 24270 Gerrit-PatchSet: 11 Gerrit-Owner: Peter Rozsa <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Peter Rozsa <[email protected]> Gerrit-Reviewer: Steve Carlin <[email protected]> Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
