Noemi Pap-Takacs has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/24093 )
Change subject: IMPALA-14592: Enable OPTIMIZE for Iceberg V3 tables ...................................................................... IMPALA-14592: Enable OPTIMIZE for Iceberg V3 tables Row Lineage data is mandatory for Iceberg V3 tables, therefore we disabled all write operations that should but cannot write the Row Lineage fields 'row-id' and 'last-updated-sequence-number'. The OPTIMIZE TABLE statement must preserve the original Row Lineage values assigned to the rows, therefore it must persist them in the compacted data files. This patch extends the OptimizeStmt class to generate the proper expressions needed for Row Lineage. Testing * e2e tests added Change-Id: I1c3cc4b9aaa46e494e1aa4583c1a6aafecad48de Reviewed-on: http://gerrit.cloudera.org:8080/24093 Tested-by: Impala Public Jenkins <[email protected]> Reviewed-by: Noemi Pap-Takacs <[email protected]> --- M fe/src/main/java/org/apache/impala/analysis/OptimizeStmt.java M fe/src/main/java/org/apache/impala/util/IcebergUtil.java M testdata/workloads/functional-query/queries/QueryTest/iceberg-v3-negative.test A testdata/workloads/functional-query/queries/QueryTest/iceberg-v3-optimize.test M tests/query_test/test_iceberg.py 5 files changed, 280 insertions(+), 19 deletions(-) Approvals: Impala Public Jenkins: Verified Noemi Pap-Takacs: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/24093 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I1c3cc4b9aaa46e494e1aa4583c1a6aafecad48de Gerrit-Change-Number: 24093 Gerrit-PatchSet: 6 Gerrit-Owner: Zoltan Borok-Nagy <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Noemi Pap-Takacs <[email protected]> Gerrit-Reviewer: Peter Rozsa <[email protected]> Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
