Zoltan Borok-Nagy has uploaded this change for review. ( http://gerrit.cloudera.org:8080/24093
Change subject: IMPALA-14592: Enable OPTIMIZE for Iceberg V3 tables ...................................................................... IMPALA-14592: Enable OPTIMIZE for Iceberg V3 tables Row Lineage data is mandatory for Iceberg V3 tables, therefore we disabled all write operations that should but cannot write the Row Lineage fields 'row-id' and 'last-updated-sequence-number'. The OPTIMIZE TABLE statement must preserve the original Row Lineage values assigned to the rows, therefore it must persist them in the compacted data files. This patch extends the OptimizeStmt class to generate the proper expressions needed for Row Lineage. Testing * e2e tests added Change-Id: I1c3cc4b9aaa46e494e1aa4583c1a6aafecad48de --- M fe/src/main/java/org/apache/impala/analysis/OptimizeStmt.java A testdata/workloads/functional-query/queries/QueryTest/iceberg-v3-optimize.test M tests/query_test/test_iceberg.py 3 files changed, 156 insertions(+), 7 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/93/24093/1 -- To view, visit http://gerrit.cloudera.org:8080/24093 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I1c3cc4b9aaa46e494e1aa4583c1a6aafecad48de Gerrit-Change-Number: 24093 Gerrit-PatchSet: 1 Gerrit-Owner: Zoltan Borok-Nagy <[email protected]>
