Hello Peter Rozsa, Noemi Pap-Takacs, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/24093
to look at the new patch set (#4).
Change subject: IMPALA-14592: Enable OPTIMIZE for Iceberg V3 tables
......................................................................
IMPALA-14592: Enable OPTIMIZE for Iceberg V3 tables
Row Lineage data is mandatory for Iceberg V3 tables, therefore
we disabled all write operations that should but cannot write
the Row Lineage fields 'row-id' and 'last-updated-sequence-number'.
The OPTIMIZE TABLE statement must preserve the original Row Lineage
values assigned to the rows, therefore it must persist them in
the compacted data files. This patch extends the OptimizeStmt class
to generate the proper expressions needed for Row Lineage.
Testing
* e2e tests added
Change-Id: I1c3cc4b9aaa46e494e1aa4583c1a6aafecad48de
---
M fe/src/main/java/org/apache/impala/analysis/OptimizeStmt.java
M fe/src/main/java/org/apache/impala/util/IcebergUtil.java
M testdata/workloads/functional-query/queries/QueryTest/iceberg-v3-negative.test
A testdata/workloads/functional-query/queries/QueryTest/iceberg-v3-optimize.test
M tests/query_test/test_iceberg.py
5 files changed, 280 insertions(+), 19 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/93/24093/4
--
To view, visit http://gerrit.cloudera.org:8080/24093
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I1c3cc4b9aaa46e494e1aa4583c1a6aafecad48de
Gerrit-Change-Number: 24093
Gerrit-PatchSet: 4
Gerrit-Owner: Zoltan Borok-Nagy <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Noemi Pap-Takacs <[email protected]>
Gerrit-Reviewer: Peter Rozsa <[email protected]>
Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
