Attila Jeges has uploaded a new patch set (#2). ( http://gerrit.cloudera.org:8080/17723 )
Change subject: IMPALA-10739: Support setting new partition spec for Iceberg tables ...................................................................... IMPALA-10739: Support setting new partition spec for Iceberg tables With this patch Impala will support partition evolution for Iceberg tables. The DDL statement to change the default partition spec is: ALTER TABLE <tbl> SET PARTITION SPEC(<partition-spec>) Hive uses the same SQL syntax. Testing: - Added FE test to exercise parsing various well-formed and ill-formed ALTER TABLE SET PARTITION SPEC statements. - Added e2e tests for: - ALTER TABLE SET PARTITION SPEC works for tables with HadoopTables and HadoopCatalog Catalog. - When evolving partition spec, the old data written with an earlier spec remains unchanged. New data is written using the new spec in a new layout. Data written with earlier spec and new spec can be fetched in a single query. - Invalid ALTER TABLE SET PARTITION SPEC statements yield the expected analysis error messages. Change-Id: I9bd935b8a82e977df9ee90d464b5fe2a7acc83f2 --- M be/src/exec/hdfs-table-sink.cc M common/thrift/JniCatalog.thrift M fe/src/main/cup/sql-parser.cup A fe/src/main/java/org/apache/impala/analysis/AlterTableSetPartitionSpecStmt.java M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java M fe/src/main/java/org/apache/impala/service/IcebergCatalogOpExecutor.java M fe/src/test/java/org/apache/impala/analysis/ParserTest.java M testdata/workloads/functional-query/queries/QueryTest/iceberg-alter.test M testdata/workloads/functional-query/queries/QueryTest/iceberg-negative.test M testdata/workloads/functional-query/queries/QueryTest/iceberg-partitioned-insert.test 10 files changed, 306 insertions(+), 3 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/23/17723/2 -- To view, visit http://gerrit.cloudera.org:8080/17723 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I9bd935b8a82e977df9ee90d464b5fe2a7acc83f2 Gerrit-Change-Number: 17723 Gerrit-PatchSet: 2 Gerrit-Owner: Attila Jeges <atti...@cloudera.com> Gerrit-Reviewer: Attila Jeges <atti...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Zoltan Borok-Nagy <borokna...@cloudera.com>