[
https://issues.apache.org/jira/browse/IMPALA-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Noemi Pap-Takacs updated IMPALA-13184:
--------------------------------------
Description:
The partition layout of Iceberg tables can be changed. This is called partition
evolution.
Currently, if we want to update the partition spec to unpartition the table, we
can change the partition spec to void.
{code:java}
CREATE EXTERNAL TABLE ice_table (i INT NULL)
PARTITIONED BY SPEC(i)
STORED AS ICEBERG;
ALTER TABLE ice_table SET PARTITION SPEC(VOID(i));{code}
The partition column was 'i' and now it is 'void\(i)'.
{code:java}
SHOW CREATE TABLE ice_table;
result:
CREATE EXTERNAL TABLE ice_table (i INT NULL)
PARTITIONED BY SPEC(VOID(i))
STORED AS ICEBERG {code}
An unpartitioned table should not contain any partition field/transform.
{code:java}
SHOW CREATE TABLE ice_table_unpartitioned;
result:
CREATE EXTERNAL TABLE ice_table (i INT NULL)
STORED AS ICEBERG{code}
The output of DESCRIBE FORMATTED should also reflect this.
It would be nice to have a simple syntax that enables deleting the partition
spec to change the table to unpartitioned. Something like
{code:java}
ALTER TABLE ice_table SET PARTITION SPEC() {code}
was:
The partition layout of Iceberg tables can be changed. This is called partition
evolution.
If we want to update the partition spec to unpartition the table, we can change
the partition spec to void.
{code:java}
CREATE EXTERNAL TABLE ice_table (i INT NULL)
PARTITIONED BY SPEC(i)
STORED AS ICEBERG;
ALTER TABLE ice_table SET PARTITION SPEC(VOID(i));{code}
The partition column was 'i' and now it is 'void\(i)'.
{code:java}
SHOW CREATE TABLE ice_table;
result:
CREATE EXTERNAL TABLE ice_table (i INT NULL)
PARTITIONED BY SPEC(VOID(i))
STORED AS ICEBERG {code}
An unpartitioned table should not contain any partition field/transform.
{code:java}
SHOW CREATE TABLE ice_table_unpartitioned;
result:
CREATE EXTERNAL TABLE ice_table (i INT NULL)
STORED AS ICEBERG{code}
The output of DESCRIBE FORMATTED should also reflect this.
> Delete Partition Spec from Iceberg Table
> ----------------------------------------
>
> Key: IMPALA-13184
> URL: https://issues.apache.org/jira/browse/IMPALA-13184
> Project: IMPALA
> Issue Type: Improvement
> Components: fe, Frontend
> Reporter: Noemi Pap-Takacs
> Priority: Minor
> Labels: impala-iceberg, newbie, ramp-up
>
> The partition layout of Iceberg tables can be changed. This is called
> partition evolution.
> Currently, if we want to update the partition spec to unpartition the table,
> we can change the partition spec to void.
> {code:java}
> CREATE EXTERNAL TABLE ice_table (i INT NULL)
> PARTITIONED BY SPEC(i)
> STORED AS ICEBERG;
> ALTER TABLE ice_table SET PARTITION SPEC(VOID(i));{code}
> The partition column was 'i' and now it is 'void\(i)'.
> {code:java}
> SHOW CREATE TABLE ice_table;
> result:
> CREATE EXTERNAL TABLE ice_table (i INT NULL)
> PARTITIONED BY SPEC(VOID(i))
> STORED AS ICEBERG {code}
> An unpartitioned table should not contain any partition field/transform.
> {code:java}
> SHOW CREATE TABLE ice_table_unpartitioned;
> result:
> CREATE EXTERNAL TABLE ice_table (i INT NULL)
> STORED AS ICEBERG{code}
>
> The output of DESCRIBE FORMATTED should also reflect this.
> It would be nice to have a simple syntax that enables deleting the partition
> spec to change the table to unpartitioned. Something like
> {code:java}
> ALTER TABLE ice_table SET PARTITION SPEC() {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
