Shohei Okumiya created HIVE-28727:
-------------------------------------
Summary: Iceberg: Null partitions make major compactions fail
Key: HIVE-28727
URL: https://issues.apache.org/jira/browse/HIVE-28727
Project: Hive
Issue Type: Bug
Components: Iceberg integration
Affects Versions: 4.0.1
Reporter: Shohei Okumiya
Assignee: Shohei Okumiya
OPTIMIZE TABLE ... REWRITE DATA or ALTER TABLE ... COMPACT 'major' fails when
null partitions are included.
{code:java}
[ERROR] Failures:
[ERROR] TestIcebergLlapLocalCompactorCliDriver.testCliDriver:89 Client
execution failed with error code = 40000
running
alter table ice_orc COMPACT 'major' and wait
fname=iceberg_major_compaction_partition_evolution.q
See ./ql/target/tmp/log/hive.log or ./itests/qtest/target/tmp/log/hive.log, or
check ./ql/target/surefire-reports or ./itests/qtest/target/surefire-reports/
for specific test cases logs.
java.lang.RuntimeException: Error retrieving value of partition field
company_id
at
org.apache.iceberg.mr.hive.IcebergTableUtil.lambda$toPartitionData$20(IcebergTableUtil.java:399)
at java.util.Optional.orElseThrow(Optional.java:290)
at
org.apache.iceberg.mr.hive.IcebergTableUtil.toPartitionData(IcebergTableUtil.java:398)
at
org.apache.iceberg.mr.hive.IcebergTableUtil.lambda$null$25(IcebergTableUtil.java:483)
at org.apache.iceberg.io.CloseableIterable$7$1.next(CloseableIterable.java:202)
at org.apache.iceberg.io.FilterIterator.advance(FilterIterator.java:65)
at org.apache.iceberg.io.FilterIterator.hasNext(FilterIterator.java:49)
at java.lang.Iterable.forEach(Iterable.java:74)
at
org.apache.iceberg.mr.hive.IcebergTableUtil.lambda$getPartitionInfo$28(IcebergTableUtil.java:492)
at java.lang.Iterable.forEach(Iterable.java:75)
at
org.apache.iceberg.mr.hive.IcebergTableUtil.getPartitionInfo(IcebergTableUtil.java:478)
at
org.apache.iceberg.mr.hive.IcebergTableUtil.getPartitionNames(IcebergTableUtil.java:522)
at
org.apache.iceberg.mr.hive.HiveIcebergStorageHandler.getPartitions(HiveIcebergStorageHandler.java:2023)
at
org.apache.hadoop.hive.ql.metadata.HiveStorageHandler.getPartitions(HiveStorageHandler.java:888)
at org.apache.hadoop.hive.ql.metadata.Hive.getPartitions(Hive.java:4150)
at
org.apache.hadoop.hive.ql.ddl.table.storage.compact.AlterTableCompactOperation.getPartitions(AlterTableCompactOperation.java:175)
at
org.apache.hadoop.hive.ql.ddl.table.storage.compact.AlterTableCompactOperation.execute(AlterTableCompactOperation.java:88)
at org.apache.hadoop.hive.ql.ddl.DDLTask.execute(DDLTask.java:84) {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
