This is an automated email from the ASF dual-hosted git repository.
difin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git
from 341f5972749 HIVE-28693: Upgrade Atlas to 2.4.0 & spring-ldap-core to
2.4.4 (#5597) (Basapuram Kumar, reviewed by Raghav Aggarwal and Shohei Okumiya)
add 3520f4fb96c HIVE-28590: Iceberg: Add support for FILE_SIZE_THRESHOLD
to compaction command (#5540) (Dmitriy Fingerman reviewed by Denys Kuzmenko)
No new revisions were added by this update.
Summary of changes:
.../java/org/apache/hadoop/hive/conf/HiveConf.java | 2 -
.../mr/hive/HiveIcebergOutputCommitter.java | 16 +-
.../hive/compaction/IcebergCompactionService.java | 11 +-
.../mr/hive/compaction/IcebergCompactionUtil.java | 10 +-
...ryCompactor.java => IcebergQueryCompactor.java} | 28 ++-
.../compaction/evaluator/CompactionEvaluator.java | 193 ++++++++++++++
.../evaluator/IcebergCompactionEvaluator.java | 129 ----------
.../iceberg_major_compaction_partition_evolution.q | 2 +-
...iceberg_major_compaction_partition_evolution2.q | 2 +-
..._major_compaction_partition_evolution_ordered.q | 2 +-
...ction_partition_evolution_w_dyn_spec_w_filter.q | 3 +-
...action_partition_evolution_w_id_spec_w_filter.q | 2 +-
.../iceberg_major_compaction_partitioned.q | 2 +-
.../iceberg_major_compaction_query_metadata.q | 2 +-
.../iceberg_major_compaction_schema_evolution.q | 2 +-
.../iceberg_major_compaction_single_partition.q | 2 +-
...or_compaction_single_partition_with_evolution.q | 2 +-
...r_compaction_single_partition_with_evolution2.q | 2 +-
.../iceberg_major_compaction_unpartitioned.q | 2 +-
...ceberg_major_compaction_unpartitioned_ordered.q | 2 +-
...eberg_major_compaction_unpartitioned_w_filter.q | 2 +-
...iceberg_minor_compaction_partition_evolution.q} | 39 +--
.../iceberg_minor_compaction_unpartitioned.q | 66 +++++
...berg_major_compaction_partition_evolution.q.out | 6 +-
...erg_major_compaction_partition_evolution2.q.out | 6 +-
...or_compaction_partition_evolution_ordered.q.out | 6 +-
...n_partition_evolution_w_dyn_spec_w_filter.q.out | 4 +
...on_partition_evolution_w_id_spec_w_filter.q.out | 6 +-
.../iceberg_major_compaction_partitioned.q.out | 8 +-
.../iceberg_major_compaction_query_metadata.q.out | 5 +-
...iceberg_major_compaction_schema_evolution.q.out | 6 +-
...iceberg_major_compaction_single_partition.q.out | 7 +-
...ompaction_single_partition_with_evolution.q.out | 9 +-
...mpaction_single_partition_with_evolution2.q.out | 8 +-
.../iceberg_major_compaction_unpartitioned.q.out | 6 +-
...rg_major_compaction_unpartitioned_ordered.q.out | 6 +-
...g_major_compaction_unpartitioned_w_filter.q.out | 6 +-
...erg_minor_compaction_partition_evolution.q.out} | 199 +++++++++------
...> iceberg_minor_compaction_unpartitioned.q.out} | 280 ++++++++++-----------
.../test/resources/testconfiguration.properties | 4 +-
.../hadoop/hive/ql/parse/AlterClauseParser.g | 8 +-
.../hive/ql/txn/compactor/CompactorContext.java | 8 +
.../hive/ql/txn/compactor/CompactorFactory.java | 6 +-
.../metastore/txn/entities/CompactionInfo.java | 4 +
44 files changed, 689 insertions(+), 432 deletions(-)
rename
iceberg/iceberg-handler/src/main/java/org/apache/iceberg/mr/hive/compaction/{IcebergMajorQueryCompactor.java
=> IcebergQueryCompactor.java} (76%)
create mode 100644
iceberg/iceberg-handler/src/main/java/org/apache/iceberg/mr/hive/compaction/evaluator/CompactionEvaluator.java
delete mode 100644
iceberg/iceberg-handler/src/main/java/org/apache/iceberg/mr/hive/compaction/evaluator/IcebergCompactionEvaluator.java
copy
iceberg/iceberg-handler/src/test/queries/positive/{iceberg_major_compaction_partition_evolution2.q
=> iceberg_minor_compaction_partition_evolution.q} (51%)
create mode 100644
iceberg/iceberg-handler/src/test/queries/positive/iceberg_minor_compaction_unpartitioned.q
copy
iceberg/iceberg-handler/src/test/results/positive/llap/{iceberg_major_compaction_partition_evolution2.q.out
=> iceberg_minor_compaction_partition_evolution.q.out} (55%)
copy
iceberg/iceberg-handler/src/test/results/positive/llap/{iceberg_major_compaction_unpartitioned.q.out
=> iceberg_minor_compaction_unpartitioned.q.out} (54%)
