Dear community, Nice to share Hudi community updates for 2023-05-29 ~ 2023-06-11 with updates on feature and bug fixes.
======================================= Feature [Core] a more effective HoodieMergeHandler for COW table with parquet [1] [Core] Support Hudi on Spark 3.4.0 [2] [1] https://issues.apache.org/jira/browse/HUDI-4790 [2] https://issues.apache.org/jira/browse/HUDI-6198 Bugs [Spark] Clustering enhancements [1] [Core] Fix Memory Leak in RealtimeCompactedRecordReader [2] [Flink] Make HoodieFlinkCompactor's parallelism of compact_task more reasonable [3] [Core] Fix the data table archiving and MDT cleaning config conf [4] [Core] Fix bug when hive queries Array type [5] [Core] Sync TIMESTAMP_MILLIS to hive [6] [Core] Enhancements to the MDT for improving performance of larger indexes [7] [Core] Hive sync use state transient time to avoid losing partitions [8] [Core] Integrate logcompaction table service to metadata table and provides various bugfixes to metadata table [10] [1] https://issues.apache.org/jira/browse/HUDI-6277 [2] https://issues.apache.org/jira/browse/HUDI-6287 [3] https://issues.apache.org/jira/browse/HUDI-6293 [4] https://issues.apache.org/jira/browse/HUDI-6256 [5] https://issues.apache.org/jira/browse/HUDI-6309 [6] https://issues.apache.org/jira/browse/HUDI-6307 [7] https://issues.apache.org/jira/browse/HUDI-5238 [8] https://issues.apache.org/jira/browse/HUDI-6182 [9] https://issues.apache.org/jira/browse/HUDI-3775 [10] https://issues.apache.org/jira/browse/HUDI-6334 Best, Leesf