Dear community, Nice to share Hudi community bi-weekly updates for 2022-10-24 ~ 2022-11-06 with updates on bug fixes.
======================================= Features [Flink] Supports dropPartition for Flink catalog [1] [Core] glue support drop partitions [2] [Core] Support schema evolution for Hive/presto [3] [Flink] source operator(monitor and reader) support user uid [4] [Flink] Add Call show_commit_extra_metadata for spark sql [5] [Core] Use Lock-Free Message Queue Disruptor Improving Hoodie Writing Efficiency [6] [1] https://issues.apache.org/jira/browse/HUDI-5049 [2] https://issues.apache.org/jira/browse/HUDI-4809 [3] https://issues.apache.org/jira/browse/HUDI-5000 [4] https://issues.apache.org/jira/browse/HUDI-5102 [5] https://issues.apache.org/jira/browse/HUDI-5105 [6] https://issues.apache.org/jira/browse/HUDI-3963 ======================================= Bugs [Core] Using hudi to build a large number of tables in spark on hive causes OOM [1] [Core] Fix clustering schedule problem in flink when enable schedule clustering and disable async clustering [2] [Flink] Fix flink catalog read spark table error : primary key col can not be nullable[3] [Core] fix merge into with no preCombineField having dup row by only insert [4] [Core] Fix msck repair external hudi table [5] [Core] presto/hive respect payload during merge parquet file and logfile when reading mor table [6] [1] https://issues.apache.org/jira/browse/HUDI-4281 [2] https://issues.apache.org/jira/browse/HUDI-5042 [3] https://issues.apache.org/jira/browse/HUDI-5058 [4] https://issues.apache.org/jira/browse/HUDI-4946 [5] https://issues.apache.org/jira/browse/HUDI-5057 [6] https://issues.apache.org/jira/browse/HUDI-4898 Best, Leesf