Dear community, Nice to share Hudi community bi-weekly updates for 2022-08-15 ~ 2022-08-28 with updates on bug fixes.
======================================= Features [DeltaStreamer] Adding PulsarSource to DeltaStreamer to support ingesting from Apache Pulsar [1] [CLI] Add timeline commands in hudi-cli [2] [1] https://issues.apache.org/jira/browse/HUDI-4616 [2] https://issues.apache.org/jira/browse/HUDI-3579 ======================================= Bugs [Core] Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table [1] [Core] Fixed timeline based marker thread safety issue [2] [Core] Read error from MOR table after compaction with timestamp partitioning [3] [Spark] MergeInto syntax WHEN MATCHED is optional but must be set [4] [Core] infer cleaner policy when write concurrency mode is OCC [5] [Core] Fix savepoints will be cleaned in keeping latest versions policy [6] [Core] Fixing DebeziumSource to properly commit offsets [7] [1] https://issues.apache.org/jira/browse/HUDI-3189 [2] https://issues.apache.org/jira/browse/HUDI-4574 [3] https://issues.apache.org/jira/browse/HUDI-4601 [3] https://issues.apache.org/jira/browse/HUDI-4477 [4] https://issues.apache.org/jira/browse/HUDI-4643 [5] https://issues.apache.org/jira/browse/HUDI-4676 [6] https://issues.apache.org/jira/browse/HUDI-4515 [6] https://issues.apache.org/jira/browse/HUDI-4616 Best, Leesf