Dear community, Nice to share Hudi community bi-weekly updates for 2022-09-26 ~ 2022-10-23 with updates on bug fixes.
======================================= Features [Core] Implement CDC Read in Spark [1] [Core] Add Kerberos kinit command support [2] [Core] Add support for unraveling proto schemas in ProtoClassBasedSchemaProvider [3] [Core] Add incremental source from GCS to Hudi [4] [Flink] Implement change log feed for Flink [5] [Core] Support log compaction action for MOR tables [6] [Core] Extend InProcessLockProvider to support multiple table ingestion[7] [Core] Implement Create/Drop/Show/Refresh Secondary Index [8] [Core] Early Conflict Detection For Multi-writer [9] [Flink] Support all the hive sync options for flink sql [10] [1] https://issues.apache.org/jira/browse/HUDI-3478 [2] https://issues.apache.org/jira/browse/HUDI-4718 [3] https://issues.apache.org/jira/browse/HUDI-4904 [4] https://issues.apache.org/jira/browse/HUDI-4850 [5] https://issues.apache.org/jira/browse/HUDI-4916 [6] https://issues.apache.org/jira/browse/HUDI-3900 [7] https://issues.apache.org/jira/browse/HUDI-4963 [8] https://issues.apache.org/jira/browse/HUDI-4293 [9] https://issues.apache.org/jira/browse/HUDI-1575 [10] https://issues.apache.org/jira/browse/HUDI-5046 ======================================= Bugs [Core] Fixing repeated trigger of data file creations w/ clustering [1] [Core] Fix HoodieSnapshotExporter for writing to a different S3 bucket or FS [2] [Core] Fix schema to include partition columns in bootstrap operation [3] [Core] Fix the issue of Mor log skipping complete blocks when reading data [4] [Core] Relaxing MERGE INTO constraints to permit limited casting operations w/in matched-on conditions [5] [Core] READ_OPTIMIZED read mode will temporary loss of data when compaction [6] [Core] Fixing invalid min/max record key stats in Parquet metadata [7] [Core] Fixing reading from metadata table when there are no inflight commits [8] [1] https://issues.apache.org/jira/browse/HUDI-4760 [2] https://issues.apache.org/jira/browse/HUDI-4913 [3] https://issues.apache.org/jira/browse/HUDI-4453 [4] https://issues.apache.org/jira/browse/HUDI-2780 [5] https://issues.apache.org/jira/browse/HUDI-4861 [6] https://issues.apache.org/jira/browse/HUDI-4308 [7] https://issues.apache.org/jira/browse/HUDI-4992 [8] https://issues.apache.org/jira/browse/HUDI-4952 Best, Leesf
