[ANNOUNCE] Hudi Community Update(2022-09-26 ~ 2022-10-23)
Dear community, Nice to share Hudi community bi-weekly updates for 2022-09-26 ~ 2022-10-23 with updates on bug fixes. === Features [Core] Implement CDC Read in Spark [1] [Core] Add Kerberos kinit command support [2] [Core] Add support for unraveling proto schemas in ProtoClassBasedSchemaProvider [3] [Core] Add incremental source from GCS to Hudi [4] [Flink] Implement change log feed for Flink [5] [Core] Support log compaction action for MOR tables [6] [Core] Extend InProcessLockProvider to support multiple table ingestion[7] [Core] Implement Create/Drop/Show/Refresh Secondary Index [8] [Core] Early Conflict Detection For Multi-writer [9] [Flink] Support all the hive sync options for flink sql [10] [1] https://issues.apache.org/jira/browse/HUDI-3478 [2] https://issues.apache.org/jira/browse/HUDI-4718 [3] https://issues.apache.org/jira/browse/HUDI-4904 [4] https://issues.apache.org/jira/browse/HUDI-4850 [5] https://issues.apache.org/jira/browse/HUDI-4916 [6] https://issues.apache.org/jira/browse/HUDI-3900 [7] https://issues.apache.org/jira/browse/HUDI-4963 [8] https://issues.apache.org/jira/browse/HUDI-4293 [9] https://issues.apache.org/jira/browse/HUDI-1575 [10] https://issues.apache.org/jira/browse/HUDI-5046 === Bugs [Core] Fixing repeated trigger of data file creations w/ clustering [1] [Core] Fix HoodieSnapshotExporter for writing to a different S3 bucket or FS [2] [Core] Fix schema to include partition columns in bootstrap operation [3] [Core] Fix the issue of Mor log skipping complete blocks when reading data [4] [Core] Relaxing MERGE INTO constraints to permit limited casting operations w/in matched-on conditions [5] [Core] READ_OPTIMIZED read mode will temporary loss of data when compaction [6] [Core] Fixing invalid min/max record key stats in Parquet metadata [7] [Core] Fixing reading from metadata table when there are no inflight commits [8] [1] https://issues.apache.org/jira/browse/HUDI-4760 [2] https://issues.apache.org/jira/browse/HUDI-4913 [3] https://issues.apache.org/jira/browse/HUDI-4453 [4] https://issues.apache.org/jira/browse/HUDI-2780 [5] https://issues.apache.org/jira/browse/HUDI-4861 [6] https://issues.apache.org/jira/browse/HUDI-4308 [7] https://issues.apache.org/jira/browse/HUDI-4992 [8] https://issues.apache.org/jira/browse/HUDI-4952 Best, Leesf
Re: [ANNOUNCE] Apache Hudi 0.12.1 released
Congrats! Thanks, Zhuoluo leesf 于2022年10月20日周四 09:03写道： > Great job! > > Alexey Kudinkin 于2022年10月20日周四 03:45写道： > > > Thanks Zhaojing for masterfully navigating this release! > > > > On Wed, Oct 19, 2022 at 7:46 AM Vinoth Chandar > wrote: > > > > > Great job everyone! > > > > > > On Wed, Oct 19, 2022 at 07:11 zhaojing yu wrote: > > > > > > > The Apache Hudi team is pleased to announce the release of Apache > Hudi > > > > 0.12.1. > > > > > > > > Apache Hudi (pronounced Hoodie) stands for Hadoop Upserts Deletes > > > > and Incrementals. Apache Hudi manages storage of large analytical > > > > datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem > compatible > > > > storage) and provides the ability to query them. > > > > > > > > This release comes 2 months after 0.12.0. It includes more than > > > > 150 resolved issues, comprising of a few new features as well as > > > > general improvements and bug fixes. You can read the release > > > > highlights at https://hudi.apache.org/releases/release-0.12.1. > > > > > > > > For details on how to use Hudi, please look at the quick start page > > > located > > > > at https://hudi.apache.org/docs/quick-start-guide.html > > > > > > > > If you'd like to download the source release, you can find it here: > > > > https://github.com/apache/hudi/releases/tag/release-0.12.1 > > > > > > > > Release notes including the resolved issues can be found here: > > > > > > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12352182 > > > > > > > > We welcome your help and feedback. For more information on how to > > report > > > > problems, and to get involved, visit the project website at > > > > https://hudi.apache.org > > > > > > > > Thanks to everyone involved! > > > > > > > > Release Manager > > > > > > > > > >
