Dear community, Nice to share Hudi community bi-weekly updates for 2021-03-28 ~ 2021-04-11 with updates on features, bug fixes and tests.
======================================= Community [Release] Apache Hudi 0.8.0 version has released, you would try it out and checkout the release notes here [1] [1] http://hudi.apache.org/releases.html#release-080-docs ======================================= Features [Flink Integration] Asynchronous Hive sync and commits cleaning for Flink writer [1] [Flink Integration] Emit deletes for flink MOR table streaming read [2] [Spark Integration] Implement Spark's FileIndex for Hudi to support queries via Hudi DataSource using non-globbed table path and partition pruning [3] [Flink Integration] Code Cleanup: Extract common method in HoodieCreateHandle & FlinkCreateHandle [4] [Flink Integration] add apache commons-codec dependency to flink-bundle explicitly [5] [Core] Clean/Compaction/Rollback command maybe never exit when operation fail [6] [Flink Integration] Assigns the buckets by record key for Flink writer [7] [Core] Fail to load user's class if user move hudi-spark-bundle.jar into spark classpath [8] [Flink Integration] Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink [9] [Core] HoodieFileGroup code optimize [10] [Hive Integration] Added HiveStylePartitionExtractor to support Hive style partitions [11] [Flink Integration] Add option for compaction parallelism [12] [Core] Support Huawei Cloud Object Storage [13] [1] https://issues.apache.org/jira/browse/HUDI-1729 [2] https://issues.apache.org/jira/browse/HUDI-1738 [3] https://issues.apache.org/jira/browse/HUDI-1591 [4] https://issues.apache.org/jira/browse/HUDI-1737 [5] https://issues.apache.org/jira/browse/HUDI-1696 [6] https://issues.apache.org/jira/browse/HUDI-1749 [7] https://issues.apache.org/jira/browse/HUDI-1757 [8] https://issues.apache.org/jira/browse/HUDI-1750 [9] https://issues.apache.org/jira/browse/HUDI-1778 [10] https://issues.apache.org/jira/browse/HUDI-1773 [11] https://issues.apache.org/jira/browse/HUDI-1762 [12] https://issues.apache.org/jira/browse/HUDI-1775 [13] https://issues.apache.org/jira/browse/HUDI-1783 ======================================= Bugs [Examples] Add hive-exec dependency for hudi-examples [1] [Java Client] Rename UpsertPartitioner in hudi-java-client [2] [Deltastreamer] DeltaStreamer print many unnecessary warn log [3] [Core] HoodieFileGroupId compareTo logical error(fileId self compare) [4] [Cli] Fix CompactionCommand and add unit test for CompactionCommand [5] [1] https://issues.apache.org/jira/browse/HUDI-1735 [2] https://issues.apache.org/jira/browse/HUDI-1713 [3] https://issues.apache.org/jira/browse/HUDI-1751 [4] https://issues.apache.org/jira/browse/HUDI-1772 [5] https://issues.apache.org/jira/browse/HUDI-699 Best, Leesf
