Dear community, Nice to share Hudi community weekly update for 2020-07-19 ~ 2020-07-26 with updates on features, bugs and tests.
======================================= Features [Bootstrap] Add common useful Spark related and Table path detection utilities [1] [Usability] Provide reasonable names for Spark DAG stages in HUDI [2] [Writer Core] Introducing support for rollbacks using marker files [3] [FileSystem] Add support for Tencent Cloud Object Storage(COS) [4] [Metrics] Add user define metrics reporter [5] [CI] Introduce rerun ci bot [6] [Writer Core] Introduce a write committed callback hook and given a default http callback implementation [7] [FileSystem] Add Databricks File System to StorageSchemes ======================================= Bugs [Writer Core] Fixing deletes for inserts in same batch in write path [8] [Writer Core] In inline compaction mode, previously failed compactions needs to be retried before new compactions [9] [Writer Core] Fix minor bug in deciding the insert buckets [10] ======================================= Tests [Test] Move TestHoodieIndex test cases to unit tests [11] [Test] Add temps show and unit test for TempViewCommand [12] [1] https://issues.apache.org/jira/browse/HUDI-1102 [2] https://issues.apache.org/jira/browse/HUDI-92 [3] https://issues.apache.org/jira/browse/HUDI-839 [4] https://issues.apache.org/jira/browse/HUDI-871 [5] https://issues.apache.org/jira/browse/HUDI-1113 [6] https://issues.apache.org/jira/browse/HUDI-985 [7] https://issues.apache.org/jira/browse/HUDI-1037 [8] https://issues.apache.org/jira/browse/HUDI-802 [9] https://issues.apache.org/jira/browse/HUDI-1029 [10] https://issues.apache.org/jira/browse/HUDI-1082 [11] https://issues.apache.org/jira/browse/HUDI-994 [12] https://issues.apache.org/jira/browse/HUDI-708 Best, Leesf
