Dear community, Nice to share Hudi community bi-weekly updates for 2020-11-22 ~ 2020-12-06 with updates on features and bug fixes.
======================================= Discussion [Release] There is a discussion about the release time of the next version, which will be cut at the end of december. [Committers] Congrats to our newest committers Satish and Prashant. ======================================= Features [CLI] Add compaction action in archive command [3] [Writer Core] Add HoodieJavaEngineContext to hudi-java-client [4] [Bootstrap] Fix for preventing bootstrap datasource jobs from hanging via spark-submit [5] [Writer Core] Add Support for OpenJ9 JVM [6] [Writer Core] Added a check to validate records are not lost during merges [7] [Spark Integration] spark sql support overwrite use insert_overwrite_table [8] [Writer Core] Add standard schema postprocessor which would rewrite the schema using spark-avro conversion [9] ======================================= Bugs [Writer Core] Fix leaks in DiskBasedMap and LazyFileIterable [10] [Spark Integration] lose partition info when using spark parameter basePath [11] [Writer Core] Write Type changed to BULK_INSERT when set ENABLE_ROW_WRITER_OPT_KEY=true [12] [Index] Update HoodieKey when deduplicating records with global index [13] [Spark Integration] Fix FileAlreadyExistsException when set HOODIE_AUTO_COMMIT_PROP to true [14] [1] https://lists.apache.org/thread.html/r40bca8747be3c7be5aa1067a9a978c928d39c0acd5d0b685d367fea1%40%3Cdev.hudi.apache.org%3E [2] https://lists.apache.org/thread.html/r9a6599ab39484644ec5b2df67f39b2725998797a5c733cd43e5d74b0%40%3Cdev.hudi.apache.org%3E [3] https://issues.apache.org/jira/browse/HUDI-1397 [4] https://issues.apache.org/jira/browse/HUDI-1364 [5] https://issues.apache.org/jira/browse/HUDI-1396 [6] https://issues.apache.org/jira/browse/HUDI-1373 [7] https://issues.apache.org/jira/browse/HUDI-1357 [8] https://issues.apache.org/jira/browse/HUDI-1349 [9] https://issues.apache.org/jira/browse/HUDI-1343 [10] https://issues.apache.org/jira/browse/HUDI-1358 [11] https://issues.apache.org/jira/browse/HUDI-1396 [12] https://issues.apache.org/jira/browse/HUDI-1424 [13] https://issues.apache.org/jira/browse/HUDI-1196 [14] https://issues.apache.org/jira/browse/HUDI-1427 Best, Leesf
