xiarixiaoyao opened a new pull request #2673: URL: https://github.com/apache/hudi/pull/2673
## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the pull request fix the bug that hudi cannot uncache rdds correctly now， hudi improve write performance by cache necessary rdds； however when the write operation is finnished， those cached rdds have not been uncached which waste lots of memory. https://github.com/apache/hudi/blob/master/hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/BaseSparkCommitActionExecutor.java#L115 https://github.com/apache/hudi/blob/master/hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/BaseSparkCommitActionExecutor.java#L214 In our environment： step1： insert 100GB data into hudi table by spark （ok） step2： insert another 100GB data into hudi table by spark again （oom ） ## Brief change log uncached rdds， when the write operation is finished ## Verify this pull request Existing UT ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc changes done or have another open PR - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
