KeDeng has uploaded this change for review. ( http://gerrit.cloudera.org:8080/19670
Change subject: [GC] gc ancient, fully deleted rowsets without live row count ...................................................................... [GC] gc ancient, fully deleted rowsets without live row count We added a background op to GC ancient, fully deleted rowsets for KUDU-1625 base on live row count. This patch is very useful, but does not work for older versions that do not support live row count features. And during the upgrade process from a lower version to a higher version, live row count feature cannot be enabled for inventory data. To resolve this issue on a lower version of the kudu cluster, I submitted this patch. The main reason is to replace the use of live row count. However, due to the lack of a more accurate counting method, this patch may only release part of the storage space for ancient, fully deleted rows. Therefore, this feature can alleviate the storage space tension of older versions to a certain extent. If you need to enable this feature, enable the flag --enable_gc_deleted_rowsets_without_live_row_count and restart tservers. There's still room for improvement in this implementation in that, currently, we ignored the delete operation in DMS. I will resolve this issue in a follow-up patch. I ran this on a real cluster, the storage space of deleted rowsets that was not previously freed can be GCed as expected. And I also add unit test case to ensure it make sense. Change-Id: Iacdff107b8b07cbd56f47f296a93f4bcfbf56b41 --- M src/kudu/tablet/delta_tracker.cc M src/kudu/tablet/delta_tracker.h M src/kudu/tablet/diskrowset.cc M src/kudu/tablet/diskrowset.h M src/kudu/tablet/tablet.cc M src/kudu/tablet/tablet_history_gc-test.cc 6 files changed, 91 insertions(+), 8 deletions(-) git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/70/19670/1 -- To view, visit http://gerrit.cloudera.org:8080/19670 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Iacdff107b8b07cbd56f47f296a93f4bcfbf56b41 Gerrit-Change-Number: 19670 Gerrit-PatchSet: 1 Gerrit-Owner: KeDeng <kdeng...@gmail.com>