YifanZhang created KUDU-3344:
--------------------------------
Summary: Master could do some garbage collection work in
CatalogManagerBgTasks thread
Key: KUDU-3344
URL: https://issues.apache.org/jira/browse/KUDU-3344
Project: Kudu
Issue Type: Improvement
Components: master
Reporter: YifanZhang
Kudu master now reserve all tables/tablets' metadata in memory and disks,
deleted tables and tablets were marked REMOVED/DELETED/REPLACED state but not
really deleted. This could lead to huge memory usage as described in KUDU-3097.
I think it's a good idea to cleanup them in the CatalogManagerBgTasks thread.
But because the data deletion tasks are done asynchronously by tablet servers,
it is uncertain when metadata can be safely deleted.
Besides, we could also cleanup dead tablet servers from master's in-memory map
in this thread, as I mentioned in KUDU-2915.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
