[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264160#comment-17264160 ]
Andras Gyori commented on YARN-10532: ------------------------------------- Thanks [~zhuqi] for the heads-up. I think this should be approached in a way, that allows: * Periodically check all the queues in the hierarchy (this should be done in a different thread asynchronously, do not know if we can reuse an existing one, or we need to introduce a garbage collector thread) * Store the timestamp of every empty queues * If a queue remains empty after X seconds, we delete it (probably a configurable value) * We should keep in mind the queue hierarchy as well, because there could be empty dynamic parent queues this way, which also need to be purged. > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is > not being used > -------------------------------------------------------------------------------------------- > > Key: YARN-10532 > URL: https://issues.apache.org/jira/browse/YARN-10532 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Wangda Tan > Assignee: zhuqi > Priority: Major > Attachments: YARN-10532.001.patch > > > It's better if we can delete auto-created queues when they are not in use for > a period of time (like 5 mins). It will be helpful when we have a large > number of auto-created queues (e.g. from 500 users), but only a small subset > of queues are actively used. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org