[
https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264189#comment-17264189
]
zhuqi commented on YARN-10532:
------------------------------
[~gandras]
In original auto created leaf queue, there are policy
GuaranteedOrZeroCapacityOverTimePolicy can:
* Store the timestamp of every empty queues
* Asynchronously check in QueueManagementDynamicEditPolicy
{code:java}
@Override
public void editSchedule() {
long startTs = clock.getTime();
initQueues();
manageAutoCreatedLeafQueues();
if (LOG.isDebugEnabled()) {
LOG.debug("Total time used=" + (clock.getTime() - startTs) + " ms.");
}
}
{code}
Something just like preemption policy.
Can commit changes to expired inactive auto queues, and make other changes.
* This can reuse for deletion when expiration, it's realized by this patch.
But in new auto created queue, there are no policy, this leads me to ask the
question in YARN-10564
If we need to realize this similar policy, or just add some thread to do this.
> Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is
> not being used
> --------------------------------------------------------------------------------------------
>
> Key: YARN-10532
> URL: https://issues.apache.org/jira/browse/YARN-10532
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Wangda Tan
> Assignee: zhuqi
> Priority: Major
> Attachments: YARN-10532.001.patch
>
>
> It's better if we can delete auto-created queues when they are not in use for
> a period of time (like 5 mins). It will be helpful when we have a large
> number of auto-created queues (e.g. from 500 users), but only a small subset
> of queues are actively used.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
