[ https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun Suresh updated YARN-6808: ------------------------------ Attachment: YARN-6808.001.patch Attaching initial patch to vet the idea. * Currently, only the allocation patch is implemented - the Auto-promote aspect needs some more bookkeeping and can probably be handled in a separate JIRA * It essentially checks if the incomning requests from an app exceeds its headroom.. and if so, are returned OPPORTUNISTIC containers. * I have added a test case in TestCapacityScheduler, but the change is pretty Scheduler Agnostic. > Allow Schedulers to return OPPORTUNISTIC containers when queues go over > configured capacity > ------------------------------------------------------------------------------------------- > > Key: YARN-6808 > URL: https://issues.apache.org/jira/browse/YARN-6808 > Project: Hadoop YARN > Issue Type: New Feature > Reporter: Arun Suresh > Assignee: Arun Suresh > Attachments: YARN-6808.001.patch > > > This is based on discussions with [~kasha] and [~kkaranasos]. > Currently, when a Queues goes over capacity, apps on starved queues must wait > either for containers to complete or for them to be pre-empted by the > scheduler to get resources. > This JIRA proposes to allow Schedulers to: > # Allocate all containers over the configured queue capacity/weight as > OPPORTUNISTIC. > # Auto-promote running OPPORTUNISTIC containers of apps as and when their > GUARANTEED containers complete. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org