[
https://issues.apache.org/jira/browse/YARN-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16160621#comment-16160621
]
Hugo Kiyodi Oshiro commented on YARN-5887:
------------------------------------------
Hi. Considering the approach for killing container based in job completion:
1. Where would be a good place to pass the information to NM.
ContainerLaunchContext ?
2. How job complete information should be calculated? numCompletedContainers /
numTotalContainers is OK?
> Policies for choosing which opportunistic containers to kill
> ------------------------------------------------------------
>
> Key: YARN-5887
> URL: https://issues.apache.org/jira/browse/YARN-5887
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Konstantinos Karanasos
>
> When a guaranteed container arrives at an NM but there are no resources to
> start its execution, opportunistic containers will be killed to make space
> for the guaranteed container.
> At the moment, we kill opportunistic containers in reverse order of arrival
> (first the most recently started ones). This is not always the right
> decision.
> For example, we might want to minimize the number of containers killed: to
> start a 6GB container, we could kill one 6GB opportunistic or three 2GB ones.
> Another example would be to refrain from killing containers of jobs that are
> very close to completion (we have to pass job completion information to the
> NM in that case).
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
