[
https://issues.apache.org/jira/browse/YARN-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16140140#comment-16140140
]
Sunil G commented on YARN-7019:
-------------------------------
bq.It would be nice if the NM could be proactively told during container
execution when the cost of preemption changes so it can make better decisions
on its own when pressed for time.
Thanks [~jlowe]. Yes, it makes sense as NM could also preempt containers.
I think a general framework seems better option here as suggested.
> Ability for applications to notify YARN about container reuse
> -------------------------------------------------------------
>
> Key: YARN-7019
> URL: https://issues.apache.org/jira/browse/YARN-7019
> Project: Hadoop YARN
> Issue Type: New Feature
> Reporter: Jason Lowe
>
> During preemption calculations YARN can try to reduce the amount of work lost
> by considering how long a container has been running. However when an
> application framework like Tez reuses a container across multiple tasks it
> changes the work lost calculation since the container has essentially
> checkpointed between task assignments. It would be nice if applications
> could inform YARN when a container has been reused/checkpointed and therefore
> is a better candidate for preemption wrt. lost work than other, younger
> containers.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
