[jira] [Commented] (MESOS-3892) Add a helper function to the Agent to retrieve the list of executors that are using optimistically offered, revocable resources.
[
https://issues.apache.org/jira/browse/MESOS-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059415#comment-15059415
]
Klaus Ma commented on MESOS-3892:
-
RR: https://reviews.apache.org/r/41345/
> Add a helper function to the Agent to retrieve the list of executors that are
> using optimistically offered, revocable resources.
>
>
> Key: MESOS-3892
> URL: https://issues.apache.org/jira/browse/MESOS-3892
> Project: Mesos
> Issue Type: Bug
>Reporter: Artem Harutyunyan
>Assignee: Klaus Ma
> Labels: mesosphere
>
> {noformat}
> class Slave {
> ...
> // How the master currently keeps track of executors.
> hashmap> executors;
> ...
> // Returns the list of executors that are using optimistically-
> // offered, revocable resources.
> list getEvictableExecutors() { ... }
> ...
> }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (MESOS-3892) Add a helper function to the Agent to retrieve the list of executors that are using optimistically offered, revocable resources.
[
https://issues.apache.org/jira/browse/MESOS-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052514#comment-15052514
]
Guangya Liu commented on MESOS-3892:
Is it possible that we do not generate the executor list in master but let
slave handle this in MVP? The slave already knows all of the executors/tasks
who is using allocation slack resources, so when launch a new task which
request resource preemption, the slave can just check and kill some
executors/tasks to recover those resources, make sense? [~jvanremoortere]
[~kaysoky] [~hartem] [~klaus1982]
> Add a helper function to the Agent to retrieve the list of executors that are
> using optimistically offered, revocable resources.
>
>
> Key: MESOS-3892
> URL: https://issues.apache.org/jira/browse/MESOS-3892
> Project: Mesos
> Issue Type: Bug
>Reporter: Artem Harutyunyan
>Assignee: Klaus Ma
> Labels: mesosphere
>
> {noformat}
> class Slave {
> ...
> // How the master currently keeps track of executors.
> hashmap> executors;
> ...
> // Returns the list of executors that are using optimistically-
> // offered, revocable resources.
> list getEvictableExecutors() { ... }
> ...
> }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (MESOS-3892) Add a helper function to the Agent to retrieve the list of executors that are using optimistically offered, revocable resources.
[
https://issues.apache.org/jira/browse/MESOS-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052993#comment-15052993
]
Klaus Ma commented on MESOS-3892:
-
I have update the code diff of MESOS-1718 at
https://reviews.apache.org/r/40759/; would you also help to review them? I'll
start to work on this one when MESOS-1718 under review :).
> Add a helper function to the Agent to retrieve the list of executors that are
> using optimistically offered, revocable resources.
>
>
> Key: MESOS-3892
> URL: https://issues.apache.org/jira/browse/MESOS-3892
> Project: Mesos
> Issue Type: Bug
>Reporter: Artem Harutyunyan
>Assignee: Klaus Ma
> Labels: mesosphere
>
> {noformat}
> class Slave {
> ...
> // How the master currently keeps track of executors.
> hashmap> executors;
> ...
> // Returns the list of executors that are using optimistically-
> // offered, revocable resources.
> list getEvictableExecutors() { ... }
> ...
> }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (MESOS-3892) Add a helper function to the Agent to retrieve the list of executors that are using optimistically offered, revocable resources.
[
https://issues.apache.org/jira/browse/MESOS-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053148#comment-15053148
]
Joseph Wu commented on MESOS-3892:
--
Yes that's reasonable (and what we discussed in the [work group
meeting|https://docs.google.com/document/d/1CKMelV6xD_HOsqwbqH3PM24P7ypS_G4oz_MDNxE85D8/edit#bookmark=id.xlfbqnql7ngq]).
Can you update the relevant JIRA's accordingly (rename, update descriptions,
etc)?
> Add a helper function to the Agent to retrieve the list of executors that are
> using optimistically offered, revocable resources.
>
>
> Key: MESOS-3892
> URL: https://issues.apache.org/jira/browse/MESOS-3892
> Project: Mesos
> Issue Type: Bug
>Reporter: Artem Harutyunyan
>Assignee: Klaus Ma
> Labels: mesosphere
>
> {noformat}
> class Slave {
> ...
> // How the master currently keeps track of executors.
> hashmap> executors;
> ...
> // Returns the list of executors that are using optimistically-
> // offered, revocable resources.
> list getEvictableExecutors() { ... }
> ...
> }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (MESOS-3892) Add a helper function to the Agent to retrieve the list of executors that are using optimistically offered, revocable resources.
[
https://issues.apache.org/jira/browse/MESOS-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037416#comment-15037416
]
Guangya Liu commented on MESOS-3892:
I know that we already have lot of discussions to talk whether the master can
kill task or not. For some frameworks, it may not implement the
{{termiateTask()}} so that once the executor was killed, the task will become
TASK_FAILED and all resources will be recovered but task continues running,
this will cause the host over committed, kubernetes on mesos is such a case, I
filed a ticket here to trace the k8s on mesos issue:
https://github.com/kubernetes/kubernetes/issues/18066
Killing task directly by master may not able to make sure QoS but it can make
sure the resources usage is correct in case some executors do not implement
{{terminateTask()}} API. Is it possible to add a new field in Framework to
control kill task or executor when the tasks on this framework is being
preempted.
> Add a helper function to the Agent to retrieve the list of executors that are
> using optimistically offered, revocable resources.
>
>
> Key: MESOS-3892
> URL: https://issues.apache.org/jira/browse/MESOS-3892
> Project: Mesos
> Issue Type: Bug
>Reporter: Artem Harutyunyan
>Assignee: Klaus Ma
> Labels: mesosphere
>
> {noformat}
> class Slave {
> ...
> // How the master currently keeps track of executors.
> hashmap> executors;
> ...
> // Returns the list of executors that are using optimistically-
> // offered, revocable resources.
> list getEvictableExecutors() { ... }
> ...
> }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (MESOS-3892) Add a helper function to the Agent to retrieve the list of executors that are using optimistically offered, revocable resources.
[
https://issues.apache.org/jira/browse/MESOS-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021012#comment-15021012
]
Klaus Ma commented on MESOS-3892:
-
For command line tasks, there's no executor_info in master. In MESOS-1718,
we're going to build {{ExecutorInfo}} instead of slave/agent; so master will
aware of Executor of command line.
> Add a helper function to the Agent to retrieve the list of executors that are
> using optimistically offered, revocable resources.
>
>
> Key: MESOS-3892
> URL: https://issues.apache.org/jira/browse/MESOS-3892
> Project: Mesos
> Issue Type: Bug
>Reporter: Artem Harutyunyan
>Assignee: Klaus Ma
> Labels: mesosphere
>
> {noformat}
> class Slave {
> ...
> // How the master currently keeps track of executors.
> hashmap> executors;
> ...
> // Returns the list of executors that are using optimistically-
> // offered, revocable resources.
> list getEvictableExecutors() { ... }
> ...
> }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
