Task requires multiple containers

2015-06-17 Thread Christoph Heer
Hi, at the moment I'm implementing a framework for Mesos. My scheduler starts one task which spawns a container with an executor which is able to handle and run the task. This pattern allows that the code/executable of the executor mustn't present on the slave node. In my use-case the tasks req

Re: Task requires multiple containers

2015-06-18 Thread Alex Rukletsov
Christoph, I'm not sure I got your use case correctly, feel free to elaborate or refine your question. From what I've understood, you may want to write your own executor, that is able to handle multiple tasks (which can be docker containers). You may want to get inspiration from docker executor

Re: Task requires multiple containers

2015-06-20 Thread Christoph Heer
Thanks for your answer Alex. Thank you for the link to new docker executor it's very interesting and I see some great benefits for my usage of Mesos. But I think my previous explanation wasn't good enough. My scheduler starts a task which will be handle by a custom executor. The executor could

Re: Task requires multiple containers

2015-06-20 Thread Tim Chen
Hi Chris, Since you implemented a custom executor, it's really up to you how you want to launch and make sure the task uses the right resources. Essentially you'll need to launch your multiple executors with the right resources flags (-c, -m). We don't expose any API to get the current Task's cg

Re: Task requires multiple containers

2015-06-21 Thread Christoph Heer
Hi, > Essentially you'll need to launch your multiple executors with the right > resources flags (-c, -m). I'm sorry I couldn't found information about resources flags. Could you provide a link with additional information about these flags? > We don't expose any API to get the current Task's c

Re: Task requires multiple containers

2015-06-22 Thread Alex Rukletsov
Christoph, as Tim mentioned before, your custom executor is responsible to handling tasks correctly. Mesos does resource bookkeeping per executor; if the executor reaches a limit (e.g. because of an OOM event), the whole executor will be killed by Mesos (actually, by a containerizer and only if yo

Re: Task requires multiple containers

2015-06-22 Thread Tim St Clair
015 7:25:00 PM > Subject: Re: Task requires multiple containers > Hi Chris, > Since you implemented a custom executor, it's really up to you how you want > to launch and make sure the task uses the right resources. > Essentially you'll need to launch your multiple executors wi

Re: Task requires multiple containers

2015-06-22 Thread Christoph Heer
Hi, > What's the current status regarding the POD-esk JIRA to treat as a single > unit vs. custom? > > It "sounds like" this is what he wants. Yes I would like to have pods. ;) I tried to start a Docker container with the cgroup of the active Mesos task as 'cgroup-parent' but it doesn't wo