Dynamic Resource Roles
Hey everyone, Just a quick question. Has the ever been any discussion around dynamic roles? What I mean by this – currently if I want to guarantee 1 core and 10 GB of ram to a specific type of framework (or "role") I need to do this at a slave level. This means if I only want to guarantee a small number of resources, I could do this on one slave. If that slave dies, that resource is no longer available. It would be interesting to see the master (DRF scheduler) capable of reserving a minimum about of resource for offering only to frameworks of a certain role, such that I can guarantee R amount of resources on N slaves across the cluster as a whole. Tom.
Re: Dynamic Resource Roles
Hi Tom, Reservations is definitely something we've discussed and will be addressed in the near future. Tim > On Sep 10, 2014, at 7:49 AM, Tom Arnfeld wrote: > > Hey everyone, > > Just a quick question. Has the ever been any discussion around dynamic > roles? > > What I mean by this – currently if I want to guarantee 1 core and 10 GB of > ram to a specific type of framework (or "role") I need to do this at a > slave level. This means if I only want to guarantee a small number of > resources, I could do this on one slave. If that slave dies, that resource > is no longer available. > > It would be interesting to see the master (DRF scheduler) capable of > reserving a minimum about of resource for offering only to frameworks of a > certain role, such that I can guarantee R amount of resources on N slaves > across the cluster as a whole. > > Tom.
Re: Dynamic Resource Roles
That's very cool, thanks. On Wed, Sep 10, 2014 at 4:59 PM, Timothy Chen wrote: > Hi Tom, > Reservations is definitely something we've discussed and will be addressed in > the near future. > Tim >> On Sep 10, 2014, at 7:49 AM, Tom Arnfeld wrote: >> >> Hey everyone, >> >> Just a quick question. Has the ever been any discussion around dynamic >> roles? >> >> What I mean by this – currently if I want to guarantee 1 core and 10 GB of >> ram to a specific type of framework (or "role") I need to do this at a >> slave level. This means if I only want to guarantee a small number of >> resources, I could do this on one slave. If that slave dies, that resource >> is no longer available. >> >> It would be interesting to see the master (DRF scheduler) capable of >> reserving a minimum about of resource for offering only to frameworks of a >> certain role, such that I can guarantee R amount of resources on N slaves >> across the cluster as a whole. >> >> Tom.
Re: Dynamic Resource Roles
BenH has been calling these "master reservations" (globally control
reservations across all slaves through the master) and "offer reservations"
(I don't care which nodes it's on, as long as I get X cpu and Y RAM, or Z
sets of {X,Y}), and they're definitely on the roadmap.
On Wed, Sep 10, 2014 at 9:05 AM, Tom Arnfeld wrote:
> That's very cool, thanks.
>
> On Wed, Sep 10, 2014 at 4:59 PM, Timothy Chen wrote:
>
> > Hi Tom,
> > Reservations is definitely something we've discussed and will be
> addressed in the near future.
> > Tim
> >> On Sep 10, 2014, at 7:49 AM, Tom Arnfeld wrote:
> >>
> >> Hey everyone,
> >>
> >> Just a quick question. Has the ever been any discussion around dynamic
> >> roles?
> >>
> >> What I mean by this – currently if I want to guarantee 1 core and 10 GB
> of
> >> ram to a specific type of framework (or "role") I need to do this at a
> >> slave level. This means if I only want to guarantee a small number of
> >> resources, I could do this on one slave. If that slave dies, that
> resource
> >> is no longer available.
> >>
> >> It would be interesting to see the master (DRF scheduler) capable of
> >> reserving a minimum about of resource for offering only to frameworks
> of a
> >> certain role, such that I can guarantee R amount of resources on N
> slaves
> >> across the cluster as a whole.
> >>
> >> Tom.
>
Re: Dynamic Resource Roles
Awesome! That's great to hear. Let me know if there's anything I can help
with.
I can't seem to find a JIRA issue (came across this
https://issues.apache.org/jira/browse/MESOS-505 but seems very old) for it.
So I've made https://issues.apache.org/jira/browse/MESOS-1791.
On 10 September 2014 18:03, Adam Bordelon wrote:
> BenH has been calling these "master reservations" (globally control
> reservations across all slaves through the master) and "offer reservations"
> (I don't care which nodes it's on, as long as I get X cpu and Y RAM, or Z
> sets of {X,Y}), and they're definitely on the roadmap.
>
> On Wed, Sep 10, 2014 at 9:05 AM, Tom Arnfeld wrote:
>
> > That's very cool, thanks.
> >
> > On Wed, Sep 10, 2014 at 4:59 PM, Timothy Chen wrote:
> >
> > > Hi Tom,
> > > Reservations is definitely something we've discussed and will be
> > addressed in the near future.
> > > Tim
> > >> On Sep 10, 2014, at 7:49 AM, Tom Arnfeld wrote:
> > >>
> > >> Hey everyone,
> > >>
> > >> Just a quick question. Has the ever been any discussion around dynamic
> > >> roles?
> > >>
> > >> What I mean by this – currently if I want to guarantee 1 core and 10
> GB
> > of
> > >> ram to a specific type of framework (or "role") I need to do this at a
> > >> slave level. This means if I only want to guarantee a small number of
> > >> resources, I could do this on one slave. If that slave dies, that
> > resource
> > >> is no longer available.
> > >>
> > >> It would be interesting to see the master (DRF scheduler) capable of
> > >> reserving a minimum about of resource for offering only to frameworks
> > of a
> > >> certain role, such that I can guarantee R amount of resources on N
> > slaves
> > >> across the cluster as a whole.
> > >>
> > >> Tom.
> >
>
