Re: Mesos sometimes not allocating the entire cluster

2016-01-20 Thread Erb, Stephan
Hi Tom, have you checked if any of the starvation issues explained in the Ebay blog post applies to you as well? http://www.ebaytechblog.com/2014/04/04/delivering-ebays-ci-solution-with-apache-mesos-part-i/? Best Regards, Stephan From: Tom Arnfeld

Mesos sometimes not allocating the entire cluster

2016-01-20 Thread Tom Arnfeld
Hey, I've noticed some interesting behaviour recently when we have lots of different frameworks connected to our Mesos cluster at once, all using a variety of different shares. Some of the frameworks don't get offered more resources (for long periods of time, hours even) leaving the cluster under

Re: Mesos sometimes not allocating the entire cluster

2016-01-20 Thread Klaus Ma
Hi Tom, Which framework are you using, e.g. Swarm, Marathon or something else? and which language package are you using? DRF will sort role/framework by allocation ratio, and offer all "available" resources by slave; but if the resources it too small (< 0.1CPU) or the resources was

Re: Mesos fetcher in dockerized slave

2016-01-20 Thread Shuai Lin
The testing of this case requires to build a docker image for mesos-slave, so it seems not practical to add a test case for it in the mesos tests. Anyway, here is the scripts I use for testing this issue: https://gist.github.com/lins05/14455e92f37e91fd46ff On Wed, Jan 20, 2016 at 10:30 AM, Shuai