Re: [VOTE] Release Apache Mesos 1.2.0 (rc2)

2017-03-02 Thread Adam Bordelon
TL;DR: No consensus yet. Let's extend the vote for a day or two, until we have 3 +1s or a legit -1. During that time we can test further, and investigate any issues that have shown up. Here's a summary of what's been reported on the 1.2.0-rc2 vote thread: - There was a perf core dump on ASF CI, w

Messos do not assign all available resources

2017-03-02 Thread Harold Molina-Bulla
Hi Everybody, We are trying to develop an Scheduler in Python to distribute processes in a Mesos cluster. I have close to 800 CPUs, but the system does not assign all the available resources to all our tasks. In order to test, we are defining: 1 CPU, 1Gbyte RAM per process in order all the proce

Re: Welcome Kevin Klues as a Mesos Committer and PMC member!

2017-03-02 Thread Yan Xu
Congrats Kevin! --- Jiang Yan Xu | @xujyan On Wed, Mar 1, 2017 at 2:05 PM, Benjamin Mahler wrote: > Hi all, > > Please welcome Kevin Klues as the newest committer and PMC member of the > Apache Mesos project. > > Kevin has been an active contributor in the project

Re: Messos do not assign all available resources

2017-03-02 Thread Benjamin Mahler
Hi there, more clarification is needed: > I have close to 800 CPUs, but the system does not assign all the available > resources to all our tasks. > What do you mean precisely here? Can you describe what you're seeing? Also, you have more than 800GB or RAM right? Ben On Thu, Mar 2, 2017 at 9:00

Re: Messos do not assign all available resources

2017-03-02 Thread Harold Molina-Bulla
Hi, Thanks for your reply. > Hi there, more clarification is needed: > > I have close to 800 CPUs, but the system does not assign all the > available resources to all our tasks. > > What do you mean precisely here? Can you describe what you're seeing? > Also, you have more than 800GB or

Re: Understanding Mesos Maintenance

2017-03-02 Thread Benjamin Mahler
Hey Zameer, great questions. Let us know if there's anything you think could be improved or documented better. Re 1: The 'Viewing maintenance status' section of the documentation should clarify this: http://mesos.apache.org/documentation/latest/maintenance/ Re 2: Both of these sound reasonable

Re: Messos do not assign all available resources

2017-03-02 Thread Benjamin Mahler
Can you upload the full logs somewhere and link to them here? How many frameworks are you running? Do they all run in the "*" role? Are the tasks short lived or long lived? Can you update your test to not use the --offer_timeout? The intention of that is to mitigate against frameworks that hold on

Re: Messos do not assign all available resources

2017-03-02 Thread Gabriel Hartmann
Possibly the suppress/revive problem. On Thu, Mar 2, 2017 at 4:30 PM Benjamin Mahler wrote: > Can you upload the full logs somewhere and link to them here? > > How many frameworks are you running? Do they all run in the "*" role? > Are the tasks short lived or long lived? > Can you update your t

Re: Messos do not assign all available resources

2017-03-02 Thread Benjamin Mahler
Also, what is the allocation that each framework has when you reach your steady state? Are there frameworks that don't have any more work to do but have a really low share of the cluster? On Thu, Mar 2, 2017 at 4:29 PM, Benjamin Mahler wrote: > Can you upload the full logs somewhere and link to

Re: Messos do not assign all available resources

2017-03-02 Thread Benjamin Mahler
What Gabriel is alluding to is a situation where you have: * Frameworks with lower shares that do not want additional resources, and * Frameworks with a higher shares that want additional resources. If there are a sufficient number of frameworks, it's possible for the decline filters of the low s

Re: Welcome Kevin Klues as a Mesos Committer and PMC member!

2017-03-02 Thread Jay Guo
Congrats Kevin! Well deserved! /J On Thu, Mar 2, 2017 at 6:05 AM, Benjamin Mahler wrote: > Hi all, > > Please welcome Kevin Klues as the newest committer and PMC member of the > Apache Mesos project. > > Kevin has been an active contributor in the project for over a year, and in > this time he m