Mailing lists for specific frameworks

Hey all, many of the frameworks in development such as the mesos-kafka and mesos-elasticsearch look very promising! In order to keep the Mesos users group clean, I was wondering if there are mailing lists, google groups etc set for some of these. I think it could be beneficial from a standpoint o

git / chronos-marathon integration

Is there a way to specify which version of a script marathon/chronos should use ? : I would like being able to have multiple version of a job, and being able to set a specific version productive, so that at this moment, mesos is getting and using that version (for marathon and chronos)... Do s

Re: git / chronos-marathon integration

And I guess git clone with -b for a branch name or specifying a commit manually won't work for you? On Wednesday, June 24, 2015, Sebastien Brennion < sebastien.brenn...@leanbi.ch> wrote: > Is there a way to specify which version of a script marathon/chronos > should use ? : > > > > I would like

RE: git / chronos-marathon integration

In fact that would be the result of it… But I would like to find a way doing something like : - indicate mesos “version 1.3 is productive” - mesos checking which version it has, eventually performing a git clone or similar - if needed restarting marathon jobs - running further chronos jobs with th

Re: git / chronos-marathon integration

docker have tag for images. I think you could use it to do version control on container. On Wed, Jun 24, 2015 at 9:00 PM, Sebastien Brennion < sebastien.brenn...@leanbi.ch> wrote: > In fact that would be the result of it… > > But I would like to find a way doing something like : > > - indicate m

Documentation

I setup my first Mesos single node cluster following the instructions at http://mesos.apache.org/documentation/latest/. I'm pretty to new to this and was wondering what other materials I could refer to try and work with Mesos - on use-cases, etc. The docs there didn't quite have a direction for a n

Re: Documentation

How about this link? http://open.mesosphere.com/tutorials/ On Wed, Jun 24, 2015 at 9:08 PM, mufy wrote: > I setup my first Mesos single node cluster following the instructions at > http://mesos.apache.org/documentation/latest/. I'm pretty to new to this > and was wondering what other materials I

Setting minimum offer size

The following problem is mentioned in the Mesos technical paper at http://mesos.berkeley.edu/mesos_tech_report.pdf " when a cluster is filled by tasks with small resource requirements, a framework f with large resource requirements may starve, because whenever a small task finishes, f cannot a

Re: Setting minimum offer size

I'm not aware of any minimum offer size option in mesos. What I've seen success with is holding onto small offers and waiting until I accumulate enough to launch the large task. This way, the need for large offers doesn't affect the cluster, but the framework that needs it gets it. On Wed, Jun 24,

Re: Setting minimum offer size

On 24/06/2015 15:35, David Greenberg wrote: I'm not aware of any minimum offer size option in mesos. What I've seen success with is holding onto small offers and waiting until I accumulate enough to launch the large task. This way, the need for large offers doesn't affect the cluster, but the f

Re: Setting minimum offer size

We have struggled with this problem many times, and our solution was to reduce the size of jobs. Reducing job size has many advantages: - Big jobs have less chance of getting starved out - Frameworks have less incentive to hold onto offers - The DRF algorithm assumes that all frameworks want offe

Re: Setting minimum offer size

On 24/06/2015 16:31, Alex Gaudio wrote: Does anyone have other ideas? HTCondor deals with this by having a "defrag" demon, which periodically stops hosts accepting small jobs, so that it can coalesce small slots into larger ones. http://research.cs.wisc.edu/htcondor/manual/latest/3_5Policy_Co

Re: Setting minimum offer size

- Original Message - > From: "Brian Candler" > To: user@mesos.apache.org > Sent: Wednesday, June 24, 2015 10:50:43 AM > Subject: Re: Setting minimum offer size > > On 24/06/2015 16:31, Alex Gaudio wrote: > > Does anyone have other ideas? > HTCondor deals with this by having a "defrag" d

oom kills lead up to cpu lockup

This issue has been harassing our cluster. Any thoughts would be appreciated. I've attached the syslog showing the issue. I've cut out several sections of oom kills of node processes, however I've left in the last two. Previous oom kill messages are similar. These oom kills occur before the sys

Re: oom kills lead up to cpu lockup

Could it be: http://blog.nitrous.io/2014/03/10/stability-and-a-linux-oom-killer-bug.html

Re: Setting minimum offer size

In a previous (more HPC like) system I worked on, the scheduler did "advance reservation" of resources, claiming bits and pieces it got and holding on until all were available. Say the last bit is expected to come in about 1 hour from now (and this needs job runtime estimation/knowledge), any short

Re: Minor Documentation Correction

See https://reviews.apache.org/r/35848/ thanks for spotting it! *Marco Massenzio* *Distributed Systems Engineer* On Tue, Jun 23, 2015 at 11:09 PM, mufy wrote: > It seemed to work with *-j 4*. Thanks. > > > --- > Mufeed Usman > My LinkedIn |

Mesos slave calling fopen() on junk file names.

I'm using mesos 0.22.0. It can use 100% cpu for long amounts of time. Doing an ltrace on the process, I see weird 'fopen' calls like this: fopen("\b\t\n\v\f\r\016\017\020\021\022\023\024\025\026\027\030\031\032\033\034\035\036\037 !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\\]^_`

Re: [Breaking Change 0.24 & Upgrade path] ZooKeeper MasterInfo change.

Folks, as heads-up, we are planning to convert the format of the MasterInfo information stored in ZooKeeper from the Protocol Buffer binary format to JSON - this is in conjunction with the HTTP API development, to allow frameworks *not* to depend on libmesos and other binary dependencies to intera

Re: Mailing lists for specific frameworks

exactly. To use Mesos better, we have to spend more on the integration mesos with stateful/stateless service such as SQL/No-SQL DB, MQ, ES and so. Or communicate with the related communities such MySQL community, MongoDB community for the special integration. 2015-06-24 19:09 GMT+08:00 John Omerni

Re: git / chronos-marathon integration

And our team is do version control by the docker tag as you said. But you'd better to keep an eye on the disk resource taken by the increasing docker images. 2015-06-24 21:04 GMT+08:00 haosdent : > docker have tag for images. I think you could use it to do version control > on container. > > On W