Re: Welcome Neil Conway as Mesos Committer and PMC member!

Congrats Neil!! On Sat, 21 Jan 2017 at 12:34 Vinod Kone wrote: > Hi folks, > > Please welcome Neil Conway as the newest committer and PMC member of the > Apache Mesos project. > > Neil has been an active contributor to Mesos for more than a year now. As > part of his work, he has contributed som

Re: Welcome Guangya Liu as Mesos Committer and PMC member!

Welcome to the PMC! >>>>> > >>>>> >> On Fri, Dec 16, 2016 at 7:03 PM, Sam wrote: >>>>> >> congratulations Guangya >>>>> >> >>>>> >> Sent from my iPhone >>>>> >> >>>>> >

Re: resource offers

; you know. I was first of all only interested if I'm supposed to get all >> offers at once or not. >> >> On 26.09.2016 11:08, Guangya Liu wrote: >> >>> Can you please turn on the `GLOG_v=2` in mesos master and append more >>> logs here? >>>

Re: resource offers

Can you please turn on the `GLOG_v=2` in mesos master and append more logs here? On Mon, Sep 26, 2016 at 4:36 PM, Hendrik Haddorp wrote: > Thanks for the tip. No, I did not set any filters. > > On 26.09.2016 09:53, Guangya Liu wrote: > >> This depends, it may be caused by tha

Re: resource offers

This depends, it may be caused by that one of the offer is declined and then got a filter, this will cause the filtered offer will be offered after the expire time. Did you set filters when decline offer? If you are enabling GLOG_v=2 for mesos master, you will get some log as "Framework xxx filtere

Re: Support for tasks groups aka pods in Mesos

The answer is No, the taskGroup can be treated as Pod in Kubernetes, it will be a set of containers co-located and co-managed on an agent that share some resources (e.g., network namespace, volumes). For your case, you may want to split your 50 tasks to small task groups. Also the `execute` cli is

Re: Does Mesos 1.0 support GPU ?

uctor Manufacturing Company > > > > |-------------> > |Guangya Liu | > | | > | | > | | > |

Re: Does Mesos 1.0 support GPU ?

Just FYI, the current GPU support only support Mesos Containerizer but not Docker Containerizer. There is a patch chain for Docker Containerizer GPU support here: https://reviews.apache.org/r/50123/ Thanks, Guangya On Tue, Aug 23, 2016 at 9:41 AM, David Greenberg wrote: > I've run the GPU sup

Re: Monitoring at container level

Have you ever tried prometheus + Grafana? Please take a look at https://prometheus.io/docs/visualization/grafana/ to see if it helps. On Fri, Jul 8, 2016 at 5:51 AM, David Kesler wrote: > We use a combination of new relic for application level monitoring and a > custom python script that scrapes

Allocator slack channel

Hi, I created an #allocator slack channel in mesos.slack.com, please join this if you want to have some discussion for allocator related issues, such as allocator performance, optimistic offer, revocable resource etc. @bmahler and @vinodkone, I also posted a RR here https://reviews.apache.org/r/

Re: Mesos persistent volumes as Docker volumes

Hi Hendrik, You can take a look for how Mesos 1.0 support docker volume driver integration with Mesos Containerizer from here https://github.com/apache/mesos/blob/master/docs/docker-volume.md Both Mesos Containerizer and Docker Containerizer support integration with docker volume driver now, you

Re: 0.28.2 - mesos-docker-executor - libmesos not found

You can check what is the output of `ldd mesos-docker-executor` to see if the libmesos-xxx is in the right location. [root@dcos001 mesosphere]# ldd ./packages/mesos--0335ca0d3700ea88ad8b808f3b1b84d747ed07f0/libexec/mesos/mesos-docker-executor | grep libmesos libmesos-0.28.1.so => /opt/mesosphere/p

Re: Running Mesos agent with --containerizers=docker option on Mac

There is a JIRA tracking this https://issues.apache.org/jira/browse/MESOS-3821 , you can apply the patch https://reviews.apache.org/r/39939/ from @haosdent to have a try. Thanks, Guangya On Sat, Jun 4, 2016 at 8:12 AM, Bogdan Ghit wrote: > Hi all, > > I am trying to run an agent as follows on

Re: Force Allocator to provide all available offers to a framework

Yes, it is suggested to use dynamic reservation or persistent volume, please refer to https://issues.apache.org/jira/browse/MESOS-4616 for detail. Thanks, Guangya On Thu, Jun 2, 2016 at 9:33 PM, haosdent wrote: > >How do I prevent the allocator from reducing the length of offers or is > there

Re: Request offers based on Slave Attributes

I think that you can filter the offers based on slave attribute, all of the offers are assigned agent attributes in the offer: https://github.com/apache/mesos/blob/master/src/master/master.cpp#L5637 On Tue, May 31, 2016 at 2:33 PM, Nihal Harish wrote: > Hi, > > The mesos.proto file allows us to

Re: [VOTE] Release Apache Mesos 0.28.2 (rc1)

+1 to this. Only one minor comment: I saw that there are indeed someone using mesos CLI, such as `mesos ps` etc. I did minor enhancement for mesos CLI recently to improve debug-ability, it would be great if we can have those in 0.28.2. The following are the three patches for mesos CLI enhancement

Re: 0.28.2

+1 to Jie for this. mesos-execute is hot recently, deferring this to 1.0 sounds more reasonable. On Mon, May 30, 2016 at 6:43 AM, Jie Yu wrote: > June, per Vinod's response, we typically only backport bug fixes. This is > more like a feature to me as well. > > However, I did try to backport this

Re: Mesos and Openstack

The public (floating) IP in OpenStack was generated by some NAT or iptables rules, and this will not be shown via `ifconfig`. I think that you can try private IP for your whole cluster. Thanks, Guangya On Thu, May 26, 2016 at 10:12 AM, haosdent wrote: > Hi, @Omar > May you change both /etc/mes

Re: 0.28.2

Hi Vinod, What June requested is actually a bug here https://issues.apache.org/jira/browse/MESOS-4744 , does it make sense to back merge this? Thanks, Guangya On Wed, May 25, 2016 at 10:34 PM, Vinod Kone wrote: > Patch releases are for bug fixes ugly only. So you have to wait for the > next s

Re: "Appropriating" an existing process into mesos task

, 2016 at 6:09 PM, Krishnanarayanan VR wrote: > Guangya: > > Thanks for your response. > > yeah, the VMs are created by the mesos executor. I'll take a look at the > checkpointing and see if it works. > > > > On Wed, May 25, 2016 at 10:57 AM, Guangya Liu wrote: >

Re: "Appropriating" an existing process into mesos task

Hi Krishnanarayanan, How did you create your VM on baremetal servers with Mesos? Are you leveraging mesos executor or some other components? The framework have checkpoint logic which can recover tasks in one framework back to original state, please refer to https://github.com/apache/mesos/blob/ma

Re: Setting constraints

on and material for the sole use of the intended > recipient(s). Any review, use or distribution that has not been expressly > authorized by Stem, Inc. is strictly prohibited. If you are not the > intended recipient, please contact the sender and delete all copies. Thank > you. > --

Re: Setting constraints

n expressly >> authorized by Stem, Inc. is strictly prohibited. If you are not the >> intended recipient, please contact the sender and delete all copies. Thank >> you. >> -- >> *From:* Guangya Liu >> *Sent:* Saturday, May 21, 2016

Re: Setting constraints

Hi Scott, I think only setting "constraints": [["hostname", "UNIQUE"] is good enough, please refer to https://github.com/mesosphere/marathon/blob/master/docs/docs/constraints.md#unique-operator Thanks, Guangya On Sun, May 22, 2016 at 12:59 AM, Scott Kinney wrote: > I would like to have one in

Re: Deploying MySQL and WordPress Docker Containers through Marathon

Just FYI, the dc/os does have near term roadmap to enable support for "external volume storage": https://github.com/dcos/dcos-docs/blob/master/1.7/overview/roadmap.md#pluggable-external-volumes , once this was enabled in open source dc/os, you can use this feature to manage your stateful services.

Re: DC/OS dynamic reservation dosen't work

}, >> "role": "dev", >> "reservation": { >> } >> } >> ]' -X POST http://127.0.0.1:5050/reserve >> >> 2. start Marathon with dev role >> >> ``` >> ./bin/start --master 127.0.0

Re: DC/OS dynamic reservation dosen't work

Gaojin, Some questions and suggestions here: 1) How did you deploy the nginx with new marathon URI? I did not found that I can configure the new marathon URI with nginx. 2) Can you please send out the curl output for your master node: a) curl "http://master-ip:5050/master/slaves

Re: Scheduler for distributed builds

The Chronos may also help for your case http://mesos.github.io/chronos/ On Wed, Apr 27, 2016 at 6:40 AM, David Greenberg wrote: > http://github.com/twosigma/cook could be a good fit for this. It supports > scheduling arbitrary jobs within seconds of submission, and it has advanced > QoS features

Re: Hybrid application deployments (container/VM/bare metal) in Mesos

des. Without > the mentioned JIRA implemented, I guess there will be no VM at all and all > non-container apps have to run on physical machine directly? Does Marathon > still use cgroups to limit the resource usage of these apps even they are > not containerized? > > > > Thanks, > &

Re: Hybrid application deployments (container/VM/bare metal) in Mesos

If you do not want to provision VM or PM on demand, then mesos plus marathon can help. There is also a JIRA talking about support Qemu/KVM in mesos https://issues.apache.org/jira/browse/MESOS-2717 On Wed, Apr 13, 2016 at 2:17 PM, tommy xiao wrote: > mesos + marathon natively support your hetero

Re: limit swap usage with docker containeriser

The reason is that DockerContainerizer is using doker CLI to create container, Docker performs the initial container configuration, while modifying resources (CPU, memory, etc.) and the DockerContainerizer cannot compose with other existing and future Mesos isolators, such as the cgroups/mem isolat

Re: Current state of the oversubscription feature

https://issues.apache.org/jira/browse/MESOS-4967 is planning to introduce "Oversubscription for reservation", can you please help check if this help? Thanks, Guangya On Mon, Mar 21, 2016 at 8:54 PM, Erb, Stephan wrote: > Hi everyone, > > I am interested in the current state of the Mesos oversu

Re: rkt / appc support

Hi Dick, This is new functionality, you can refer to https://issues.apache.org/jira/browse/MESOS-2840 for more detail, there are also some design document link append in the JIRA ticket. Thanks, Guangya On Wed, Mar 16, 2016 at 5:24 PM, Dick Davies wrote: > Quick question - what versions of Me

Re: [VOTE] Release Apache Mesos 0.28.0 (rc1)

Tim, What about https://reviews.apache.org/r/42516/ for user-defined network in docker containerizer, the user defined network has been landed in docker for quite a while and it is better to enable mesos docker containerizer support this. Thanks, Guangya On Thu, Mar 10, 2016 at 2:00 AM, Kevin K

Re: [VOTE] Release Apache Mesos 0.28.0 (rc1)

There are also issues related with overlayfs, the overlayfs will not work if linux kernel is greater than 4.2, and also there is no document related to overlayfs. There are already patches and JIRA tickets for both issues. https://reviews.apache.org/r/44421/ https://reviews.apache.org/r/44391/ T

Re: 0.28.0 release

I think that we also need to include https://reviews.apache.org/r/44258/ ( https://issues.apache.org/jira/browse/MESOS-4831) in 0.28 cause this issue will lead two inverse offers with one maintain call. Thanks, Guangya On Fri, Mar 4, 2016 at 9:44 AM, Vinod Kone wrote: > Release vote sent. The

Re: Mixed use workloads in Mesos 0.25 agents/slaves

not get a docker job to run from Aurora. I am verifying if > something needs to done to configure Aurora properly too. > > > > > -- > κρισhναν > > On Sun, Feb 28, 2016 at 6:16 PM, Guangya Liu wrote: > >> Hi Krish, >> >> From the output of mesos-execute, s

Re: Mixed use workloads in Mesos 0.25 agents/slaves

master detected at > master@10.20.3.100:5050 > I0228 04:56:23.080498 13786 sched.cpp:272] No credentials provided. > Attempting to register without authentication > > > > > -- > κρισhναν > > On Sun, Feb 28, 2016 at 8:14 AM, Guangya Liu wrote: > >> Hi Krish, >>

Re: Mixed use workloads in Mesos 0.25 agents/slaves

be wrong. I get the error that the >> 'containerizer' is not supported: "Failed to load unknown flag >> 'containerizer'" >> I am using mesos-0.24.1. >> >> I am trying to run a hello-docker aurora (v0.11) job using docker >> containeriz

Re: Question regarding docker containerizer

The Docker Executor was also managed by Mesos itself, you can refer to https://github.com/apache/mesos/blob/master/src/slave/containerizer/docker.cpp#L1197 , the executor was managed by mesos and mesos can set the default resources for the executor: https://github.com/apache/mesos/blob/master/src/s

Re: limiting nodes to specific frameworks

u are not the intended recipient. If you > are > not the intended recipient, you may not use, copy, disclose, or distribute > this > message or its contents or enclosures to any other person and any such > actions > may be unlawful. Ball reserves the right to monitor and review al

Re: Can Marathon ensure single instance of a service at any give time?

Marathon is designed for long running services no matter the service is stateless or stateful with HA by default. The Marathon will help restart your services if it is down. Thanks, Guangya On Tue, Feb 23, 2016 at 6:06 PM, Petr Novak wrote: > Hello, > if I need to run single stateless instanc

Re: Mesos sometimes not allocating the entire cluster

any resources, but by doing this we seem to have got around the > bug in the allocator that’s causing strange fairness allocations, resulting > in no offers being sent. > > I’m going to look into defining a reproducible test case for this > scheduling situation to coax the allocator into be

Re: Mesos sometimes not allocating the entire cluster

think that’s correct, this is likely to be an offer for a slave > where 9CPUs are currently allocated to an executor. > > I can verify via the agent configuration and HTTP endpoints that most of > the agents do not have a role, and none of the frameworks do. > > Tom. > >

Re: Mesos sometimes not allocating the entire cluster

On Mon, Feb 22, 2016 at 5:16 PM, Tom Arnfeld wrote: > No roles, no reservations. > > We're using the default filter options with all frameworks and default > allocation interval. > > On 21 Feb 2016, at 08:10, Guangya Liu wrote: > > Hi Tom, > > I traced the agen

Re: Mesos sometimes not allocating the entire cluster

a On Mon, Feb 22, 2016 at 5:16 PM, Tom Arnfeld wrote: > No roles, no reservations. > > We're using the default filter options with all frameworks and default > allocation interval. > > On 21 Feb 2016, at 08:10, Guangya Liu wrote: > > Hi Tom, > > I traced t

Re: Mixed use workloads in Mesos 0.25 agents/slaves

#x27;t seem to support non-containerized workloads. > > Is my analysis correct? > > Also, if the above is correct, how does one tell the frameworks > (Aurora/Marathon/Cassandra frameworks) to use containerized vs > non-containerized workload slaves to schedule jobs? > >

Re: Mesos sometimes not allocating the entire cluster

ere’s something here that highlights the issue, we can’t find > anything that we can’t explain. > > Cheers, > > Tom. > > On 19 Feb 2016, at 03:02, Guangya Liu wrote: > > Hi Tom, > > After the patch was applied, there is no need to restart framework but > only meso

Re: Mesos sometimes not allocating the entire cluster

another ~30% of the cluster that is >>>> unallocated, and it stays like this for a significant amount of time until >>>> something changes, perhaps another user joins and allocates the rest >>>> chunks of this spare resource is offered to some of the framewor

Re: Mesos integration with OpenStack HEAT AutoScaling

Hi Petr, It would be great if you can also share your use case here, I can post your feedback/use case to Magnum community to improve Magnum support for Mesos. Thanks, Guangya On Tue, Feb 16, 2016 at 4:20 PM, Guangya Liu wrote: > Hi Peter, > > Have you ever tried Magnum (https://g

Re: Mesos integration with OpenStack HEAT AutoScaling

Hi Peter, Have you ever tried Magnum (https://github.com/openstack/magnum) which is the container service in OpenStack leveraging HEAT to integrate with Kubernetes, Swarm and Mesos. With Magnum, you do not need to maintain your own HEAT template but just let Magnum do this for you, it is more simp

Re: Specifying a preferred host with a Resource Request

ng to the volumes(h1,h2,h3) that it had reserved in its >>> previous >>>run? (over Offers on some hosts that it does not care about) >>> >>> More precisely, I'm trying to ensure that the time for the 'if' check >>> is bounded - >>&

Re: Specifying a preferred host with a Resource Request

ait time for an available resource is limited (say about a minute > or two)? . It can still be a best-effort guarantee and not a strict one. > > > > Thanks again, > Jagadish > > -- > Jagadish > > > > On Fri, Feb 5, 2016 at 6:46 PM, Guangya Liu wrote: > &g

Re: Specifying a preferred host with a Resource Request

Hi Jagadish, Even though Mesos have the interface of "requestResources", it was not implemented in the built-in allocator at the moment, so the call of "driver.requestResources (resources);" will not work. Is it possible that you update your framework logic as this: 1) framework get resoruce offe

Re: Unable to receive offers / long delays when starting or restarting.

Which version of mesos are you using? I suspect that your resources might have been filtered out by the allocator, can you please also attach some logs for mesos master? On Tue, Feb 2, 2016 at 11:29 PM, tommy xiao wrote: > interesting on this case, please follow Shuai Lin's suggestion, provide >

Re: Unable to start mesos slave 0.25+ in docker

I think that you can take a look at https://issues.apache.org/jira/browse/MESOS-3793 to see if it helps. On Fri, Jan 29, 2016 at 4:41 PM, Giulio Eulisse wrote: > Ciao, > > I filed: > > https://issues.apache.org/jira/browse/MESOS-4543 > > about not being able to start a mesos slave in docker sinc

Re: Completely rude alternative to HierarchicalDRF?

Does setting a large weight for this framework help? You can configure different frameworks use different roles. On Tue, Jan 26, 2016 at 7:18 AM, Charles Allen < charles.al...@metamarkets.com> wrote: > Is there an allocator out there that will prioritize frameworks to favor > the oldest first? >

Re: Mesos sometimes not allocating the entire cluster

Can you please help check if some outstanding offers in cluster which does not accept by any framework? You can check this via the endpoint of /master/state.json endpoint. If there are some outstanding offers, you can start the master with a offer_timeout flag to let master rescind some offers if

Re: Share GPU resources via attributes or as custom resources (INTERNAL)

I think that you can use 'curl' to test, please refer to https://open.mesosphere.com/advanced-course/advanced-usage-of-marathon/ On Fri, Jan 15, 2016 at 4:22 PM, wrote: > Thanks Haosdent, > > > > If what you say about Marathon is right (i.e., that Marathon’s constraints > only work with Mesos’ a

Re: Mesos on OpenShift 3.1

Yes, that's an option, but seems many tiers: Kubernetes+Mesos running on top of Kubernetes ;-) On Tue, Jan 5, 2016 at 4:59 PM, Adam Bordelon wrote: > Den, the other option is to run Mesos on top of OpenShift, and then launch > a new k8s-mesos instance on top of Mesos. You wouldn't be reusing the

Re: Mesos on OpenShift 3.1

Hi Den, Yes, you can try to build your own km, as you are using Kubernetes 1.1, so possibly you can follow this https://github.com/kubernetes/kubernetes/blob/release-1.1/docs/getting-started-guides/mesos.md Thanks, Guangya On Tue, Jan 5, 2016 at 3:54 PM, Den Cowboy wrote: > Okay thanks. Some

Re: Mesos on OpenShift 3.1

Sorry I forgot the version, but the "km" binary should located in same directory as "kubelet", so seems your kubernetes v1.1.0-origin-1107-g4c8e6f4 does not include km distribution. I think that you can post a question to kubernetes slack channel or kubernetes mail list to get some help from there

Re: Mesos on OpenShift 3.1

Hi Den, AFAIK, the OpenShift do not include Kubenetes-Mesos distro when I try it month ago, but I do not know if it includes Kubenetes-Mesos distro for now. You can double check if there is a binary named as "km" which is in same directory as "kubelet", if the "km" is there, then you can migrate y

Re: [Proposal] Fine Granularity Resource Allocation

There is already a JIRA ticket here https://issues.apache.org/jira/browse/MESOS-3765 tracing the fine-grained resource offers, after some discussion in community, it is suggested to reach an agreement in community before we move forward. You can append some of your ideas there. Actually for your d

Re: Dynamic Reservations - API to See them

I think there is no API for pure dynamic reservation but there are indeed API for reservations including both static and dynamic reservations. You can query the endpoint /state or /slaves on master to check the reservations status. You may want to file a JIRA ticket if only want to get dynamic res

Re: Can tasks from multiple frameworks simultaneously run on the same slave node?

Just want to show more detail for offer_timeout, currently, there is no default value for it, you may want to specify a value such as "5s" when start up mesos master. Then if the offer was not handled in 5s, it will be returned to master automatically. Cited from https://github.com/apache/mesos/bl

Re: Multiple active masters

There is a JIRA ticket here https://issues.apache.org/jira/browse/MESOS-3548 , you can possibly append your thinking and use case there to push this move forward? Thanks! On Fri, Nov 27, 2015 at 11:16 PM, Elouan Keryell-Even < elouan.kery...@gmail.com> wrote: > Hi, > > I don't think this is possi

Re: many outstanding chronos offers

I think it should be "5mins" or "30secs", please refer to https://github.com/mesosphere/mesos/blob/master/3rdparty/libprocess/3rdparty/stout/include/stout/duration.hpp#L55-L69 for detail, thanks! On Thu, Nov 5, 2015 at 9:04 PM, craig w wrote: > Looks like it would be "5min" or "30s" > > > http

Re: Welcome Kapil as Mesos committer and PMC member!

Congrats Kapil! On Thu, Nov 5, 2015 at 6:02 PM, Till Toenshoff wrote: > I'm happy to announce that Kapil Arya has been voted a Mesos committer and > PMC member! > > Welcome Kapil, and thanks for all of your great contributions to the > project so far! > > Looking forward to lots more of your con

Re: mess slave can't register to master via master ip:port

should be modified. >> >> http://mesos.apache.org/documentation/latest/configuration/#SlaveOptions >> >> >> Right? >> >> >> 发件人: Guangya Liu >> 答复: "user@mesos.apache.org" >> 日期: 2015年11月3日 星期二 下午12:39 >> 至: "user@mesos.ap

Re: mess slave can't register to master via master ip:port

Seems mesos does not support such mode, please refer to https://github.com/apache/mesos/blob/master/src/slave/main.cpp#L105-L111 for the format of "--master". Thanks! On Tue, Nov 3, 2015 at 12:28 PM, haosdent wrote: > After checking code, seems Mesos only support --master=IP1:5050 > or --master=

Re: Oversubscription and quotas

Hi Bharath, I think that you are requesting the "Optimistic Offer" feature which is under going. Please refer to the following link for detail: https://issues.apache.org/jira/browse/MESOS-1607 https://docs.google.com/document/d/1RGrkDNnfyjpOQVxk_kUFJCalNMqnFlzaMRww7j7HSKU/edit The "Optimistic Of

Re: Is there any APIs for status monitering, how did the Webui got the status of mesos?

Hi Marco, I think that you are mentioning http://:5050/master/state There is JIRA ticket https://issues.apache.org/jira/browse/MESOS-3568 planning to add this to mesos document. Thanks, Guangya On Thu, Oct 8, 2015 at 4:44 PM, Marco Massenzio wrote:

Re: Running a task in Mesos cluster

) at > scheduler-a8deafaa-cf10-401c-a61c-515340560c49@127.0.1.1:58843 > I1007 12:16:42.775126 8005 master.cpp:5571] Removing framework > 0ccab17d-20e8-4ab8-9de4-ae60691f8c8e-0003 (Balloon Framework (C++)) at > scheduler-a8deafaa-cf10-401c-a61c-515340560c49@127.0.1.1:58843 > I1007 12

Re: Running a task in Mesos cluster

+) with checkpointing disabled and capabilities [ ] > I1007 11:24:59.700251 32393 hierarchical.hpp:515] Added framework > 89b179d8-9fb7-4a61-ad03-a9a5525482ff-0020 > E1007 11:24:59.700253 32399 process.cpp:1912] Failed to shutdown socket > with fd 13: Transport endpoint is not connected > >

Re: Scheduling tasks based on dependancy

gt; > Can you please give me more information? > > > -Pradeep > > > > On 5 October 2015 at 17:45, Guangya Liu wrote: > >> Hi Pradeep, >> >> I think that you can try Chronos and Marathon which can help you. >> >> *Marathon:* https://github.com/mesospher

Re: Scheduling tasks based on dependancy

other than CPU,MEM, DISK like IO, PCI devices that exists with > the node etc? > > Thanks, > Pradeep > > On 5 October 2015 at 17:45, Guangya Liu wrote: > >> Hi Pradeep, >> >> I think that you can try Chronos and Marathon which can help you. >> >&

Re: Scheduling tasks based on dependancy

Hi Pradeep, I think that you can try Chronos and Marathon which can help you. *Marathon:* https://github.com/mesosphere/marathon You can try Marathon + Mesos + Mesos Resource Attribute When you start up mesos slave, uses --attributes option, here is an example: ./bin/mesos-slave.sh --master=9.21

Re: Xian-Mesos-User-Group: Apache Mesos Startup In Xi'an China

Hi, All of the materials of Xian Mesos Meetup have been uploaded to http://www.meetup.com/Xian-Mesos-User-Group/files/ There are 3 topics: 1) Seattle Mesos Conf Recap - Guangya Liu 2) Mesos Community Guidance - Klaus Ma 3) IBM Platform Computing DCOS Technology Overview - Lei Su Please take a

Re: Running a task in Mesos cluster

1005 13:24:04.642654 4826 slave.cpp:1980] Asked to shut down framework > 77539063-89ce-4efa-a20b-ca788abbd912-0066 by master@192.168.0.102:5050 > W1005 13:24:04.642812 4826 slave.cpp:1995] Cannot shut down unknown > framework 77539063-89ce-4efa-a20b-ca788abbd912-0066 > > > > On 5

Re: Running a task in Mesos cluster

efa-a20b-ca788abbd912-0055 () at > scheduler-b1bc0243-b5be-44ae-894c-ca318c24ce6d@127.0.1.1:47259 > > > Can you please tell me what is the reason? The client is in the same > network as well. But it does not run any master or slave processes. > > Thanks & Regards, > Prad

Re: Running a task in Mesos cluster

' is already > attached to another hierarchy > > I took that out from the cluster for now. The tasks are getting scheduled > on the other two slave nodes. > > Thanks for your timely help > > -Pradeep > > On 5 October 2015 at 10:54, Guangya Liu wrote: > >>

Re: Running a task in Mesos cluster

o know how did you launch the tasks. > > 1. What processes you have started on Master? > 2. What are the processes you have started on Slaves? > > I am missing something here, otherwise all my slave have enough memory and > cpus to launch the tasks I mentioned. > What I am missing

Re: Running a task in Mesos cluster

> E1002 10:01:12.754118 7417 process.cpp:1912] Failed to shutdown socket >>> with fd 16: Transport endpoint is not connected >>> I1002 10:01:12.754132 7413 master.cpp:2553] Deactivating slave >>> 6a11063e-b8ff-43bd-86cf-e6eef0de06fd-S62 at slave(1)@127.0.1.1:5051 &

Re: Running a task in Mesos cluster

Hi Pradeep, Please check some of my questions in line. Thanks, Guangya On Fri, Oct 2, 2015 at 12:55 AM, Pradeep Kiruvale wrote: > Hi All, > > I am new to Mesos. I have set up a Mesos cluster with 1 Master and 3 > Slaves. > > One slave runs on the Master Node itself and Other slaves run on dif

Re: how does resource allocation work with docker?

mber of requested cpus. It also appears there's no way to >> determine the cpu share from within docker without explicitly passing an >> environment variable, etc. >> -- >> *From:* Guangya Liu [gyliu...@gmail.com] >> *Sent:* Wednesday, Sep

Re: how does resource allocation work with docker?

Hi Clarke, You can take a look at the framework for docker here https://github.com/apache/mesos/blob/master/src/examples/docker_no_executor_framework.cpp All of the resource limitations for a docker task should be defined in the framework. Thanks, Guangya On Wed, Sep 23, 2015 at 9:33 PM, Clark

Re: Reservations for multiple different agents

. < rdigior...@pace.edu> wrote: > > On Sep 21, 2015, at 19:33, Guangya Liu wrote: > > HI Rinaldo, > > I think that you can use dynamic reservation feature to achieve this: You > can launch your tasks after reservation succeeds. Actually, all of the > dynamic reservation

Re: Reservations for multiple different agents

HI Rinaldo, I think that you can use dynamic reservation feature to achieve this: You can launch your tasks after reservation succeeds. Actually, all of the dynamic reservation feature with endpoint has been finished except ACL part, so you can use this feature now if you do not care ACL part. T

Re: Documentation for Multi-Tenancy support

Hi Stephen, This is a project under going in mesos community, you may wan to refer to the following two JIRA ticket to get more details. [1] https://issues.apache.org/jira/browse/MESOS-1791 [2] https://issues.apache.org/jira/browse/MESOS-2936 Thanks, Guangya On Wed, Sep 16, 2015 at 8:04 AM, Ste

Re: Setting maximum per-node resources in offers

be > deployed in standalone mode on top of Aurora on top of Mesos. :) > > Funny enough, two of my colleagues (Tim St. Clair and Erik Erlandson) seem > to be tracking and commenting on the epic you linked to. :) > > On Wed, Sep 9, 2015 at 12:59 AM, Guangya Liu wrote: > >

Re: Setting maximum per-node resources in offers

pic: https://issues.apache.org/jira/browse/MESOS-1791 Design doc: https://docs.google.com/document/d/16iRNmziasEjVOblYp5bbkeBZ7pnjNlaIzPQqMTHQ-9I/edit?pli=1#heading=h.9g7fqjh6652v > > RJ > > > > On Sep 8, 2015, at 11:47 PM, Guangya Liu wrote: > > Hi RJ, > > I think t

Re: Setting maximum per-node resources in offers

Hi RJ, I think that your final goal is that you want to use framework running on top of mesos to execute some tasks. Such logic should be in the framework part. The netflix open sourced a framework scheduler library named as fenzo, you may want to take a look at this one to see if it can help you.

Xian-Mesos-User-Group: Apache Mesos Startup In Xi'an China

Hi All, The first Mesos Meetup in Xi'an China will be held on 2015-09-19 hosted by IBM CSTL! For more detail, please refer to http://www.meetup.com/Xian-Mesos-User-Group/events/225153460/?a=ra1_te , welcome to join us! Because it is a local meetup in China, so the content are written in Chinese b