Re: Custom flags to docker run
Hey Steven, If you check the marathon REST API documentation https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps you can see you can add docker parameters. However, I still feel the need to mention this is the Mesos mail list and you should post your Marathon related questions to the Marathon mailing list. On 12 Aug 2015, at 09:16, Stephen Knight skni...@pivotal.io wrote: Hi, Is there a way to pass a custom flag to docker run through the Marathon API? I've not seen anything in the documentation, this could just be a basic reading fail on my part. What I want to do is use Calico (or similar) with Docker and provision containers via Marathon. Weave is messy for what I am trying to achieve and the integration isn't going as planned, is there a better option and how can you then integrate it? Does that flexibility exist in the Marathon API? Thx Stephen
Re: Custom flags to docker run
I understand, thanks for the help. I'll dig a little deeper on the right mailing list. On Wed, Aug 12, 2015 at 11:34 AM, Alexander Rojas alexan...@mesosphere.io wrote: Hey Steven, If you check the marathon REST API documentation https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps you can see you can add docker parameters. However, I still feel the need to mention this is the Mesos mail list and you should post your Marathon related questions to the Marathon mailing list. On 12 Aug 2015, at 09:16, Stephen Knight skni...@pivotal.io wrote: Hi, Is there a way to pass a custom flag to docker run through the Marathon API? I've not seen anything in the documentation, this could just be a basic reading fail on my part. What I want to do is use Calico (or similar) with Docker and provision containers via Marathon. Weave is messy for what I am trying to achieve and the integration isn't going as planned, is there a better option and how can you then integrate it? Does that flexibility exist in the Marathon API? Thx Stephen
Re: Ambari and Mesos
Agree, there are need more works to integrate them. On Wed, Aug 12, 2015 at 3:14 PM, Stephen Knight skni...@pivotal.io wrote: Well essentially I want to bring Mesos and Hadoop together, particularly MRV2. Instead of relying on 2 different schedulers, it would be great to have a framework that allows the datanode to be a docker container provisioned in Mesos as an Ambari target. I see there is some work from Twitter/Ebay on Project Myriad which would bring the two together. Have to wait and see how that turns out i guess. On Tue, Aug 11, 2015 at 11:42 PM, Tim St Clair tstcl...@redhat.com wrote: Depends entirely what you are trying to do, b/c Ambari has a host of capabilities which make it a full management tool for HDP. So it may make more sense to break-down what features you are looking to integrate... Cheers, Tim -- *From: *Stephen Knight skni...@pivotal.io *To: *user@mesos.apache.org *Sent: *Tuesday, August 11, 2015 8:56:35 AM *Subject: *Ambari and Mesos Hi guys, Is there a way to integrate Ambari and Mesos? I see that Mesos is capable of managing Hadoop in the sense that it will distribute out resource but how would you couple that with Ambari? Any advice is greatly appreciated. Thanks -- Cheers, Timothy St. Clair Red Hat Inc. -- Best Regards, Haosdent Huang
Re: Ambari and Mesos
Well essentially I want to bring Mesos and Hadoop together, particularly MRV2. Instead of relying on 2 different schedulers, it would be great to have a framework that allows the datanode to be a docker container provisioned in Mesos as an Ambari target. I see there is some work from Twitter/Ebay on Project Myriad which would bring the two together. Have to wait and see how that turns out i guess. On Tue, Aug 11, 2015 at 11:42 PM, Tim St Clair tstcl...@redhat.com wrote: Depends entirely what you are trying to do, b/c Ambari has a host of capabilities which make it a full management tool for HDP. So it may make more sense to break-down what features you are looking to integrate... Cheers, Tim -- *From: *Stephen Knight skni...@pivotal.io *To: *user@mesos.apache.org *Sent: *Tuesday, August 11, 2015 8:56:35 AM *Subject: *Ambari and Mesos Hi guys, Is there a way to integrate Ambari and Mesos? I see that Mesos is capable of managing Hadoop in the sense that it will distribute out resource but how would you couple that with Ambari? Any advice is greatly appreciated. Thanks -- Cheers, Timothy St. Clair Red Hat Inc.
Re: Mesos, Multinode Workload Network segregation
Awesome-sauce ! I plan to be there at the conference. To me, this is the natural progression with mesos. Will this be integrated with a mesos release? Trevor Alexander Powell Sr. Manager, Cloud Engineer Architecture 7575 Gateway Blvd. Newark, CA 94560 T: +1.510.713.3751 M: +1.650.325.7467 www.rms.com On Aug 10, 2015 11:50 PM, Christos Kozyrakis kozyr...@gmail.com wrote: Hi Trevor, we are working with Project Calico in order to implement two important features (urgently missing in Mesos imho): - IPs per container: this will eliminate port conflicts when apps with specific port needs get deployed on the same slave - network-level isolation: so that you can control which apps can reach each other and how, within or across slaves. The details will be presented at MesosCon and code released soon after that to the open source. Let me know if you need more info ahead of time. On Mon, Aug 10, 2015 at 11:24 PM, Trevor Powell trevor.pow...@rms.commailto:trevor.pow...@rms.com wrote: Anyone have any thoughts on how Mesos may accomplish this use case? We have several workloads that span multiple slaves and we want to ensure those work loads can see each other, the internet, and nothing else. Basically we have untrusted groups of work loads. We trust the load to talk to itself across a several slaves. But we don’t trust it to not affect or inspect other work loads on the same slave. Basically we are looking to place “blinders” on the work load. So it can only see what it needs to see from the network level. I have heard of things like weave or Project calico (http://www.projectcalico.org/learn/) . They seem promising. But I ponder what Mesos is looking to do long term. -- [cid:E81DB7C8-03F6-42D9-8B9C-5BD2135A06C9]http://www.rms.com/ Trevor Alexander Powell Sr. Manager, Cloud Engineer Architecture 7575 Gateway Blvd. Newark, CA 94560 T: +1.510.713.3751 M: +1.650.325.7467 www.rms.comhttp://www.rms.com/ -- Christos
Re: Custom flags to docker run
Hi Stephen, Via Marathon I am deploying Docker containers across a Mesos cluster. The containers have unique Weave IP@s allowing inter-container communication. All things considered, getting to this point has been relatively straight-forward, and Weave has been one of the IJW components. I'd be curious to learn why you're finding Weave messy. If you'd like to take it out-of-band (as it were), please feel free to e-mail me directly. Cordially, Paul On Wed, Aug 12, 2015 at 3:16 AM, Stephen Knight skni...@pivotal.io wrote: Hi, Is there a way to pass a custom flag to docker run through the Marathon API? I've not seen anything in the documentation, this could just be a basic reading fail on my part. What I want to do is use Calico (or similar) with Docker and provision containers via Marathon. Weave is messy for what I am trying to achieve and the integration isn't going as planned, is there a better option and how can you then integrate it? Does that flexibility exist in the Marathon API? Thx Stephen
Re: Ambari and Mesos
Ambari provides several features, such as monitor/alert and cluster management: - regarding monitor/alert, Mesos has provided metrics API; we can follow Ambari's Sink protocol to show them in Ambari - regarding cluster management, suggest to ask Ambari acquire resources from Mesos and start related daemon by Mesos; not only YARN, but also Kafka, Storm and others Regards -- Klaus Ma (马达), PMP® | Advisory Software Engineer Platform Symphony MapReduce Development Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://www.cguru.net On 08/12/2015 03:20 PM, haosdent wrote: Agree, there are need more works to integrate them. On Wed, Aug 12, 2015 at 3:14 PM, Stephen Knight skni...@pivotal.io mailto:skni...@pivotal.io wrote: Well essentially I want to bring Mesos and Hadoop together, particularly MRV2. Instead of relying on 2 different schedulers, it would be great to have a framework that allows the datanode to be a docker container provisioned in Mesos as an Ambari target. I see there is some work from Twitter/Ebay on Project Myriad which would bring the two together. Have to wait and see how that turns out i guess. On Tue, Aug 11, 2015 at 11:42 PM, Tim St Clair tstcl...@redhat.com mailto:tstcl...@redhat.com wrote: Depends entirely what you are trying to do, b/c Ambari has a host of capabilities which make it a full management tool for HDP. So it may make more sense to break-down what features you are looking to integrate... Cheers, Tim *From: *Stephen Knight skni...@pivotal.io mailto:skni...@pivotal.io *To: *user@mesos.apache.org mailto:user@mesos.apache.org *Sent: *Tuesday, August 11, 2015 8:56:35 AM *Subject: *Ambari and Mesos Hi guys, Is there a way to integrate Ambari and Mesos? I see that Mesos is capable of managing Hadoop in the sense that it will distribute out resource but how would you couple that with Ambari? Any advice is greatly appreciated. Thanks -- Cheers, Timothy St. Clair Red Hat Inc. -- Best Regards, Haosdent Huang -- Klaus Ma (马达), PMP® | Advisory Software Engineer Platform Symphony MapReduce Development Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://www.cguru.net
