Re: mesos docker vs native container

2016-04-26 Thread Avinash Sridharan
Docker does use bridged networking by default, but it uses linux bridges to perform the bridging, there is no docker-proxy process. The problem with docker bridge network is that the address space of the container spawned on the docker bridge are different than the host network, so you need to perf

Re: mesos docker vs native container

2016-04-26 Thread Jeff Schroeder
I think you might be a bit confused now this all works. Docker by default uses bridged networking, which by default spins up a little crappy docker-proxy process for every port. You can disable docker-proxy and instead use hairpin routing mode if you have a modern kernel. However, I'm almost certai

Re: Scheduler for distributed builds

2016-04-26 Thread David Greenberg
http://github.com/twosigma/cook could be a good fit for this. It supports scheduling arbitrary jobs within seconds of submission, and it has advanced QoS features. On Tue, Apr 26, 2016 at 3:13 PM Paulo Gallo wrote: > Hi, > > I'm looking for a scheduler to do distributed builds, i.e. most of the

Scheduler for distributed builds

2016-04-26 Thread Paulo Gallo
Hi, I'm looking for a scheduler to do distributed builds, i.e. most of the tasks would be short lived, like a few hundred ms long. Is there's any Mesos based scheduler that would be a good fit for this? Any help is appreciated. Thanks, -Paulo PS: I know that Jenkins supports distributed builds

Re: mesos docker vs native container

2016-04-26 Thread vincent gromakowski
Question is more related to mesos. I am thinking of using docker instead of native (LXC?) containers but I suspect network performance decrease which is important on big data workloads. Can you explain why its not secured In host mode ? Le 26 avr. 2016 7:51 PM, "Avinash Sridharan" a écrit : > H

Re: FW: failure notice

2016-04-26 Thread Pradeep Chhetri
Not sure though but my guess is that Mesos slave is unable to pull the docker image. Are you using private docker registry ? On Apr 26, 2016 5:24 PM, wrote: > Hi, > > I tried running python application through Marathon GUI ( > https://docs.docker.com/engine/userguide/containers/usingdocker/).The

Re: mesos docker vs native container

2016-04-26 Thread Avinash Sridharan
Hi Vincent, What do you mean by native container through Docker? Can you clarify your question a bit. Also if it's a DC/OS specific question you might want to post at us...@dcos.io . Thanks, Avinash On Tue, Apr 26, 2016 at 10:41 AM, vincent gromakowski < vincent.gromakow...@gmail.com> wrote: >

Re: mesos docker vs native container

2016-04-26 Thread Steven Schlansker
> On Apr 25, 2016, at 12:37 AM, vincent gromakowski > wrote: > > I am very interesting in getting some feedback of people who has moved from > native container through Docker specially from network performance > perspective. > DCOS has been open sourced and I like all automation it brings wit

Re: mesos docker vs native container

2016-04-26 Thread vincent gromakowski
Nobody experienced docker vs native container performance ? Le 25 avr. 2016 9:37 AM, "vincent gromakowski" < vincent.gromakow...@gmail.com> a écrit : > I am very interesting in getting some feedback of people who has moved > from native container through Docker specially from network performance >

Re: Launch docker container from Marathon UI

2016-04-26 Thread June Taylor
The answer to your question is not very simple. I am still figuring this out myself, but you can look at certain projects such as mesos-dns which publish SRV records for running docker containers, allowing you to programmatically find services you have started up. For example, here I have started u

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
Yes i guess i understood, so when i star a socker container like wordpress this app could have the need to contact another container as mysql, here project calico should be an efficient way to make this. Ok i will try, just to understand, first i run the mysql, then mesos will allocate it on a cert

Re: Setting ulimits on mesos-slave

2016-04-26 Thread June Taylor
That is a good point - is the executor spun off as a different PID, if so it would perhaps inherit a different fsize value. Thanks, June Taylor System Administrator, Minnesota Population Center University of Minnesota On Tue, Apr 26, 2016 at 11:43 AM, haosdent wrote: > I disable the limit glob

Re: Setting ulimits on mesos-slave

2016-04-26 Thread haosdent
I disable the limit globally and retry set ``` limit fsize unlimited unlimited ``` in /etc/init/mesos-slave.conf after reboot. It works as well according to check limits under /proc May you double check this in your side? I wonder if the fszie only effective on Mesos Agent and doesn't work in you

Re: FW: failure notice

2016-04-26 Thread Gilbert Song
Hi Aishwarya, It would be helpful to find out the root cause if the agent log and sandbox log can be attached:) Gilbert On Tue, Apr 26, 2016 at 5:17 AM, haosdent wrote: > Could you provide Mesos Agent log and stdout/stderr log? > > On Tue, Apr 26, 2016 at 7:53 PM, > wrote: > >> Hi, >> >> I tr

RE: Launch docker container from Marathon UI

2016-04-26 Thread Aaron Carey
Then you need to tell marathon to run the mysql container first, and then submit the wordpress container. Sorry I think I misunderstood! -- Aaron Carey Production Engineer - Cloud Pipeline Industrial Light & Magic London 020 3751 9150 From: Stefano Bianchi [ja

Re: Launch docker container from Marathon UI

2016-04-26 Thread June Taylor
Stefano, You would want to search for an appropriate image on Docker Hub. Here is one I have NO experience with: https://hub.docker.com/_/mysql/ You would then need to learn about how the image is expecting to be configured, so you can set it up appropriately. This is not really a fully thought

RE: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
My problem is this, where can i find the mysql container? I have just said to marathon to rim a wordpress docker container, without specify mysql one. Il 26/apr/2016 17:39, "Aaron Carey" ha scritto: > If you run the wordpress container on a different host to the mysql > container and use --link o

Re: Launch docker container from Marathon UI

2016-04-26 Thread Rad Gruchalski
Marathon does not know it has to run it. You need to tell Marathon to start mysql container and then tell your wordpress container where is your mysql. Best regards,
 Radek Gruchalski 
ra...@gruchalski.com (mailto:ra...@gruchalski.com)
 (mailto:ra...@gruchalski.com) de.linkedin.com/in/r

RE: Launch docker container from Marathon UI

2016-04-26 Thread Aaron Carey
If you run the wordpress container on a different host to the mysql container and use --link on the command line, does that work? -- Aaron Carey Production Engineer - Cloud Pipeline Industrial Light & Magic London 020 3751 9150 From: Stefano Bianchi [jazzist...

RE: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
Hi Aaron Actually both mesos-dns and calico are running even though these containers im running are not, yet, using the calico ipaddr specific in json description. So i guess it is a problem of bridging, i guess simply specify HOST option on container field in Marathon UI Il 26/apr/2016 16:59, "Aar

RE: Launch docker container from Marathon UI

2016-04-26 Thread Aaron Carey
--link in docker should really be avoided when using marathon/mesos as it implies the containers are on the same host, but this will not always be the case when mesos schedules your containers (also I think it's being deprecated in docker anyway.. not sure though?). This problem looks like one

Re: Launch docker container from Marathon UI

2016-04-26 Thread June Taylor
Stefano, The docker run flag --link is intended to connect the container to another running container. I do not know how this would operate in marathon. Perhaps it would be an application group which starts up the mysql docker image first, then the Wordpress docker image after it. Thanks, June T

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
Thanks *Rad* Gruchalski, actually i'm trying to make a json file that "translate" this command in marathon: docker run --name some-wordpress --link some-mysql:mysql -d wordpress i guess the error is relate to the fact that i'm not specifying --link some-mysql:mysql My problem is that i don't know

Re: Launch docker container from Marathon UI

2016-04-26 Thread Rad Gruchalski
It says exactly what the problem is. Start a marathon task with correct environment variables in env and you will be fine. Best regards,
 Radek Gruchalski 
ra...@gruchalski.com (mailto:ra...@gruchalski.com)
 (mailto:ra...@gruchalski.com) de.linkedin.com/in/radgruchalski/ (http://d

Re: Launch docker container from Marathon UI

2016-04-26 Thread June Taylor
The docker container you're using seems to be expecting environment variables which you have not supplied. Thanks, June Taylor System Administrator, Minnesota Population Center University of Minnesota On Tue, Apr 26, 2016 at 8:56 AM, Stefano Bianchi wrote: > jupyter is working fine. > i tried

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
jupyter is working fine. i tried to run wordpress and i get this error in stderr of mesos: error: missing WORDPRESS_DB_HOST and MYSQL_PORT_3306_TCP environment variables Did you forget to --link some_mysql_container:mysql or set an external db with -e WORDPRESS_DB_HOST=hostname:port? Some

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
However thank you so much to all! 2016-04-26 15:22 GMT+02:00 Stefano Bianchi : > i found the answer by my self sorry if i disturbed you. > > 2016-04-26 15:19 GMT+02:00 Stefano Bianchi : > >> Now that it is running, how can i check the User Interface? >> >> >> 2016-04-26 15:18 GMT+02:00 Stefano Bi

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
i found the answer by my self sorry if i disturbed you. 2016-04-26 15:19 GMT+02:00 Stefano Bianchi : > Now that it is running, how can i check the User Interface? > > > 2016-04-26 15:18 GMT+02:00 Stefano Bianchi : > >> Yes, now it's running!!! June you are awesome!!! >> >> 2016-04-26 15:16 GMT+02

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
Now that it is running, how can i check the User Interface? 2016-04-26 15:18 GMT+02:00 Stefano Bianchi : > Yes, now it's running!!! June you are awesome!!! > > 2016-04-26 15:16 GMT+02:00 Stefano Bianchi : > >> i have done these 2 commands, now jupyter is in deploying in marathon, >> staging in m

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
Yes, now it's running!!! June you are awesome!!! 2016-04-26 15:16 GMT+02:00 Stefano Bianchi : > i have done these 2 commands, now jupyter is in deploying in marathon, > staging in mesos. > Is there some additional configuration needed? > > 2016-04-26 15:13 GMT+02:00 Stefano Bianchi : > >> June i

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
i have done these 2 commands, now jupyter is in deploying in marathon, staging in mesos. Is there some additional configuration needed? 2016-04-26 15:13 GMT+02:00 Stefano Bianchi : > June i tried to run your json, but the task is waiting, and if starts it > failed immediately. > > I guess because

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
June i tried to run your json, but the task is waiting, and if starts it failed immediately. I guess because i did not type this commands: 1. echo 'docker,mesos' > /etc/mesos-slave/containerizers 2. $ echo '5mins' > /etc/mesos-slave/executor_registration_timeout Could it be the

Re: Launch docker container from Marathon UI

2016-04-26 Thread June Taylor
Stefano, Per your earlier question, "group/image" refers to the path you will see in the Docker Hub website on the right side, after the "docker pull" command. In the Jupyter Notebook example I gave you, jupyter is the group, and notebook is the image, with the / literal separating them. Thanks,

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
Thank you June taylor, it is axactly what i was intending. if it is not disturbing you, i try jupyter notebook as well, just to make some tests on how to launch marathon. stay tuned :) 2016-04-26 14:58 GMT+02:00 Stefano Bianchi : > thanks haosdent. > actually i have run this kind of apps through

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
thanks haosdent. actually i have run this kind of apps through rest api. Now i want learn how to laung docker files. I found this exaple: { "container": { "type": "DOCKER", "docker": { "network": "HOST", "image": "group/image" }, "volumes": [ { "containe

Re: Setting ulimits on mesos-slave

2016-04-26 Thread June Taylor
Perhaps the "unlimited" keyword is what is not working? What should be specified for Unlimited? Thanks, June Taylor System Administrator, Minnesota Population Center University of Minnesota On Mon, Apr 25, 2016 at 9:48 PM, haosdent wrote: > According my test, it works in my side. > > * Before

Re: Launch docker container from Marathon UI

2016-04-26 Thread June Taylor
Stefano, I hope this information is helpful: You should specify the docker hub path, which is the what you can see after the Docker Pull command on the Hub page. In your case, simply the word: "wordpress" without quotes, is what you would use as the Image. You will also need to specify port bind

Re: Launch docker container from Marathon UI

2016-04-26 Thread Rad Gruchalski
Here’s the up to date URL: https://mesosphere.github.io/marathon/docs/generated/api.html#v2_apps_post Best regards,
 Radek Gruchalski 
ra...@gruchalski.com (mailto:ra...@gruchalski.com)
 (mailto:ra...@gruchalski.com) de.linkedin.com/in/radgruchalski/ (http://de.linkedin.com/in/radgruch

Re: Launch docker container from Marathon UI

2016-04-26 Thread haosdent
This is marathon REST API document: https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps . Usually we define a task json file and call the rest api. For example, create tasks.json which content is ``` { "id": "/test-sleep", "cmd": "sleep 200" } ``` And ``` curl -X POST -H "Cont

Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
Hi guys i'm trying to follow the instructions on mesosphere documentation, but it is a little bit unlear for me that i am new to this world. i' would like to launch a wordpress container, present on docker hub here https://hub.docker.com/_/wordpress/ , from marathon UI but i don't understand the m

Re: FW: failure notice

2016-04-26 Thread haosdent
Could you provide Mesos Agent log and stdout/stderr log? On Tue, Apr 26, 2016 at 7:53 PM, wrote: > Hi, > > I tried running python application through Marathon GUI ( > https://docs.docker.com/engine/userguide/containers/usingdocker/).The > application is delaying to deploy and the task is failin

FW: failure notice

2016-04-26 Thread aishwarya.adyanthaya
Hi, I tried running python application through Marathon GUI (https://docs.docker.com/engine/userguide/containers/usingdocker/).The application is delaying to deploy and the task is failing . This what I am getting the error:- Task id hello-world.8b610fde-0b97-11e6-8964-fa163e724e71 State TASK

Re: Run Mesos without master being able to open connections to slaves

2016-04-26 Thread Elouan Keryell-Even
2016-04-25 19:27 GMT+02:00 Vinod Kone : > > On Mon, Apr 25, 2016 at 8:35 AM, Elouan Keryell-Even < > elouan.kery...@gmail.com> wrote: > >> So I'd be glad to have some insight from you guys about if it is >> possible, in one way or another, to make Mesos work without the Master >> being able to ini