Re: Mesos 0.28.2 does not start

2016-06-11 Thread Stefano Bianchi
Wait, i saw now that on openstack security group pots 5050 8080 and 4400
are not open...

2016-06-11 19:35 GMT+02:00 Erik Weathers <eweath...@groupon.com>:

> I'm not 100% sure what is implied by "public" and "floating" IPs here.
> Are the IPs of 10.20.250.x the *actual* IPs on the hosts?  i.e., if you run
> "ifconfig -a" or "ip a" do those IPs appear?   If not then you cannot bind
> to them on the host.
>
> - Erik
>
> On Sat, Jun 11, 2016 at 10:32 AM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> the problem is presented also on 0.27.2 i tried to perform a yum
>> downgrade mesos-0.27.2 and i still have this problem. i don't understand
>> why. i followed the common procedure as for my previous work.
>>
>> 2016-06-11 19:30 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>
>>> The floating IPs are correclty set both on /etc/mesos-master/ip and
>>> /etc/mesos-master/hostname
>>>
>>> 2016-06-11 19:27 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>>> i checked now, and i have correctly set 10.250.0.124, 10.250.0.125, 
>>>> 10.250.0.126
>>>> according to the masters floating IPs
>>>>
>>>> 2016-06-11 19:18 GMT+02:00 haosdent <haosd...@gmail.com>:
>>>>
>>>>> Oh, according to the log. It looks like your set /etc/mesos-master/ip
>>>>> to 10.250.0.12?
>>>>>
>>>>> On Sun, Jun 12, 2016 at 1:15 AM, Stefano Bianchi <jazzist...@gmail.com
>>>>> > wrote:
>>>>>
>>>>>> i dont' have 10.250.0.12 <http://10.250.0.12:5050/> floating IP, i
>>>>>> have 10.250.0.124 <http://10.250.0.12:5050/> 10.250.0.125
>>>>>> <http://10.250.0.12:5050/> and 10.250.0.126
>>>>>> <http://10.250.0.12:5050/>
>>>>>>
>>>>>> 2016-06-11 19:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>>
>>>>>>> sorry i have made a mistakee in my previous message,
>>>>>>> On each master: nano /etc/zookeeper/conf/zoo.cfg
>>>>>>> the last three lines are:
>>>>>>> server.1=192.168.100.3:2888:3888
>>>>>>> server.2=192.168.100.4:2888:3888
>>>>>>> server.3=192.168.10.3:2888:3888
>>>>>>>
>>>>>>> these are the correct IPs i have set in this file.
>>>>>>>
>>>>>>> 2016-06-11 15:36 GMT+02:00 haosdent <haosd...@gmail.com>:
>>>>>>>
>>>>>>>> If 10.250.0.12:5050 used by any other processes?
>>>>>>>>
>>>>>>>> On Sat, Jun 11, 2016 at 9:18 PM, Stefano Bianchi <
>>>>>>>> jazzist...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> I have set:
>>>>>>>>>
>>>>>>>>> 1)
>>>>>>>>> On master1:
>>>>>>>>> sudo -u zookeeper zookeeper-server-initialize --myid=1
>>>>>>>>>
>>>>>>>>> On Master2:
>>>>>>>>> sudo -u zookeeper zookeeper-server-initialize --myid=2
>>>>>>>>>
>>>>>>>>> On Master3:
>>>>>>>>> sudo -u zookeeper zookeeper-server-initialize --myid=3
>>>>>>>>>
>>>>>>>>> i checked /var/lib/zookeeper/myid and i get correctly 1, 2 and 3
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 2) On each master: nano /etc/zookeeper/conf/zoo.cfg
>>>>>>>>> the last three lines are:
>>>>>>>>> server.1=192.168.100.54:2888:3888
>>>>>>>>> server.2=192.168.100.55:2888:3888
>>>>>>>>> server.3=192.168.10.16:2888:3888
>>>>>>>>>
>>>>>>>>> where 2888 and 3888 are both open on openstack security group.
>>>>>>>>>
>>>>>>>>> 3)nano /etc/mesos/zk
>>>>>>>>>
>>>>>>>>> zk://192.168.100.3:2181,192.168.100.4:2181,192.168.10.3:2181/mesos
>>>>>>>>>
>>>>>>>>> 4) Set the quorum to 2with
>>>>>>>>> nano /etc/mesos-master/quorum  and i have written 2
>>>>>>>>>
>>>>>

Re: Mesos 0.28.2 does not start

2016-06-11 Thread Stefano Bianchi
The floating IPs are correclty set both on /etc/mesos-master/ip and
/etc/mesos-master/hostname

2016-06-11 19:27 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> i checked now, and i have correctly set 10.250.0.124, 10.250.0.125, 
> 10.250.0.126
> according to the masters floating IPs
>
> 2016-06-11 19:18 GMT+02:00 haosdent <haosd...@gmail.com>:
>
>> Oh, according to the log. It looks like your set /etc/mesos-master/ip
>> to 10.250.0.12?
>>
>> On Sun, Jun 12, 2016 at 1:15 AM, Stefano Bianchi <jazzist...@gmail.com>
>> wrote:
>>
>>> i dont' have 10.250.0.12 <http://10.250.0.12:5050/> floating IP, i have
>>> 10.250.0.124 <http://10.250.0.12:5050/> 10.250.0.125
>>> <http://10.250.0.12:5050/> and 10.250.0.126 <http://10.250.0.12:5050/>
>>>
>>> 2016-06-11 19:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>>> sorry i have made a mistakee in my previous message,
>>>> On each master: nano /etc/zookeeper/conf/zoo.cfg
>>>> the last three lines are:
>>>> server.1=192.168.100.3:2888:3888
>>>> server.2=192.168.100.4:2888:3888
>>>> server.3=192.168.10.3:2888:3888
>>>>
>>>> these are the correct IPs i have set in this file.
>>>>
>>>> 2016-06-11 15:36 GMT+02:00 haosdent <haosd...@gmail.com>:
>>>>
>>>>> If 10.250.0.12:5050 used by any other processes?
>>>>>
>>>>> On Sat, Jun 11, 2016 at 9:18 PM, Stefano Bianchi <jazzist...@gmail.com
>>>>> > wrote:
>>>>>
>>>>>> I have set:
>>>>>>
>>>>>> 1)
>>>>>> On master1:
>>>>>> sudo -u zookeeper zookeeper-server-initialize --myid=1
>>>>>>
>>>>>> On Master2:
>>>>>> sudo -u zookeeper zookeeper-server-initialize --myid=2
>>>>>>
>>>>>> On Master3:
>>>>>> sudo -u zookeeper zookeeper-server-initialize --myid=3
>>>>>>
>>>>>> i checked /var/lib/zookeeper/myid and i get correctly 1, 2 and 3
>>>>>>
>>>>>>
>>>>>> 2) On each master: nano /etc/zookeeper/conf/zoo.cfg
>>>>>> the last three lines are:
>>>>>> server.1=192.168.100.54:2888:3888
>>>>>> server.2=192.168.100.55:2888:3888
>>>>>> server.3=192.168.10.16:2888:3888
>>>>>>
>>>>>> where 2888 and 3888 are both open on openstack security group.
>>>>>>
>>>>>> 3)nano /etc/mesos/zk
>>>>>>
>>>>>> zk://192.168.100.3:2181,192.168.100.4:2181,192.168.10.3:2181/mesos
>>>>>>
>>>>>> 4) Set the quorum to 2with
>>>>>> nano /etc/mesos-master/quorum  and i have written 2
>>>>>>
>>>>>> 5)then in /etc/mesos-master/ i created hostname and ip files, within
>>>>>> which i have written the public IPs of the masters such that i can use
>>>>>> sandbox on web ui.
>>>>>> the same in /etc/marathon/conf/ just creating hostname file.
>>>>>>
>>>>>> let me say that the openstack cluster on which i'm now working on
>>>>>> isnot on the public internet but under a private network of the 
>>>>>> university
>>>>>> lab.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> 2016-06-10 22:21 GMT+02:00 Joseph Wu <jos...@mesosphere.io>:
>>>>>>
>>>>>>> Looks like the master can't bind to the IP you have specified (or,
>>>>>>> if you did not specify, the master resolved it from the computer's
>>>>>>> hostname).
>>>>>>>
>>>>>>> Either specify the --ip master flag or investigate the problem with
>>>>>>> your network.
>>>>>>>
>>>>>>> On Fri, Jun 10, 2016 at 11:03 AM, Stefano Bianchi <
>>>>>>> jazzist...@gmail.com> wrote:
>>>>>>>
>>>>>>>> this is what i get with your command:
>>>>>>>>
>>>>>>>> giu 10 18:02:23 master.novalocal systemd[1]: *Unit
>>>>>>>> mesos-master.service entered failed state.*
>>>>>>>>
>>>>>>>> giu 10 18:02:23 master.novalocal system

Re: Mesos 0.28.2 does not start

2016-06-11 Thread Stefano Bianchi
i checked now, and i have correctly set 10.250.0.124, 10.250.0.125,
10.250.0.126
according to the masters floating IPs

2016-06-11 19:18 GMT+02:00 haosdent <haosd...@gmail.com>:

> Oh, according to the log. It looks like your set /etc/mesos-master/ip
> to 10.250.0.12?
>
> On Sun, Jun 12, 2016 at 1:15 AM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> i dont' have 10.250.0.12 <http://10.250.0.12:5050/> floating IP, i have
>> 10.250.0.124 <http://10.250.0.12:5050/> 10.250.0.125
>> <http://10.250.0.12:5050/> and 10.250.0.126 <http://10.250.0.12:5050/>
>>
>> 2016-06-11 19:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>
>>> sorry i have made a mistakee in my previous message,
>>> On each master: nano /etc/zookeeper/conf/zoo.cfg
>>> the last three lines are:
>>> server.1=192.168.100.3:2888:3888
>>> server.2=192.168.100.4:2888:3888
>>> server.3=192.168.10.3:2888:3888
>>>
>>> these are the correct IPs i have set in this file.
>>>
>>> 2016-06-11 15:36 GMT+02:00 haosdent <haosd...@gmail.com>:
>>>
>>>> If 10.250.0.12:5050 used by any other processes?
>>>>
>>>> On Sat, Jun 11, 2016 at 9:18 PM, Stefano Bianchi <jazzist...@gmail.com>
>>>> wrote:
>>>>
>>>>> I have set:
>>>>>
>>>>> 1)
>>>>> On master1:
>>>>> sudo -u zookeeper zookeeper-server-initialize --myid=1
>>>>>
>>>>> On Master2:
>>>>> sudo -u zookeeper zookeeper-server-initialize --myid=2
>>>>>
>>>>> On Master3:
>>>>> sudo -u zookeeper zookeeper-server-initialize --myid=3
>>>>>
>>>>> i checked /var/lib/zookeeper/myid and i get correctly 1, 2 and 3
>>>>>
>>>>>
>>>>> 2) On each master: nano /etc/zookeeper/conf/zoo.cfg
>>>>> the last three lines are:
>>>>> server.1=192.168.100.54:2888:3888
>>>>> server.2=192.168.100.55:2888:3888
>>>>> server.3=192.168.10.16:2888:3888
>>>>>
>>>>> where 2888 and 3888 are both open on openstack security group.
>>>>>
>>>>> 3)nano /etc/mesos/zk
>>>>>
>>>>> zk://192.168.100.3:2181,192.168.100.4:2181,192.168.10.3:2181/mesos
>>>>>
>>>>> 4) Set the quorum to 2with
>>>>> nano /etc/mesos-master/quorum  and i have written 2
>>>>>
>>>>> 5)then in /etc/mesos-master/ i created hostname and ip files, within
>>>>> which i have written the public IPs of the masters such that i can use
>>>>> sandbox on web ui.
>>>>> the same in /etc/marathon/conf/ just creating hostname file.
>>>>>
>>>>> let me say that the openstack cluster on which i'm now working on
>>>>> isnot on the public internet but under a private network of the university
>>>>> lab.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> 2016-06-10 22:21 GMT+02:00 Joseph Wu <jos...@mesosphere.io>:
>>>>>
>>>>>> Looks like the master can't bind to the IP you have specified (or, if
>>>>>> you did not specify, the master resolved it from the computer's 
>>>>>> hostname).
>>>>>>
>>>>>> Either specify the --ip master flag or investigate the problem with
>>>>>> your network.
>>>>>>
>>>>>> On Fri, Jun 10, 2016 at 11:03 AM, Stefano Bianchi <
>>>>>> jazzist...@gmail.com> wrote:
>>>>>>
>>>>>>> this is what i get with your command:
>>>>>>>
>>>>>>> giu 10 18:02:23 master.novalocal systemd[1]: *Unit
>>>>>>> mesos-master.service entered failed state.*
>>>>>>>
>>>>>>> giu 10 18:02:23 master.novalocal systemd[1]: *mesos-master.service
>>>>>>> failed.*
>>>>>>>
>>>>>>> [root@master ~]# journalctl -u mesos-master
>>>>>>>
>>>>>>> -- Logs begin at gio 2016-06-09 23:24:02 UTC, end at ven 2016-06-10
>>>>>>> 18:02:23 UTC. --
>>>>>>>
>>>>>>> giu 09 23:24:35 master.novalocal systemd[1]: Started Mesos Master.
>>>>>>>
>>>>>>> giu 09 23:24:35 master.novalocal systemd[1

Re: Mesos 0.28.2 does not start

2016-06-11 Thread Stefano Bianchi
i dont' have 10.250.0.12 <http://10.250.0.12:5050/> floating IP, i have
10.250.0.124 <http://10.250.0.12:5050/> 10.250.0.125
<http://10.250.0.12:5050/> and 10.250.0.126 <http://10.250.0.12:5050/>

2016-06-11 19:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> sorry i have made a mistakee in my previous message,
> On each master: nano /etc/zookeeper/conf/zoo.cfg
> the last three lines are:
> server.1=192.168.100.3:2888:3888
> server.2=192.168.100.4:2888:3888
> server.3=192.168.10.3:2888:3888
>
> these are the correct IPs i have set in this file.
>
> 2016-06-11 15:36 GMT+02:00 haosdent <haosd...@gmail.com>:
>
>> If 10.250.0.12:5050 used by any other processes?
>>
>> On Sat, Jun 11, 2016 at 9:18 PM, Stefano Bianchi <jazzist...@gmail.com>
>> wrote:
>>
>>> I have set:
>>>
>>> 1)
>>> On master1:
>>> sudo -u zookeeper zookeeper-server-initialize --myid=1
>>>
>>> On Master2:
>>> sudo -u zookeeper zookeeper-server-initialize --myid=2
>>>
>>> On Master3:
>>> sudo -u zookeeper zookeeper-server-initialize --myid=3
>>>
>>> i checked /var/lib/zookeeper/myid and i get correctly 1, 2 and 3
>>>
>>>
>>> 2) On each master: nano /etc/zookeeper/conf/zoo.cfg
>>> the last three lines are:
>>> server.1=192.168.100.54:2888:3888
>>> server.2=192.168.100.55:2888:3888
>>> server.3=192.168.10.16:2888:3888
>>>
>>> where 2888 and 3888 are both open on openstack security group.
>>>
>>> 3)nano /etc/mesos/zk
>>>
>>> zk://192.168.100.3:2181,192.168.100.4:2181,192.168.10.3:2181/mesos
>>>
>>> 4) Set the quorum to 2with
>>> nano /etc/mesos-master/quorum  and i have written 2
>>>
>>> 5)then in /etc/mesos-master/ i created hostname and ip files, within
>>> which i have written the public IPs of the masters such that i can use
>>> sandbox on web ui.
>>> the same in /etc/marathon/conf/ just creating hostname file.
>>>
>>> let me say that the openstack cluster on which i'm now working on isnot
>>> on the public internet but under a private network of the university lab.
>>>
>>>
>>>
>>>
>>>
>>> 2016-06-10 22:21 GMT+02:00 Joseph Wu <jos...@mesosphere.io>:
>>>
>>>> Looks like the master can't bind to the IP you have specified (or, if
>>>> you did not specify, the master resolved it from the computer's hostname).
>>>>
>>>> Either specify the --ip master flag or investigate the problem with
>>>> your network.
>>>>
>>>> On Fri, Jun 10, 2016 at 11:03 AM, Stefano Bianchi <jazzist...@gmail.com
>>>> > wrote:
>>>>
>>>>> this is what i get with your command:
>>>>>
>>>>> giu 10 18:02:23 master.novalocal systemd[1]: *Unit
>>>>> mesos-master.service entered failed state.*
>>>>>
>>>>> giu 10 18:02:23 master.novalocal systemd[1]: *mesos-master.service
>>>>> failed.*
>>>>>
>>>>> [root@master ~]# journalctl -u mesos-master
>>>>>
>>>>> -- Logs begin at gio 2016-06-09 23:24:02 UTC, end at ven 2016-06-10
>>>>> 18:02:23 UTC. --
>>>>>
>>>>> giu 09 23:24:35 master.novalocal systemd[1]: Started Mesos Master.
>>>>>
>>>>> giu 09 23:24:35 master.novalocal systemd[1]: Starting Mesos Master...
>>>>>
>>>>> giu 09 23:24:51 master.novalocal mesos-master[808]: *WARNING: Logging
>>>>> before InitGoogleLogging() is written to STDERR*
>>>>>
>>>>> giu 09 23:24:51 master.novalocal mesos-master[808]: *F0609
>>>>> 23:24:51.739418   718 process.cpp:892] Failed to initialize: Failed to 
>>>>> bind
>>>>> on 10.250.0.124*
>>>>>
>>>>> giu 09 23:24:52 master.novalocal mesos-master[808]:  Check
>>>>> failure stack trace: 
>>>>>
>>>>> giu 09 23:24:52 master.novalocal systemd[1]: *mesos-master.service:
>>>>> main process exited, code=killed, status=6/ABRT*
>>>>>
>>>>> giu 09 23:24:52 master.novalocal systemd[1]: *Unit
>>>>> mesos-master.service entered failed state.*
>>>>>
>>>>> giu 09 23:24:52 master.novalocal systemd[1]: *mesos-master.service
>>>>> failed.*
>>>>>
>>>>> giu 09 23:25:14 master.novalocal system

Re: Mesos 0.28.2 does not start

2016-06-11 Thread Stefano Bianchi
sorry i have made a mistakee in my previous message,
On each master: nano /etc/zookeeper/conf/zoo.cfg
the last three lines are:
server.1=192.168.100.3:2888:3888
server.2=192.168.100.4:2888:3888
server.3=192.168.10.3:2888:3888

these are the correct IPs i have set in this file.

2016-06-11 15:36 GMT+02:00 haosdent <haosd...@gmail.com>:

> If 10.250.0.12:5050 used by any other processes?
>
> On Sat, Jun 11, 2016 at 9:18 PM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> I have set:
>>
>> 1)
>> On master1:
>> sudo -u zookeeper zookeeper-server-initialize --myid=1
>>
>> On Master2:
>> sudo -u zookeeper zookeeper-server-initialize --myid=2
>>
>> On Master3:
>> sudo -u zookeeper zookeeper-server-initialize --myid=3
>>
>> i checked /var/lib/zookeeper/myid and i get correctly 1, 2 and 3
>>
>>
>> 2) On each master: nano /etc/zookeeper/conf/zoo.cfg
>> the last three lines are:
>> server.1=192.168.100.54:2888:3888
>> server.2=192.168.100.55:2888:3888
>> server.3=192.168.10.16:2888:3888
>>
>> where 2888 and 3888 are both open on openstack security group.
>>
>> 3)nano /etc/mesos/zk
>>
>> zk://192.168.100.3:2181,192.168.100.4:2181,192.168.10.3:2181/mesos
>>
>> 4) Set the quorum to 2with
>> nano /etc/mesos-master/quorum  and i have written 2
>>
>> 5)then in /etc/mesos-master/ i created hostname and ip files, within
>> which i have written the public IPs of the masters such that i can use
>> sandbox on web ui.
>> the same in /etc/marathon/conf/ just creating hostname file.
>>
>> let me say that the openstack cluster on which i'm now working on isnot
>> on the public internet but under a private network of the university lab.
>>
>>
>>
>>
>>
>> 2016-06-10 22:21 GMT+02:00 Joseph Wu <jos...@mesosphere.io>:
>>
>>> Looks like the master can't bind to the IP you have specified (or, if
>>> you did not specify, the master resolved it from the computer's hostname).
>>>
>>> Either specify the --ip master flag or investigate the problem with your
>>> network.
>>>
>>> On Fri, Jun 10, 2016 at 11:03 AM, Stefano Bianchi <jazzist...@gmail.com>
>>> wrote:
>>>
>>>> this is what i get with your command:
>>>>
>>>> giu 10 18:02:23 master.novalocal systemd[1]: *Unit
>>>> mesos-master.service entered failed state.*
>>>>
>>>> giu 10 18:02:23 master.novalocal systemd[1]: *mesos-master.service
>>>> failed.*
>>>>
>>>> [root@master ~]# journalctl -u mesos-master
>>>>
>>>> -- Logs begin at gio 2016-06-09 23:24:02 UTC, end at ven 2016-06-10
>>>> 18:02:23 UTC. --
>>>>
>>>> giu 09 23:24:35 master.novalocal systemd[1]: Started Mesos Master.
>>>>
>>>> giu 09 23:24:35 master.novalocal systemd[1]: Starting Mesos Master...
>>>>
>>>> giu 09 23:24:51 master.novalocal mesos-master[808]: *WARNING: Logging
>>>> before InitGoogleLogging() is written to STDERR*
>>>>
>>>> giu 09 23:24:51 master.novalocal mesos-master[808]: *F0609
>>>> 23:24:51.739418   718 process.cpp:892] Failed to initialize: Failed to bind
>>>> on 10.250.0.124*
>>>>
>>>> giu 09 23:24:52 master.novalocal mesos-master[808]:  Check failure
>>>> stack trace: 
>>>>
>>>> giu 09 23:24:52 master.novalocal systemd[1]: *mesos-master.service:
>>>> main process exited, code=killed, status=6/ABRT*
>>>>
>>>> giu 09 23:24:52 master.novalocal systemd[1]: *Unit
>>>> mesos-master.service entered failed state.*
>>>>
>>>> giu 09 23:24:52 master.novalocal systemd[1]: *mesos-master.service
>>>> failed.*
>>>>
>>>> giu 09 23:25:14 master.novalocal systemd[1]: mesos-master.service
>>>> holdoff time over, scheduling restart.
>>>>
>>>> giu 09 23:25:14 master.novalocal systemd[1]: Started Mesos Master.
>>>>
>>>> giu 09 23:25:14 master.novalocal systemd[1]: Starting Mesos Master...
>>>>
>>>> giu 09 23:25:15 master.novalocal mesos-master[1091]: *WARNING: Logging
>>>> before InitGoogleLogging() is written to STDERR*
>>>>
>>>> giu 09 23:25:15 master.novalocal mesos-master[1091]: *F0609
>>>> 23:25:15.071262  1075 process.cpp:892] Failed to initialize: Failed to bind
>>>> on 10.250.0.12*
>>>>
>>>> giu 09 23:25:15 master.novalocal mesos-ma

Re: Mesos 0.28.2 does not start

2016-06-11 Thread Stefano Bianchi
I have set:

1)
On master1:
sudo -u zookeeper zookeeper-server-initialize --myid=1

On Master2:
sudo -u zookeeper zookeeper-server-initialize --myid=2

On Master3:
sudo -u zookeeper zookeeper-server-initialize --myid=3

i checked /var/lib/zookeeper/myid and i get correctly 1, 2 and 3


2) On each master: nano /etc/zookeeper/conf/zoo.cfg
the last three lines are:
server.1=192.168.100.54:2888:3888
server.2=192.168.100.55:2888:3888
server.3=192.168.10.16:2888:3888

where 2888 and 3888 are both open on openstack security group.

3)nano /etc/mesos/zk

zk://192.168.100.3:2181,192.168.100.4:2181,192.168.10.3:2181/mesos

4) Set the quorum to 2with
nano /etc/mesos-master/quorum  and i have written 2

5)then in /etc/mesos-master/ i created hostname and ip files, within which
i have written the public IPs of the masters such that i can use sandbox on
web ui.
the same in /etc/marathon/conf/ just creating hostname file.

let me say that the openstack cluster on which i'm now working on isnot on
the public internet but under a private network of the university lab.





2016-06-10 22:21 GMT+02:00 Joseph Wu <jos...@mesosphere.io>:

> Looks like the master can't bind to the IP you have specified (or, if you
> did not specify, the master resolved it from the computer's hostname).
>
> Either specify the --ip master flag or investigate the problem with your
> network.
>
> On Fri, Jun 10, 2016 at 11:03 AM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> this is what i get with your command:
>>
>> giu 10 18:02:23 master.novalocal systemd[1]: *Unit mesos-master.service
>> entered failed state.*
>>
>> giu 10 18:02:23 master.novalocal systemd[1]: *mesos-master.service
>> failed.*
>>
>> [root@master ~]# journalctl -u mesos-master
>>
>> -- Logs begin at gio 2016-06-09 23:24:02 UTC, end at ven 2016-06-10
>> 18:02:23 UTC. --
>>
>> giu 09 23:24:35 master.novalocal systemd[1]: Started Mesos Master.
>>
>> giu 09 23:24:35 master.novalocal systemd[1]: Starting Mesos Master...
>>
>> giu 09 23:24:51 master.novalocal mesos-master[808]: *WARNING: Logging
>> before InitGoogleLogging() is written to STDERR*
>>
>> giu 09 23:24:51 master.novalocal mesos-master[808]: *F0609
>> 23:24:51.739418   718 process.cpp:892] Failed to initialize: Failed to bind
>> on 10.250.0.124*
>>
>> giu 09 23:24:52 master.novalocal mesos-master[808]:  Check failure
>> stack trace: 
>>
>> giu 09 23:24:52 master.novalocal systemd[1]: *mesos-master.service: main
>> process exited, code=killed, status=6/ABRT*
>>
>> giu 09 23:24:52 master.novalocal systemd[1]: *Unit mesos-master.service
>> entered failed state.*
>>
>> giu 09 23:24:52 master.novalocal systemd[1]: *mesos-master.service
>> failed.*
>>
>> giu 09 23:25:14 master.novalocal systemd[1]: mesos-master.service holdoff
>> time over, scheduling restart.
>>
>> giu 09 23:25:14 master.novalocal systemd[1]: Started Mesos Master.
>>
>> giu 09 23:25:14 master.novalocal systemd[1]: Starting Mesos Master...
>>
>> giu 09 23:25:15 master.novalocal mesos-master[1091]: *WARNING: Logging
>> before InitGoogleLogging() is written to STDERR*
>>
>> giu 09 23:25:15 master.novalocal mesos-master[1091]: *F0609
>> 23:25:15.071262  1075 process.cpp:892] Failed to initialize: Failed to bind
>> on 10.250.0.12*
>>
>> giu 09 23:25:15 master.novalocal mesos-master[1091]:  Check failure
>> stack trace: 
>>
>> giu 09 23:25:15 master.novalocal systemd[1]: *mesos-master.service: main
>> process exited, code=killed, status=6/ABRT*
>>
>> giu 09 23:25:15 master.novalocal systemd[1]: *Unit mesos-master.service
>> entered failed state.*
>>
>> giu 09 23:25:15 master.novalocal systemd[1]: *mesos-master.service
>> failed.*
>>
>> giu 09 23:25:35 master.novalocal systemd[1]: mesos-master.service holdoff
>> time over, scheduling restart.
>>
>> giu 09 23:25:35 master.novalocal systemd[1]: Started Mesos Master.
>>
>> giu 09 23:25:35 master.novalocal systemd[1]: Starting Mesos Master...
>>
>> giu 09 23:25:35 master.novalocal mesos-master[1156]: *WARNING: Logging
>> before InitGoogleLogging() is written to STDERR*
>>
>> giu 09 23:25:35 master.novalocal mesos-master[1156]: *F0609
>> 23:25:35.288352  1141 process.cpp:892] Failed to initialize: Failed to bind
>> on 10.250.0.12*
>>
>> giu 09 23:25:35 master.novalocal mesos-master[1156]:  Check failure
>> stack trace: 
>>
>> giu 09 23:25:35 master.novalocal systemd[1]: *mesos-master.service: main
>> process exited, code=killed, status=6/ABRT*
>>
>> giu 09 23:25:

Re: Mesos 0.28.2 does not start

2016-06-10 Thread Stefano Bianchi
:51 GMT+02:00 Joseph Wu <jos...@mesosphere.io>:

> The log directory is based on your configuration.  See the master config
> section here: http://mesos.apache.org/documentation/latest/configuration/
>
> If you've set the --log_dir flag, you'll find your logs there.  Otherwise,
> the logs will be in stderr.
> If you launched the master via a systemd service, use: journalctl -u 
> mesos-master
>
>
> On Fri, Jun 10, 2016 at 9:45 AM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> Actually i don't have the access to the Mesos UI so i need to find the
>> log within CentOS VM.
>> Please can you tell me where can i find the master log file ?
>>
>> 2016-06-10 17:50 GMT+02:00 Jie Yu <yujie@gmail.com>:
>>
>>> Can u create a jira ticket and paste the master log? Thanks for
>>> reporting!
>>>
>>> Sent from my iPhone
>>>
>>> On Jun 10, 2016, at 8:44 AM, Stefano Bianchi <jazzist...@gmail.com>
>>> wrote:
>>>
>>> Hi all
>>> i'm re installing my platform on another openstack tenant.
>>> I downloaded all the needed softwares, zookeeper-server, mesos 0.28.2
>>> marathon 1.1.1 and chronos 2.4.0.
>>> i have configured all correctly the i started zookeeper-server and it
>>> works fine.
>>> when i type: service mesos-master start
>>> it seems to start but if i check the status with: service mesos-master
>>> status
>>> i obtain the following:
>>>
>>> [root@master ~]# service mesos-master status
>>>
>>> Redirecting to /bin/systemctl status  mesos-master.service
>>>
>>> ● mesos-master.service - Mesos Master
>>>
>>>Loaded: loaded (/usr/lib/systemd/system/mesos-master.service;
>>> enabled; vendor preset: disabled)
>>>
>>>Active: activating (auto-restart) (Result: signal) since ven
>>> 2016-06-10 15:39:36 UTC; 3s ago
>>>
>>>   Process: 12163 ExecStart=/usr/bin/mesos-init-wrapper master *(code=killed,
>>> signal=ABRT)*
>>>
>>>  Main PID: 12163 (code=killed, signal=ABRT)
>>>
>>>
>>> Any one knows why i have this issue?
>>>
>>> Thanks in advance.
>>>
>>>
>>
>


Re: Mesos 0.28.2 does not start

2016-06-10 Thread Stefano Bianchi
Actually i don't have the access to the Mesos UI so i need to find the log
within CentOS VM.
Please can you tell me where can i find the master log file ?

2016-06-10 17:50 GMT+02:00 Jie Yu <yujie@gmail.com>:

> Can u create a jira ticket and paste the master log? Thanks for reporting!
>
> Sent from my iPhone
>
> On Jun 10, 2016, at 8:44 AM, Stefano Bianchi <jazzist...@gmail.com> wrote:
>
> Hi all
> i'm re installing my platform on another openstack tenant.
> I downloaded all the needed softwares, zookeeper-server, mesos 0.28.2
> marathon 1.1.1 and chronos 2.4.0.
> i have configured all correctly the i started zookeeper-server and it
> works fine.
> when i type: service mesos-master start
> it seems to start but if i check the status with: service mesos-master
> status
> i obtain the following:
>
> [root@master ~]# service mesos-master status
>
> Redirecting to /bin/systemctl status  mesos-master.service
>
> ● mesos-master.service - Mesos Master
>
>Loaded: loaded (/usr/lib/systemd/system/mesos-master.service; enabled;
> vendor preset: disabled)
>
>Active: activating (auto-restart) (Result: signal) since ven 2016-06-10
> 15:39:36 UTC; 3s ago
>
>   Process: 12163 ExecStart=/usr/bin/mesos-init-wrapper master *(code=killed,
> signal=ABRT)*
>
>  Main PID: 12163 (code=killed, signal=ABRT)
>
>
> Any one knows why i have this issue?
>
> Thanks in advance.
>
>


Mesos 0.28.2 does not start

2016-06-10 Thread Stefano Bianchi
Hi all
i'm re installing my platform on another openstack tenant.
I downloaded all the needed softwares, zookeeper-server, mesos 0.28.2
marathon 1.1.1 and chronos 2.4.0.
i have configured all correctly the i started zookeeper-server and it works
fine.
when i type: service mesos-master start
it seems to start but if i check the status with: service mesos-master
status
i obtain the following:

[root@master ~]# service mesos-master status

Redirecting to /bin/systemctl status  mesos-master.service

● mesos-master.service - Mesos Master

   Loaded: loaded (/usr/lib/systemd/system/mesos-master.service; enabled;
vendor preset: disabled)

   Active: activating (auto-restart) (Result: signal) since ven 2016-06-10
15:39:36 UTC; 3s ago

  Process: 12163 ExecStart=/usr/bin/mesos-init-wrapper master *(code=killed,
signal=ABRT)*

 Main PID: 12163 (code=killed, signal=ABRT)


Any one knows why i have this issue?

Thanks in advance.


Re: Mesos and Openstack

2016-05-25 Thread Stefano Bianchi
Yes, you should also edit the hosts file where you associate the hostnames
of each VM to the correspondent private IP address.
Il 25/mag/2016 18:46, "haosdent"  ha scritto:

> >If I use the slaves internal IP address like 192.168.1.40 it can make
> the connection with Mesos master, but then dies and keeps reconnecting.
> Does the network from Master to Slave and from Slave to Master work fine
> if you use internal IP? And may you show the log related to "dies and
> keeps reconnecting"?
>
> On Wed, May 25, 2016 at 11:16 PM, Omar Sobh  wrote:
>
>> Hello all,
>>
>> I have a number of mesos slave inside and openstack installation that i'm
>> trying to connect to a master on a different subnet. If I use the slaves
>> internal IP address like 192.168.1.40 it can make the connection with Mesos
>> master, but then dies and keeps reconnecting. If I map it to the public
>> interface it dies from spawning too fast. The public IP address isn't
>> visible inside the host but i've mapped it via openstack floating IP
>> addresses so I know the VM is getting it. Are there any ideas on how I can
>> connect these VM's to the Mesos master, and why do they die out with
>> internal IP's and a public interface mapping?
>>
>>
>> best,
>>
>> O
>>
>>
>
>
> --
> Best Regards,
> Haosdent Huang
>


Re: IP address as resource

2016-05-07 Thread Stefano Bianchi
Did you look at Project Calico?

2016-05-07 3:45 GMT+02:00 Bharath Ravi Kumar :

> Hi Zameer,
>
> Thanks for responding. I had reached out to user@ at the same time, but
> haven't heard back. As for the specific feature in Aurora, since we're
> still testing our internal system against various frameworks, I'd be
> willing to try a patch to better evaluate the capability in question.
> Looking forward to a response on user@aurora.
>
> On Fri, May 6, 2016 at 10:17 PM, Zameer Manji  wrote:
>
>> Bharath,
>>
>> Aurora is currently adding support for arbitrary resources with this
>> exact usecase in mind. The code isn't complete yet and it hasn't been tried
>> out in production. I suggest reaching out to the user@
>>  for Aurora to get the latest
>> update.
>>
>> On Fri, May 6, 2016 at 6:36 AM, Bharath Ravi Kumar 
>> wrote:
>>
>>> Hi,
>>>
>>> I'm aware of mesos' IP-per-container capability and the authors' reasons
>>> for not modeling an IP address as a resource on a host. However, for
>>> operational simplicity, I prefer an implementation that does not interact
>>> with multiple other services (e.g. an IPAM). I'm hence considering the
>>> following approach:
>>>
>>> a) Model the IP addresses available on a host as resources.
>>> b) Using the IP address (from the set) accepted by a framework, launch a
>>> task using the docker containerizer, with the IP address selected by the
>>> framework.
>>> c) For tasks that are not resource intensive, fall back on port range
>>> reservation and docker host mode networking.
>>>
>>> It appears that Marathon doesn't support arbitrary resources, but Apache
>>> Aurora might(?) . I'd like to know if anyone else has attempted this
>>> approach with either framework, any potential downsides to this approach,
>>> and any alternatives that are similar to this.
>>>
>>> Thanks,
>>> Bharath
>>>
>>> --
>>> Zameer Manji
>>>
>>>
>


Re: How to install marathon-lb

2016-05-03 Thread Stefano Bianchi
Hi kamil

I tried to replace that hostname with the one related to one random slave.
And it does not work.
I tried also to change the private IP od the marathon instance with the
public, but i still have problem.
I'm also running Mesos-DNS this should be a problem?


2016-05-02 21:52 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:

> Did you try to run docker command from shell? Does it work for you?
> Do you have also slave running on 131.154.96.27?
> In my case entry was "constraints": [["hostname", "CLUSTER",
> "master-1"]], because on host master-1 I have both master and slave running.
> If you don't have slave running on 131.154.96.27, update this entry to
> point to one of your slave hosts.
>
>
> 2016-05-02 19:03 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> Here it is:
>>
>> {
>>
>>   "id": "marathon-lb",
>>
>>   "volumes": [],
>>
>>   "cpus": 1,
>>
>>   "mem": 512,
>>
>>   "instances": 1,
>>
>>   "container": {
>>
>> "type": "DOCKER",
>>
>> "docker": {
>>
>> "image": "mesosphere/marathon-lb",
>>
>> "network": "HOST",
>>
>> "parameters": [
>>
>> { "key": "env", "value": "PORTS=9090" }
>>
>> ],
>>
>> "portMappings": [
>>
>>   {
>>
>>"containerPort": 80,
>>
>> "hostPort": 80,
>>
>> "servicePort": 10004,
>>
>> "protocol": "tcp"
>>
>>   },
>>
>>   {
>>
>>"containerPort": 9090,
>>
>> "hostPort": 9090,
>>
>> "servicePort": 10005,
>>
>> "protocol": "tcp"
>>
>>   }
>>
>> ]},
>>
>> "privileged": false
>>
>>   },
>>
>>   "args": [
>>
>>   "sse",
>>
>>   "--marathon", "http://192.168.100.54:8080;,
>>
>>   "--group", "external"
>>
>>   ],
>>
>>   "forcePullImage": true,
>>
>>   "constraints": [["hostname", "CLUSTER", "131.154.96.27"]]
>>
>> }
>>
>>
>> where:
>> 192.168.100.54 is the private IP there marathon is running.
>>
>> 131.154.96.27: is the hostname i set in /etc/mesos-master/hostname and
>> /etc/mesos-master/ip files.
>>
>>
>>
>> 2016-05-02 17:20 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:
>>
>>> Please paste your modified marathon-lb.json file.
>>> Can you see any error messages in the marathon and mesos logs ?
>>> We are mapping ports 80, 9090,10004,10005, those need to be open.
>>>
>>> Docker command is as follows:
>>>
>>> docker run --privileged -e PORTS=9090 --net=host -p 80:80 -p 9090:9090
>>> mesosphere/marathon-lb sse --marathon http://192.168.33.20:8080 --group
>>> "external"
>>>
>>> 2016-05-02 17:07 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>>> Can you please tell me which is the correspondent marathon-lb.json
>>>> docker command?
>>>>
>>>> 2016-05-02 16:55 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>
>>>>> All those ports must be open? Because i am on openstack environment
>>>>> and i need to know if there is something to open
>>>>>
>>>>> 2016-05-02 15:52 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>
>>>>>> i changed all but i see waiting app.
>>>>>>
>>>>>> 2016-05-02 15:26 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:
>>>>>>
>>>>>>> I am using private docker registry (
>>>>>>> https://docs.docker.com/registry/).
>>>>>>> In my case I can pull image from local repository installed on node
>>>>>>> master-1 (master-1:5000/marathon-lb):
>>>>>>>  "image": "master-1:5000/marathon-lb"
>>>>>>>
>>>>>>> If you don't have private registry, you have to pull image from the
>>>

Re: How to install marathon-lb

2016-05-02 Thread Stefano Bianchi
Here it is:

{

  "id": "marathon-lb",

  "volumes": [],

  "cpus": 1,

  "mem": 512,

  "instances": 1,

  "container": {

"type": "DOCKER",

"docker": {

"image": "mesosphere/marathon-lb",

"network": "HOST",

"parameters": [

{ "key": "env", "value": "PORTS=9090" }

],

"portMappings": [

  {

   "containerPort": 80,

"hostPort": 80,

"servicePort": 10004,

"protocol": "tcp"

  },

  {

   "containerPort": 9090,

"hostPort": 9090,

"servicePort": 10005,

"protocol": "tcp"

  }

]},

"privileged": false

  },

  "args": [

  "sse",

  "--marathon", "http://192.168.100.54:8080;,

  "--group", "external"

  ],

  "forcePullImage": true,

  "constraints": [["hostname", "CLUSTER", "131.154.96.27"]]

}


where:
192.168.100.54 is the private IP there marathon is running.

131.154.96.27: is the hostname i set in /etc/mesos-master/hostname and
/etc/mesos-master/ip files.



2016-05-02 17:20 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:

> Please paste your modified marathon-lb.json file.
> Can you see any error messages in the marathon and mesos logs ?
> We are mapping ports 80, 9090,10004,10005, those need to be open.
>
> Docker command is as follows:
>
> docker run --privileged -e PORTS=9090 --net=host -p 80:80 -p 9090:9090
> mesosphere/marathon-lb sse --marathon http://192.168.33.20:8080 --group
> "external"
>
> 2016-05-02 17:07 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> Can you please tell me which is the correspondent marathon-lb.json docker
>> command?
>>
>> 2016-05-02 16:55 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>
>>> All those ports must be open? Because i am on openstack environment and
>>> i need to know if there is something to open
>>>
>>> 2016-05-02 15:52 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>>> i changed all but i see waiting app.
>>>>
>>>> 2016-05-02 15:26 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:
>>>>
>>>>> I am using private docker registry (https://docs.docker.com/registry/
>>>>> ).
>>>>> In my case I can pull image from local repository installed on node
>>>>> master-1 (master-1:5000/marathon-lb):
>>>>>  "image": "master-1:5000/marathon-lb"
>>>>>
>>>>> If you don't have private registry, you have to pull image from the
>>>>> docker hub (mesosphere/marathon-lb):
>>>>>  "image": "mesosphere/marathon-lb"
>>>>>
>>>>> Basically, for many reasons I want all my images to be hosted locally.
>>>>>
>>>>>
>>>>>
>>>>> 2016-05-02 15:10 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>
>>>>>> Thanks your your answer.
>>>>>> I understood what you are telling me, just a thing, what you mean
>>>>>> with docker registry?
>>>>>>
>>>>>> 2016-05-02 13:31 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Fastest way is to run marathon-lb docker image.
>>>>>>> You have to update marathon-lb.json code below with yours (or
>>>>>>> public) docker registry, IPs and hostnames.
>>>>>>> When you add application to marathon and you want it to be load
>>>>>>> balanced via marathon-lb,
>>>>>>> you have to add labels section eg.:
>>>>>>>
>>>>>>>  "labels": {
>>>>>>> "HAPROXY_GROUP":"external",
>>>>>>> "HAPROXY_0_VHOST":"service.mesosphere.com"
>>>>>>>   }
>>>>>>>
>>>>>>>
>>>>>>> Reading documentation on github was enough for me, specially
>>>>>>> "issues" tab ;)
>>>>>>> https://github.com/mesosphere/marathon-lb
>>>>>>>
>&

Re: How to install marathon-lb

2016-05-02 Thread Stefano Bianchi
Can you please tell me which is the correspondent marathon-lb.json docker
command?

2016-05-02 16:55 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> All those ports must be open? Because i am on openstack environment and i
> need to know if there is something to open
>
> 2016-05-02 15:52 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> i changed all but i see waiting app.
>>
>> 2016-05-02 15:26 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:
>>
>>> I am using private docker registry (https://docs.docker.com/registry/).
>>> In my case I can pull image from local repository installed on node
>>> master-1 (master-1:5000/marathon-lb):
>>>  "image": "master-1:5000/marathon-lb"
>>>
>>> If you don't have private registry, you have to pull image from the
>>> docker hub (mesosphere/marathon-lb):
>>>  "image": "mesosphere/marathon-lb"
>>>
>>> Basically, for many reasons I want all my images to be hosted locally.
>>>
>>>
>>>
>>> 2016-05-02 15:10 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>>> Thanks your your answer.
>>>> I understood what you are telling me, just a thing, what you mean with
>>>> docker registry?
>>>>
>>>> 2016-05-02 13:31 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:
>>>>
>>>>> Hi,
>>>>>
>>>>> Fastest way is to run marathon-lb docker image.
>>>>> You have to update marathon-lb.json code below with yours (or public)
>>>>> docker registry, IPs and hostnames.
>>>>> When you add application to marathon and you want it to be load
>>>>> balanced via marathon-lb,
>>>>> you have to add labels section eg.:
>>>>>
>>>>>  "labels": {
>>>>> "HAPROXY_GROUP":"external",
>>>>> "HAPROXY_0_VHOST":"service.mesosphere.com"
>>>>>   }
>>>>>
>>>>>
>>>>> Reading documentation on github was enough for me, specially "issues"
>>>>> tab ;)
>>>>> https://github.com/mesosphere/marathon-lb
>>>>>
>>>>>
>>>>> Below code works for me, but I think you can change "network" mode
>>>>> from BRIDGE to HOST and remove line : { "key": "net", "value": "host" }.
>>>>>
>>>>> marathon-lb.json:
>>>>>
>>>>> {
>>>>>   "id": "marathon-lb",
>>>>>   "volumes": [],
>>>>>   "cpus": 0.5,
>>>>>   "mem": 256.0,
>>>>>   "instances": 1,
>>>>>   "container": {
>>>>> "type": "DOCKER",
>>>>> "docker": {
>>>>> "image": "master-1:5000/marathon-lb",
>>>>> "network": "BRIDGE",
>>>>> "parameters": [
>>>>> { "key": "env", "value": "PORTS=9090" },
>>>>> { "key": "net", "value": "host" }
>>>>> ],
>>>>> "portMappings": [
>>>>>   {
>>>>> "containerPort": 80,
>>>>> "hostPort": 80,
>>>>> "servicePort": 10004,
>>>>> "protocol": "tcp"
>>>>>   },
>>>>>   {
>>>>> "containerPort": 9090,
>>>>> "hostPort": 9090,
>>>>> "servicePort": 10005,
>>>>> "protocol": "tcp"
>>>>>   }
>>>>> ]},
>>>>> "privileged": false
>>>>>   },
>>>>>   "args": [
>>>>>   "sse",
>>>>>   "--marathon", "http://192.168.33.20:8080;,
>>>>>   "--group", "external"
>>>>>   ],
>>>>>   "forcePullImage": true,
>>>>>   "constraints": [["hostname", "CLUSTER", "master-1"]]
>>>>> }
>>>>>
>>>>> 2016-05-02 11:08 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>
>>>>>> Hello all
>>>>>>
>>>>>> I'm not using DC/OS, and i would like to know how to install
>>>>>> marathon-lb on my mesos cluster. Is there any tutorial that does not
>>>>>> involve dcos instructions?
>>>>>>
>>>>>> Thanks for replies.
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>


Re: How to install marathon-lb

2016-05-02 Thread Stefano Bianchi
All those ports must be open? Because i am on openstack environment and i
need to know if there is something to open

2016-05-02 15:52 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> i changed all but i see waiting app.
>
> 2016-05-02 15:26 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:
>
>> I am using private docker registry (https://docs.docker.com/registry/).
>> In my case I can pull image from local repository installed on node
>> master-1 (master-1:5000/marathon-lb):
>>  "image": "master-1:5000/marathon-lb"
>>
>> If you don't have private registry, you have to pull image from the
>> docker hub (mesosphere/marathon-lb):
>>  "image": "mesosphere/marathon-lb"
>>
>> Basically, for many reasons I want all my images to be hosted locally.
>>
>>
>>
>> 2016-05-02 15:10 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>
>>> Thanks your your answer.
>>> I understood what you are telling me, just a thing, what you mean with
>>> docker registry?
>>>
>>> 2016-05-02 13:31 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:
>>>
>>>> Hi,
>>>>
>>>> Fastest way is to run marathon-lb docker image.
>>>> You have to update marathon-lb.json code below with yours (or public)
>>>> docker registry, IPs and hostnames.
>>>> When you add application to marathon and you want it to be load
>>>> balanced via marathon-lb,
>>>> you have to add labels section eg.:
>>>>
>>>>  "labels": {
>>>> "HAPROXY_GROUP":"external",
>>>> "HAPROXY_0_VHOST":"service.mesosphere.com"
>>>>   }
>>>>
>>>>
>>>> Reading documentation on github was enough for me, specially "issues"
>>>> tab ;)
>>>> https://github.com/mesosphere/marathon-lb
>>>>
>>>>
>>>> Below code works for me, but I think you can change "network" mode from
>>>> BRIDGE to HOST and remove line : { "key": "net", "value": "host" }.
>>>>
>>>> marathon-lb.json:
>>>>
>>>> {
>>>>   "id": "marathon-lb",
>>>>   "volumes": [],
>>>>   "cpus": 0.5,
>>>>   "mem": 256.0,
>>>>   "instances": 1,
>>>>   "container": {
>>>> "type": "DOCKER",
>>>> "docker": {
>>>> "image": "master-1:5000/marathon-lb",
>>>> "network": "BRIDGE",
>>>> "parameters": [
>>>> { "key": "env", "value": "PORTS=9090" },
>>>> { "key": "net", "value": "host" }
>>>> ],
>>>> "portMappings": [
>>>>   {
>>>> "containerPort": 80,
>>>> "hostPort": 80,
>>>> "servicePort": 10004,
>>>> "protocol": "tcp"
>>>>   },
>>>>   {
>>>> "containerPort": 9090,
>>>> "hostPort": 9090,
>>>> "servicePort": 10005,
>>>> "protocol": "tcp"
>>>>   }
>>>> ]},
>>>> "privileged": false
>>>>   },
>>>>   "args": [
>>>>   "sse",
>>>>   "--marathon", "http://192.168.33.20:8080;,
>>>>   "--group", "external"
>>>>   ],
>>>>   "forcePullImage": true,
>>>>   "constraints": [["hostname", "CLUSTER", "master-1"]]
>>>> }
>>>>
>>>> 2016-05-02 11:08 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>
>>>>> Hello all
>>>>>
>>>>> I'm not using DC/OS, and i would like to know how to install
>>>>> marathon-lb on my mesos cluster. Is there any tutorial that does not
>>>>> involve dcos instructions?
>>>>>
>>>>> Thanks for replies.
>>>>>
>>>>
>>>>
>>>
>>
>


Re: How to install marathon-lb

2016-05-02 Thread Stefano Bianchi
i changed all but i see waiting app.

2016-05-02 15:26 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:

> I am using private docker registry (https://docs.docker.com/registry/).
> In my case I can pull image from local repository installed on node
> master-1 (master-1:5000/marathon-lb):
>  "image": "master-1:5000/marathon-lb"
>
> If you don't have private registry, you have to pull image from the docker
> hub (mesosphere/marathon-lb):
>  "image": "mesosphere/marathon-lb"
>
> Basically, for many reasons I want all my images to be hosted locally.
>
>
>
> 2016-05-02 15:10 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> Thanks your your answer.
>> I understood what you are telling me, just a thing, what you mean with
>> docker registry?
>>
>> 2016-05-02 13:31 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:
>>
>>> Hi,
>>>
>>> Fastest way is to run marathon-lb docker image.
>>> You have to update marathon-lb.json code below with yours (or public)
>>> docker registry, IPs and hostnames.
>>> When you add application to marathon and you want it to be load balanced
>>> via marathon-lb,
>>> you have to add labels section eg.:
>>>
>>>  "labels": {
>>> "HAPROXY_GROUP":"external",
>>> "HAPROXY_0_VHOST":"service.mesosphere.com"
>>>   }
>>>
>>>
>>> Reading documentation on github was enough for me, specially "issues"
>>> tab ;)
>>> https://github.com/mesosphere/marathon-lb
>>>
>>>
>>> Below code works for me, but I think you can change "network" mode from
>>> BRIDGE to HOST and remove line : { "key": "net", "value": "host" }.
>>>
>>> marathon-lb.json:
>>>
>>> {
>>>   "id": "marathon-lb",
>>>   "volumes": [],
>>>   "cpus": 0.5,
>>>   "mem": 256.0,
>>>   "instances": 1,
>>>   "container": {
>>> "type": "DOCKER",
>>> "docker": {
>>> "image": "master-1:5000/marathon-lb",
>>> "network": "BRIDGE",
>>> "parameters": [
>>> { "key": "env", "value": "PORTS=9090" },
>>> { "key": "net", "value": "host" }
>>> ],
>>> "portMappings": [
>>>   {
>>> "containerPort": 80,
>>> "hostPort": 80,
>>> "servicePort": 10004,
>>> "protocol": "tcp"
>>>   },
>>>   {
>>> "containerPort": 9090,
>>> "hostPort": 9090,
>>> "servicePort": 10005,
>>> "protocol": "tcp"
>>>   }
>>> ]},
>>> "privileged": false
>>>   },
>>>   "args": [
>>>   "sse",
>>>   "--marathon", "http://192.168.33.20:8080;,
>>>   "--group", "external"
>>>   ],
>>>   "forcePullImage": true,
>>>   "constraints": [["hostname", "CLUSTER", "master-1"]]
>>> }
>>>
>>> 2016-05-02 11:08 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>>> Hello all
>>>>
>>>> I'm not using DC/OS, and i would like to know how to install
>>>> marathon-lb on my mesos cluster. Is there any tutorial that does not
>>>> involve dcos instructions?
>>>>
>>>> Thanks for replies.
>>>>
>>>
>>>
>>
>


Re: How to install marathon-lb

2016-05-02 Thread Stefano Bianchi
Thanks your your answer.
I understood what you are telling me, just a thing, what you mean with
docker registry?

2016-05-02 13:31 GMT+02:00 Kamil Wokitajtis <wokitaj...@gmail.com>:

> Hi,
>
> Fastest way is to run marathon-lb docker image.
> You have to update marathon-lb.json code below with yours (or public)
> docker registry, IPs and hostnames.
> When you add application to marathon and you want it to be load balanced
> via marathon-lb,
> you have to add labels section eg.:
>
>  "labels": {
> "HAPROXY_GROUP":"external",
> "HAPROXY_0_VHOST":"service.mesosphere.com"
>   }
>
>
> Reading documentation on github was enough for me, specially "issues" tab
> ;)
> https://github.com/mesosphere/marathon-lb
>
>
> Below code works for me, but I think you can change "network" mode from
> BRIDGE to HOST and remove line : { "key": "net", "value": "host" }.
>
> marathon-lb.json:
>
> {
>   "id": "marathon-lb",
>   "volumes": [],
>   "cpus": 0.5,
>   "mem": 256.0,
>   "instances": 1,
>   "container": {
> "type": "DOCKER",
> "docker": {
> "image": "master-1:5000/marathon-lb",
> "network": "BRIDGE",
> "parameters": [
> { "key": "env", "value": "PORTS=9090" },
> { "key": "net", "value": "host" }
> ],
> "portMappings": [
>   {
> "containerPort": 80,
> "hostPort": 80,
> "servicePort": 10004,
> "protocol": "tcp"
>   },
>   {
> "containerPort": 9090,
> "hostPort": 9090,
> "servicePort": 10005,
> "protocol": "tcp"
>   }
> ]},
> "privileged": false
>   },
>   "args": [
>   "sse",
>   "--marathon", "http://192.168.33.20:8080;,
>   "--group", "external"
>   ],
>   "forcePullImage": true,
>   "constraints": [["hostname", "CLUSTER", "master-1"]]
> }
>
> 2016-05-02 11:08 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> Hello all
>>
>> I'm not using DC/OS, and i would like to know how to install marathon-lb
>> on my mesos cluster. Is there any tutorial that does not involve dcos
>> instructions?
>>
>> Thanks for replies.
>>
>
>


How to install marathon-lb

2016-05-02 Thread Stefano Bianchi
Hello all

I'm not using DC/OS, and i would like to know how to install marathon-lb on
my mesos cluster. Is there any tutorial that does not involve dcos
instructions?

Thanks for replies.


Re: setting roles in mesos 0.28

2016-04-29 Thread Stefano Bianchi
this happen when i have 3 masters however.

2016-04-29 19:02 GMT+02:00 haosdent <haosd...@gmail.com>:

> >When a master is elected, after a minute it disconnect re-electing
> another master.
> Last week I use 0.28.1 to set up two masters in same server + a docker
> containered zookeeper. It works fine for me and could not reproduce the
> question you mentioned before. But I would continue to try reproduce it
> again in multiple vms tomorrow. By the way, no idea why your thread mix
> with "settings roles in mesos 0.28"~
>
> On Fri, Apr 29, 2016 at 5:11 PM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> I notice from mates of mine, several issues with mesos 0.28.1. Specially
>> on the master election stability. When a master is elected, after a minute
>> it disconnect re-electing another master.
>> Anyone of you have this issue?
>> This is not my issue, since im running 0.27.2 which is much more stable.
>> Il 25/apr/2016 11:33, "Adam Bordelon" <a...@mesosphere.io> ha scritto:
>>
>>> Seems like you're trying to start Marathon with multiple Mesos roles
>>> "spark;sparkr;ms;qa", but Marathon may be interpreting this as a single
>>> role that happens to include semi-colons. Mesos does not yet support
>>> multiple roles in a single framework. See
>>> https://issues.apache.org/jira/browse/MESOS-1763
>>> Note that the acceptedResourceRoles feature in Marathon currently only
>>> applies to the "*" (unreserved) role vs. the value of --mesos_role
>>>
>>> On Wed, Apr 20, 2016 at 5:19 AM, Rodrick Brown <rodr...@orchard-app.com>
>>> wrote:
>>>
>>>> On Apr 20 2016, at 1:36 am, Jian Qiu <gothicqiuj...@gmail.com> wrote:
>>>>
>>>>> It is not necessary to configure --role on master. Actually it should
>>>>> work if you configure --default_role='sparkr' on agent and start marathon
>>>>> with --mesos_role=sparkr. Which version of mesos are you using? And could
>>>>> you attach the master log?
>>>>>
>>>>
>>>> This is Marathon 0.15 and Mesos 0.28.1
>>>>
>>>> on my masters I have the following attribute set
>>>> $ cat /etc/marathon/conf/mesos_role
>>>> spark;sparkr;ms;qa
>>>>
>>>> On the slave I have the following set in the agent
>>>> $ cat /etc/mesos-slave/default_role
>>>> sparkr
>>>>
>>>> $ cat /etc/mesos-slave/resources
>>>> cpus:10;mem:10
>>>>
>>>> $ cat attributes
>>>> rack:sparkr
>>>>
>>>> I'm trying to launch a simple task from marathon on this agent with
>>>> following configs
>>>>
>>>> $ cat rstudio-mesos-shuffle-server.marathon.json
>>>> {
>>>>"id": "/mesos/rstudio-shuffle-service",
>>>>"cmd": ". /opt/spark-1.6.1/conf/spark-env.sh .
>>>> /opt/spark-1.6.1/sbin/spark-config.sh && .
>>>> /opt/spark-1.6.1/bin/load-spark-env.sh && env &&
>>>> /opt/spark-1.6.1/bin/spark-class
>>>> org.apache.spark.deploy.mesos.MesosExternalShuffleService 1",
>>>>"cpus": 0.5,
>>>>"mem": 1524,
>>>>"disk": 100,
>>>>"user": "mesos",
>>>>"instances": 1,
>>>>"requirePorts": true,
>>>>"acceptedResourceRoles": ["sparkr"],
>>>>"ports":
>>>>[
>>>>  31338
>>>>],
>>>>"constraints": [
>>>>  [
>>>>"hostname","UNIQUE"
>>>>  ],
>>>>  [
>>>>"rack", "LIKE", "sparkr"
>>>>  ]
>>>>],
>>>>"env": {
>>>>"SPARK_HOME": "/opt/spark-1.6.1",
>>>>"SPARK_SCALA_VERSION": "2.11"
>>>>},
>>>>"healthChecks": [
>>>>  {
>>>>"gracePeriodSeconds": 5,
>>>>"intervalSeconds": 10,
>>>>"maxConsecutiveFailures": 3,
>>>>"portIndex": 0,
>>>>"protocol": "TCP",
>>>>"timeoutSeconds": 5
>>>>  }
>>>>  

Re: setting roles in mesos 0.28

2016-04-29 Thread Stefano Bianchi
I notice from mates of mine, several issues with mesos 0.28.1. Specially on
the master election stability. When a master is elected, after a minute it
disconnect re-electing another master.
Anyone of you have this issue?
This is not my issue, since im running 0.27.2 which is much more stable.
Il 25/apr/2016 11:33, "Adam Bordelon"  ha scritto:

> Seems like you're trying to start Marathon with multiple Mesos roles
> "spark;sparkr;ms;qa", but Marathon may be interpreting this as a single
> role that happens to include semi-colons. Mesos does not yet support
> multiple roles in a single framework. See
> https://issues.apache.org/jira/browse/MESOS-1763
> Note that the acceptedResourceRoles feature in Marathon currently only
> applies to the "*" (unreserved) role vs. the value of --mesos_role
>
> On Wed, Apr 20, 2016 at 5:19 AM, Rodrick Brown 
> wrote:
>
>> On Apr 20 2016, at 1:36 am, Jian Qiu  wrote:
>>
>>> It is not necessary to configure --role on master. Actually it should
>>> work if you configure --default_role='sparkr' on agent and start marathon
>>> with --mesos_role=sparkr. Which version of mesos are you using? And could
>>> you attach the master log?
>>>
>>
>> This is Marathon 0.15 and Mesos 0.28.1
>>
>> on my masters I have the following attribute set
>> $ cat /etc/marathon/conf/mesos_role
>> spark;sparkr;ms;qa
>>
>> On the slave I have the following set in the agent
>> $ cat /etc/mesos-slave/default_role
>> sparkr
>>
>> $ cat /etc/mesos-slave/resources
>> cpus:10;mem:10
>>
>> $ cat attributes
>> rack:sparkr
>>
>> I'm trying to launch a simple task from marathon on this agent with
>> following configs
>>
>> $ cat rstudio-mesos-shuffle-server.marathon.json
>> {
>>"id": "/mesos/rstudio-shuffle-service",
>>"cmd": ". /opt/spark-1.6.1/conf/spark-env.sh .
>> /opt/spark-1.6.1/sbin/spark-config.sh && .
>> /opt/spark-1.6.1/bin/load-spark-env.sh && env &&
>> /opt/spark-1.6.1/bin/spark-class
>> org.apache.spark.deploy.mesos.MesosExternalShuffleService 1",
>>"cpus": 0.5,
>>"mem": 1524,
>>"disk": 100,
>>"user": "mesos",
>>"instances": 1,
>>"requirePorts": true,
>>"acceptedResourceRoles": ["sparkr"],
>>"ports":
>>[
>>  31338
>>],
>>"constraints": [
>>  [
>>"hostname","UNIQUE"
>>  ],
>>  [
>>"rack", "LIKE", "sparkr"
>>  ]
>>],
>>"env": {
>>"SPARK_HOME": "/opt/spark-1.6.1",
>>"SPARK_SCALA_VERSION": "2.11"
>>},
>>"healthChecks": [
>>  {
>>"gracePeriodSeconds": 5,
>>"intervalSeconds": 10,
>>"maxConsecutiveFailures": 3,
>>"portIndex": 0,
>>"protocol": "TCP",
>>"timeoutSeconds": 5
>>  }
>>],
>>"maxLaunchDelaySeconds": 3,
>>"backoffFactor": 1.20,
>> "upgradeStrategy": {
>>  "minimumHealthCapacity": 0.5,
>>  "maximumOverCapacity": 0.5
>>}
>> }
>>
>> In the marathon logs this is what I see
>>
>> 20 12:11:42 prod-mesos-m-3.aws.xxx.com marathon[29617]: [2016-04-20
>> 12:11:42,807] INFO Offer ID:
>> [50ceafa4-f3c1-4738-a9eb-c5d3bf0ff742-O13166461]. Considered resources with
>> roles: [sparkr]. Not all basic resources satisfied: cpu not in offer, disk
>> not in offer, mem not in offer
>> (mesosphere.mesos.ResourceMatcher$:marathon-akka.actor.default-dispatcher-9)
>>
>> Thanks.
>>
>>
>>
>>> On Wed, Apr 20, 2016 at 11:11 AM, Rodrick Brown >> > wrote:
>>>
>>> I'm confused do roles need to be configured on masters and slaves or
>>> just slaves?
>>> The docs says --roles has been deprecated on mesos-master but doesn't
>>> state an alternate method.
>>>
>>>
>>> on my slaves i'm using default_role='sparkr' and in marathon I've added
>>> --mesos_role=sparkr however I'm not able to get any tasks to run on this
>>> server do I need to set it on the masters also ?
>>>
>>> Please advise thanks.
>>>
>>> --RB
>>>
>>>
>>>
>>> --
>>>
>>> *Rodrick Brown* / Systems Engineer
>>>
>>> +1 917 445 6839 / rodr...@orchardplatform.com
>>> 
>>>
>>> *Orchard Platform*
>>>
>>> 101 5th Avenue, 4th Floor, New York, NY 10003
>>>
>>> http://www.orchardplatform.com
>>>
>>> Orchard Blog  | Marketplace
>>> Lending Meetup 
>>>
>>> *NOTICE TO RECIPIENTS*: This communication is confidential and intended
>>> for the use of the addressee only. If you are not an intended recipient of
>>> this communication, please delete it immediately and notify the sender by
>>> return email. Unauthorized reading, dissemination, distribution or copying
>>> of this communication is prohibited. This communication does not constitute
>>> an offer to sell or a solicitation of an indication of interest to purchase
>>> any loan, security or any other financial product or instrument, nor is it
>>> an offer to sell or a solicitation of an indication of interest to purchase
>>> any 

Re: stop marathon tasks from rest api

2016-04-28 Thread Stefano Bianchi
Thank you chris i figured out.
Il 27/apr/2016 22:09, "Chris Baker" <ch...@galacticfog.com> ha scritto:

> to destroy it
> DELETE /v2/apps/{appId}
>
> https://mesosphere.github.io/marathon/docs/rest-api.html#delete-v2-apps-appid
>
> to scale it to zero ("stop" it)
> PUT {"instances": 0} /v2/apps/{appId}
> https://mesosphere.github.io/marathon/docs/rest-api.html#put-v2-apps-appid
>
>
>
> On Wed, Apr 27, 2016 at 3:49 PM Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> Hi guys
>> i'm currently unable to access to marathon UI, so i was wondering which
>> is the command to stop a marathon task from terminal?
>> thanks
>>
>


stop marathon tasks from rest api

2016-04-27 Thread Stefano Bianchi
Hi guys
i'm currently unable to access to marathon UI, so i was wondering which is
the command to stop a marathon task from terminal?
thanks


Re: Launch docker container from Marathon UI

2016-04-27 Thread Stefano Bianchi
ok now i started hadoop, i have just to wait the pull process end.
mesos assign a port to this task but if i go to the SLAVE_IP:PORT i cannot
see anything.
On which pot hadoop is commonly viewable?

2016-04-27 15:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> Since i already mentioned, anyone of you tried to run hadoop as docker
> container from marathon?
> i tried with this simple json:
>
> {
>
>   "id": "hadoop",
>
>   "cpus": 1,
>
>   "mem": 1000,
>
>   "container": {
>
> "type": "DOCKER",
>
> "docker": {
>
>   "image": "sequenceiq/hadoop-docker:2.7.1",
>
>   "network": "HOST"
>
> }
>
>   }
>
> }
>
> the app appears as running but the bar is yellow and on mesos i see staged.
> The container is more or less 800 MB probably i need to wait that pull
> operation ends? Maybe the i need to give more ram and also some storage?
>
> 2016-04-27 14:07 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> Thank you Guillermo Rodriguez
>> I will try your solution as soon as possible since wordpress is not the
>> goal task i wanna run, it was just an example to understand how to launch a
>> docker container, and of course i have chosen the easiest one :P
>> However, i correctly run Jenkins, Jupyter and Owncloud, now i'm trying to
>> do the same with hadoop.
>> Thanks to all guys.
>>
>> 2016-04-27 12:54 GMT+02:00 Guillermo Rodriguez <gu...@spritekin.com>:
>>
>>> Sorry if it has been answered before.
>>> You need mesos-dns.
>>> Start your mysql service on marathon, then mesos-dns will have an entry
>>> called mysql.marathon.mesos regardless of where the service is started you
>>> can always use that URL to resolve the mysql service.
>>>
>>> Then you start wordpress and specify that your mysql server is
>>> mysql.marathon.mesos. If you need to setup an env variable in the wordpress
>>> definition you use the env section like:
>>> {
>>>   "id": "wordpress",
>>>   "cpus": 1,
>>>   "mem": 512,
>>>   "container": {
>>> "type": "DOCKER",
>>> "docker": {
>>>   "image": "wordpress",
>>>   "network": "HOST"
>>> }
>>>   },
>>>   "env": {
>>>   "WORDPRESS_DB_HOST": "mysql.marathon.mesos:3306",
>>>   }
>>> }
>>>
>>> Marathon also allows to add dependencies on startup so you can request
>>> marathon to start the mysql service before starting the wordpress.service.
>>> Search for the Marathon REST API for more information.
>>>
>>> Luck!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> --
>>> *From*: "Stefano Bianchi" <jazzist...@gmail.com>
>>> *Sent*: Wednesday, April 27, 2016 2:53 AM
>>>
>>> *To*: user@mesos.apache.org
>>> *Subject*: Re: Launch docker container from Marathon UI
>>>
>>> Yes i guess i understood, so when i star a socker container like
>>> wordpress this app could have the need to contact another container as
>>> mysql, here project calico should be an efficient way to make this.
>>> Ok i will try, just to understand, first i run the mysql, then mesos
>>> will allocate it on a certain slave, then i need to run wordpress. How can
>>> i specify where is the mysql container in marathon UI?
>>>
>>> 2016-04-26 17:48 GMT+02:00 June Taylor <j...@umn.edu>:
>>>
>>>> Stefano,
>>>>
>>>> You would want to search for an appropriate image on Docker Hub. Here
>>>> is one I have NO experience with: https://hub.docker.com/_/mysql/
>>>>
>>>> You would then need to learn about how the image is expecting to be
>>>> configured, so you can set it up appropriately.
>>>>
>>>> This is not really a fully thought out solution. I assume you're trying
>>>> to do this for more of a proof-of-concept, though. So it may be fine for
>>>> your needs.
>>>>
>>>>
>>>> Thanks,
>>>> June Taylor
>>>> System Administrator, Minnesota Population Center
>>>> University of Minnesota
>>>>
>>>> On Tue, Apr 26, 2016 at 10:43 AM, Stefano Bianch

Re: Launch docker container from Marathon UI

2016-04-27 Thread Stefano Bianchi
of course the port is opened

2016-04-27 15:53 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> ok now i started hadoop, i have just to wait the pull process end.
> mesos assign a port to this task but if i go to the SLAVE_IP:PORT i cannot
> see anything.
> On which pot hadoop is commonly viewable?
>
> 2016-04-27 15:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> Since i already mentioned, anyone of you tried to run hadoop as docker
>> container from marathon?
>> i tried with this simple json:
>>
>> {
>>
>>   "id": "hadoop",
>>
>>   "cpus": 1,
>>
>>   "mem": 1000,
>>
>>   "container": {
>>
>> "type": "DOCKER",
>>
>> "docker": {
>>
>>   "image": "sequenceiq/hadoop-docker:2.7.1",
>>
>>   "network": "HOST"
>>
>>     }
>>
>>   }
>>
>> }
>>
>> the app appears as running but the bar is yellow and on mesos i see
>> staged.
>> The container is more or less 800 MB probably i need to wait that pull
>> operation ends? Maybe the i need to give more ram and also some storage?
>>
>> 2016-04-27 14:07 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>
>>> Thank you Guillermo Rodriguez
>>> I will try your solution as soon as possible since wordpress is not the
>>> goal task i wanna run, it was just an example to understand how to launch a
>>> docker container, and of course i have chosen the easiest one :P
>>> However, i correctly run Jenkins, Jupyter and Owncloud, now i'm trying
>>> to do the same with hadoop.
>>> Thanks to all guys.
>>>
>>> 2016-04-27 12:54 GMT+02:00 Guillermo Rodriguez <gu...@spritekin.com>:
>>>
>>>> Sorry if it has been answered before.
>>>> You need mesos-dns.
>>>> Start your mysql service on marathon, then mesos-dns will have an entry
>>>> called mysql.marathon.mesos regardless of where the service is started you
>>>> can always use that URL to resolve the mysql service.
>>>>
>>>> Then you start wordpress and specify that your mysql server is
>>>> mysql.marathon.mesos. If you need to setup an env variable in the wordpress
>>>> definition you use the env section like:
>>>> {
>>>>   "id": "wordpress",
>>>>   "cpus": 1,
>>>>   "mem": 512,
>>>>   "container": {
>>>> "type": "DOCKER",
>>>> "docker": {
>>>>   "image": "wordpress",
>>>>   "network": "HOST"
>>>> }
>>>>   },
>>>>   "env": {
>>>>   "WORDPRESS_DB_HOST": "mysql.marathon.mesos:3306",
>>>>   }
>>>> }
>>>>
>>>> Marathon also allows to add dependencies on startup so you can request
>>>> marathon to start the mysql service before starting the wordpress.service.
>>>> Search for the Marathon REST API for more information.
>>>>
>>>> Luck!
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> *From*: "Stefano Bianchi" <jazzist...@gmail.com>
>>>> *Sent*: Wednesday, April 27, 2016 2:53 AM
>>>>
>>>> *To*: user@mesos.apache.org
>>>> *Subject*: Re: Launch docker container from Marathon UI
>>>>
>>>> Yes i guess i understood, so when i star a socker container like
>>>> wordpress this app could have the need to contact another container as
>>>> mysql, here project calico should be an efficient way to make this.
>>>> Ok i will try, just to understand, first i run the mysql, then mesos
>>>> will allocate it on a certain slave, then i need to run wordpress. How can
>>>> i specify where is the mysql container in marathon UI?
>>>>
>>>> 2016-04-26 17:48 GMT+02:00 June Taylor <j...@umn.edu>:
>>>>
>>>>> Stefano,
>>>>>
>>>>> You would want to search for an appropriate image on Docker Hub. Here
>>>>> is one I have NO experience with: https://hub.docker.com/_/mysql/
>>>>>
>>>>> You would then need to learn about how the image is expecting to be
>>>&

Re: Launch docker container from Marathon UI

2016-04-27 Thread Stefano Bianchi
Since i already mentioned, anyone of you tried to run hadoop as docker
container from marathon?
i tried with this simple json:

{

  "id": "hadoop",

  "cpus": 1,

  "mem": 1000,

  "container": {

"type": "DOCKER",

"docker": {

  "image": "sequenceiq/hadoop-docker:2.7.1",

  "network": "HOST"

}

  }

}

the app appears as running but the bar is yellow and on mesos i see staged.
The container is more or less 800 MB probably i need to wait that pull
operation ends? Maybe the i need to give more ram and also some storage?

2016-04-27 14:07 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> Thank you Guillermo Rodriguez
> I will try your solution as soon as possible since wordpress is not the
> goal task i wanna run, it was just an example to understand how to launch a
> docker container, and of course i have chosen the easiest one :P
> However, i correctly run Jenkins, Jupyter and Owncloud, now i'm trying to
> do the same with hadoop.
> Thanks to all guys.
>
> 2016-04-27 12:54 GMT+02:00 Guillermo Rodriguez <gu...@spritekin.com>:
>
>> Sorry if it has been answered before.
>> You need mesos-dns.
>> Start your mysql service on marathon, then mesos-dns will have an entry
>> called mysql.marathon.mesos regardless of where the service is started you
>> can always use that URL to resolve the mysql service.
>>
>> Then you start wordpress and specify that your mysql server is
>> mysql.marathon.mesos. If you need to setup an env variable in the wordpress
>> definition you use the env section like:
>> {
>>   "id": "wordpress",
>>   "cpus": 1,
>>   "mem": 512,
>>   "container": {
>> "type": "DOCKER",
>> "docker": {
>>   "image": "wordpress",
>>   "network": "HOST"
>>     }
>>   },
>>   "env": {
>>   "WORDPRESS_DB_HOST": "mysql.marathon.mesos:3306",
>>   }
>> }
>>
>> Marathon also allows to add dependencies on startup so you can request
>> marathon to start the mysql service before starting the wordpress.service.
>> Search for the Marathon REST API for more information.
>>
>> Luck!
>>
>>
>>
>>
>>
>>
>>
>> --
>> *From*: "Stefano Bianchi" <jazzist...@gmail.com>
>> *Sent*: Wednesday, April 27, 2016 2:53 AM
>>
>> *To*: user@mesos.apache.org
>> *Subject*: Re: Launch docker container from Marathon UI
>>
>> Yes i guess i understood, so when i star a socker container like
>> wordpress this app could have the need to contact another container as
>> mysql, here project calico should be an efficient way to make this.
>> Ok i will try, just to understand, first i run the mysql, then mesos will
>> allocate it on a certain slave, then i need to run wordpress. How can i
>> specify where is the mysql container in marathon UI?
>>
>> 2016-04-26 17:48 GMT+02:00 June Taylor <j...@umn.edu>:
>>
>>> Stefano,
>>>
>>> You would want to search for an appropriate image on Docker Hub. Here is
>>> one I have NO experience with: https://hub.docker.com/_/mysql/
>>>
>>> You would then need to learn about how the image is expecting to be
>>> configured, so you can set it up appropriately.
>>>
>>> This is not really a fully thought out solution. I assume you're trying
>>> to do this for more of a proof-of-concept, though. So it may be fine for
>>> your needs.
>>>
>>>
>>> Thanks,
>>> June Taylor
>>> System Administrator, Minnesota Population Center
>>> University of Minnesota
>>>
>>> On Tue, Apr 26, 2016 at 10:43 AM, Stefano Bianchi <jazzist...@gmail.com>
>>> wrote:
>>>
>>>> My problem is this, where can i find the mysql container? I have just
>>>> said to marathon to rim a wordpress docker container, without specify mysql
>>>> one.
>>>> Il 26/apr/2016 17:39, "Aaron Carey" <aca...@ilm.com> ha scritto:
>>>>
>>>>> If you run the wordpress container on a different host to the mysql
>>>>> container and use --link on the command line, does that work?
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Aaron Carey
>>>>> Production Engineer - Cloud Pipeline
>>>>> Indus

Re: Launch docker container from Marathon UI

2016-04-27 Thread Stefano Bianchi
Thank you Guillermo Rodriguez
I will try your solution as soon as possible since wordpress is not the
goal task i wanna run, it was just an example to understand how to launch a
docker container, and of course i have chosen the easiest one :P
However, i correctly run Jenkins, Jupyter and Owncloud, now i'm trying to
do the same with hadoop.
Thanks to all guys.

2016-04-27 12:54 GMT+02:00 Guillermo Rodriguez <gu...@spritekin.com>:

> Sorry if it has been answered before.
> You need mesos-dns.
> Start your mysql service on marathon, then mesos-dns will have an entry
> called mysql.marathon.mesos regardless of where the service is started you
> can always use that URL to resolve the mysql service.
>
> Then you start wordpress and specify that your mysql server is
> mysql.marathon.mesos. If you need to setup an env variable in the wordpress
> definition you use the env section like:
> {
>   "id": "wordpress",
>   "cpus": 1,
>   "mem": 512,
>   "container": {
> "type": "DOCKER",
> "docker": {
>   "image": "wordpress",
>   "network": "HOST"
> }
>   },
>   "env": {
>   "WORDPRESS_DB_HOST": "mysql.marathon.mesos:3306",
>   }
> }
>
> Marathon also allows to add dependencies on startup so you can request
> marathon to start the mysql service before starting the wordpress.service.
> Search for the Marathon REST API for more information.
>
> Luck!
>
>
>
>
>
>
>
> --
> *From*: "Stefano Bianchi" <jazzist...@gmail.com>
> *Sent*: Wednesday, April 27, 2016 2:53 AM
>
> *To*: user@mesos.apache.org
> *Subject*: Re: Launch docker container from Marathon UI
>
> Yes i guess i understood, so when i star a socker container like wordpress
> this app could have the need to contact another container as mysql, here
> project calico should be an efficient way to make this.
> Ok i will try, just to understand, first i run the mysql, then mesos will
> allocate it on a certain slave, then i need to run wordpress. How can i
> specify where is the mysql container in marathon UI?
>
> 2016-04-26 17:48 GMT+02:00 June Taylor <j...@umn.edu>:
>
>> Stefano,
>>
>> You would want to search for an appropriate image on Docker Hub. Here is
>> one I have NO experience with: https://hub.docker.com/_/mysql/
>>
>> You would then need to learn about how the image is expecting to be
>> configured, so you can set it up appropriately.
>>
>> This is not really a fully thought out solution. I assume you're trying
>> to do this for more of a proof-of-concept, though. So it may be fine for
>> your needs.
>>
>>
>> Thanks,
>> June Taylor
>> System Administrator, Minnesota Population Center
>> University of Minnesota
>>
>> On Tue, Apr 26, 2016 at 10:43 AM, Stefano Bianchi <jazzist...@gmail.com>
>> wrote:
>>
>>> My problem is this, where can i find the mysql container? I have just
>>> said to marathon to rim a wordpress docker container, without specify mysql
>>> one.
>>> Il 26/apr/2016 17:39, "Aaron Carey" <aca...@ilm.com> ha scritto:
>>>
>>>> If you run the wordpress container on a different host to the mysql
>>>> container and use --link on the command line, does that work?
>>>>
>>>>
>>>> --
>>>>
>>>> Aaron Carey
>>>> Production Engineer - Cloud Pipeline
>>>> Industrial Light & Magic
>>>> London020 3751 9150
>>>>
>>>> --
>>>> *From:* Stefano Bianchi [jazzist...@gmail.com]
>>>> *Sent:* 26 April 2016 16:23
>>>> *To:* user@mesos.apache.org
>>>> *Subject:* RE: Launch docker container from Marathon UI
>>>>
>>>>
>>>>
>>>> Hi Aaron
>>>> Actually both mesos-dns and calico are running even though these
>>>> containers im running are not, yet, using the calico ipaddr specific in
>>>> json description.
>>>> So i guess it is a problem of bridging, i guess simply specify HOST
>>>> option on container field in Marathon UI
>>>> Il 26/apr/2016 16:59, "Aaron Carey" <aca...@ilm.com> ha scritto:
>>>>
>>>>> --link in docker should really be avoided when using marathon/mesos as
>>>>> it implies the containers are on the same host, but this will not always 
>>>&g

RE: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
My problem is this, where can i find the mysql container? I have just said
to marathon to rim a wordpress docker container, without specify mysql one.
Il 26/apr/2016 17:39, "Aaron Carey" <aca...@ilm.com> ha scritto:

> If you run the wordpress container on a different host to the mysql
> container and use --link on the command line, does that work?
>
> --
>
> Aaron Carey
> Production Engineer - Cloud Pipeline
> Industrial Light & Magic
> London
> 020 3751 9150
>
> --
> *From:* Stefano Bianchi [jazzist...@gmail.com]
> *Sent:* 26 April 2016 16:23
> *To:* user@mesos.apache.org
> *Subject:* RE: Launch docker container from Marathon UI
>
> Hi Aaron
> Actually both mesos-dns and calico are running even though these
> containers im running are not, yet, using the calico ipaddr specific in
> json description.
> So i guess it is a problem of bridging, i guess simply specify HOST option
> on container field in Marathon UI
> Il 26/apr/2016 16:59, "Aaron Carey" <aca...@ilm.com> ha scritto:
>
>> --link in docker should really be avoided when using marathon/mesos as it
>> implies the containers are on the same host, but this will not always be
>> the case when mesos schedules your containers (also I think it's being
>> deprecated in docker anyway.. not sure though?).
>>
>> This problem looks like one of service discovery within the mesos
>> cluster: how does one service contact the other when it doesn't know which
>> host the other service may have landed on?
>>
>> There are several different solutions for service discovery, you can look
>> into some like Project Calico to offer a network layer to docker or try dns
>> based solutions like Mesos-dns or Consul (along with mesos-consul). I think
>> marathon also has some concept of service discovery built in too if you use
>> something like haproxy.
>>
>> I hope this helps!
>>
>> Aaron
>>
>> --
>>
>> Aaron Carey
>> Production Engineer - Cloud Pipeline
>> Industrial Light & Magic
>> London
>> 020 3751 9150
>>
>> --
>> *From:* June Taylor [j...@umn.edu]
>> *Sent:* 26 April 2016 15:22
>> *To:* user@mesos.apache.org
>> *Subject:* Re: Launch docker container from Marathon UI
>>
>> Stefano,
>>
>> The docker run flag --link is intended to connect the container to
>> another running container. I do not know how this would operate in
>> marathon. Perhaps it would be an application group which starts up the
>> mysql docker image first, then the Wordpress docker image after it.
>>
>>
>> Thanks,
>> June Taylor
>> System Administrator, Minnesota Population Center
>> University of Minnesota
>>
>> On Tue, Apr 26, 2016 at 9:20 AM, Stefano Bianchi <jazzist...@gmail.com>
>> wrote:
>>
>>> Thanks *Rad* Gruchalski, actually i'm trying to make a json file that
>>> "translate" this command in marathon:
>>>
>>> docker run --name some-wordpress --link some-mysql:mysql -d wordpress
>>>
>>> i guess the error is relate to the fact that i'm not specifying --link
>>> some-mysql:mysql
>>> My problem is that i don't know how to do that, i tried to fill
>>> environment variable fields:
>>>
>>> Key = link
>>> Value = some-mysql:mysql
>>>
>>> But in this way the app does not work as well. How can i configure these
>>> env variables?
>>>
>>> 2016-04-26 16:01 GMT+02:00 Rad Gruchalski <ra...@gruchalski.com>:
>>>
>>>> It says exactly what the problem is.
>>>>
>>>> Start a marathon task with correct environment variables in env and you
>>>> will be fine.
>>>>
>>>> Best regards,
>>>> Radek Gruchalski
>>>> ra...@gruchalski.com <ra...@gruchalski.com>
>>>> de.linkedin.com/in/radgruchalski/
>>>>
>>>>
>>>> *Confidentiality: *This communication is intended for the above-named
>>>> person and may be confidential and/or legally privileged.
>>>> If it has come to you in error you must take no action based on it, nor
>>>> must you copy or show it to anyone; please delete/destroy and inform the
>>>> sender immediately.
>>>>
>>>> On Tuesday, 26 April 2016 at 15:56, Stefano Bianchi wrote:
>>>>
>>>> jupyter is working fine.
>>>> i tried to run wordpress and i get this error in stderr of mesos:
>>>>
>>>> error: mi

RE: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
Hi Aaron
Actually both mesos-dns and calico are running even though these containers
im running are not, yet, using the calico ipaddr specific in json
description.
So i guess it is a problem of bridging, i guess simply specify HOST option
on container field in Marathon UI
Il 26/apr/2016 16:59, "Aaron Carey" <aca...@ilm.com> ha scritto:

> --link in docker should really be avoided when using marathon/mesos as it
> implies the containers are on the same host, but this will not always be
> the case when mesos schedules your containers (also I think it's being
> deprecated in docker anyway.. not sure though?).
>
> This problem looks like one of service discovery within the mesos cluster:
> how does one service contact the other when it doesn't know which host the
> other service may have landed on?
>
> There are several different solutions for service discovery, you can look
> into some like Project Calico to offer a network layer to docker or try dns
> based solutions like Mesos-dns or Consul (along with mesos-consul). I think
> marathon also has some concept of service discovery built in too if you use
> something like haproxy.
>
> I hope this helps!
>
> Aaron
>
> --
>
> Aaron Carey
> Production Engineer - Cloud Pipeline
> Industrial Light & Magic
> London
> 020 3751 9150
>
> --
> *From:* June Taylor [j...@umn.edu]
> *Sent:* 26 April 2016 15:22
> *To:* user@mesos.apache.org
> *Subject:* Re: Launch docker container from Marathon UI
>
> Stefano,
>
> The docker run flag --link is intended to connect the container to another
> running container. I do not know how this would operate in marathon.
> Perhaps it would be an application group which starts up the mysql docker
> image first, then the Wordpress docker image after it.
>
>
> Thanks,
> June Taylor
> System Administrator, Minnesota Population Center
> University of Minnesota
>
> On Tue, Apr 26, 2016 at 9:20 AM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> Thanks *Rad* Gruchalski, actually i'm trying to make a json file that
>> "translate" this command in marathon:
>>
>> docker run --name some-wordpress --link some-mysql:mysql -d wordpress
>>
>> i guess the error is relate to the fact that i'm not specifying --link
>> some-mysql:mysql
>> My problem is that i don't know how to do that, i tried to fill
>> environment variable fields:
>>
>> Key = link
>> Value = some-mysql:mysql
>>
>> But in this way the app does not work as well. How can i configure these
>> env variables?
>>
>> 2016-04-26 16:01 GMT+02:00 Rad Gruchalski <ra...@gruchalski.com>:
>>
>>> It says exactly what the problem is.
>>>
>>> Start a marathon task with correct environment variables in env and you
>>> will be fine.
>>>
>>> Best regards,
>>> Radek Gruchalski
>>> ra...@gruchalski.com <ra...@gruchalski.com>
>>> de.linkedin.com/in/radgruchalski/
>>>
>>>
>>> *Confidentiality: *This communication is intended for the above-named
>>> person and may be confidential and/or legally privileged.
>>> If it has come to you in error you must take no action based on it, nor
>>> must you copy or show it to anyone; please delete/destroy and inform the
>>> sender immediately.
>>>
>>> On Tuesday, 26 April 2016 at 15:56, Stefano Bianchi wrote:
>>>
>>> jupyter is working fine.
>>> i tried to run wordpress and i get this error in stderr of mesos:
>>>
>>> error: missing WORDPRESS_DB_HOST and MYSQL_PORT_3306_TCP environment
>>> variables
>>>
>>>   Did you forget to --link some_mysql_container:mysql or set an external
>>> db
>>>
>>>   with -e WORDPRESS_DB_HOST=hostname:port?
>>>
>>>
>>>
>>> Some one of you know this issue?
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> 2016-04-26 15:51 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>> However thank you so much to all!
>>>
>>> 2016-04-26 15:22 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>> i found the answer by my self sorry if i disturbed you.
>>>
>>> 2016-04-26 15:19 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>> Now that it is running, how can i check the User Interface?
>>>
>>>
>>> 2016-04-26 15:18 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com&

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
Thanks *Rad* Gruchalski, actually i'm trying to make a json file that
"translate" this command in marathon:

docker run --name some-wordpress --link some-mysql:mysql -d wordpress

i guess the error is relate to the fact that i'm not specifying --link
some-mysql:mysql
My problem is that i don't know how to do that, i tried to fill environment
variable fields:

Key = link
Value = some-mysql:mysql

But in this way the app does not work as well. How can i configure these
env variables?

2016-04-26 16:01 GMT+02:00 Rad Gruchalski <ra...@gruchalski.com>:

> It says exactly what the problem is.
>
> Start a marathon task with correct environment variables in env and you
> will be fine.
>
> Best regards,
> Radek Gruchalski
> ra...@gruchalski.com <ra...@gruchalski.com>
> de.linkedin.com/in/radgruchalski/
>
>
> *Confidentiality:*This communication is intended for the above-named
> person and may be confidential and/or legally privileged.
> If it has come to you in error you must take no action based on it, nor
> must you copy or show it to anyone; please delete/destroy and inform the
> sender immediately.
>
> On Tuesday, 26 April 2016 at 15:56, Stefano Bianchi wrote:
>
> jupyter is working fine.
> i tried to run wordpress and i get this error in stderr of mesos:
>
> error: missing WORDPRESS_DB_HOST and MYSQL_PORT_3306_TCP environment
> variables
>
>   Did you forget to --link some_mysql_container:mysql or set an external db
>
>   with -e WORDPRESS_DB_HOST=hostname:port?
>
>
>
> Some one of you know this issue?
>
>
>
>
>
>
>
>
>
>
>
>
> 2016-04-26 15:51 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
> However thank you so much to all!
>
> 2016-04-26 15:22 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
> i found the answer by my self sorry if i disturbed you.
>
> 2016-04-26 15:19 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
> Now that it is running, how can i check the User Interface?
>
>
> 2016-04-26 15:18 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
> Yes, now it's running!!! June you are awesome!!!
>
> 2016-04-26 15:16 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
> i have done these 2 commands, now jupyter is in deploying in marathon,
> staging in mesos.
> Is there some additional configuration needed?
>
> 2016-04-26 15:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
> June i tried to run your json, but the task is waiting, and if starts it
> failed immediately.
>
> I guess because i did not type this commands:
>
>
>1.
>
>echo 'docker,mesos' > /etc/mesos-slave/containerizers
>
>2.
>
>$ echo '5mins' > /etc/mesos-slave/executor_registration_timeout
>
>
> Could it be the problem?
>
> 2016-04-26 15:02 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
> Thank you June taylor, it is axactly what i was intending.
> if it is not disturbing you, i try jupyter notebook as well, just to make
> some tests on how to launch marathon.
> stay tuned :)
>
> 2016-04-26 14:58 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
> thanks haosdent.
> actually i have run this kind of apps through rest api.
> Now i want learn how to laung docker files. I found this exaple:
>
> {
>   "container": {
> "type": "DOCKER",
> "docker": {
>   "network": "HOST",
>   "image": "group/image"
> },
> "volumes": [
>   {
> "containerPath": "/etc/a",
> "hostPath": "/var/data/a",
> "mode": "RO"
>   },
>   {
> "containerPath": "/etc/b",
> "hostPath": "/var/data/b",
> "mode": "RW"
>   }
> ]
>   }}
>
>
> I am able to link the correspondent field in the marathon UI with what is
> written in this json.
> What i need to understand is, what i should write in:
>
>  "image": "group/image"
>
> i mean, with what i have to replace group and image?
> For instance, if i would run wordpress container on docker hub what i
> should put replacing "group/image" ?
>
>
>
>
>
>
>
> 2016-04-26 14:30 GMT+02:00 haosdent <haosd...@gmail.com>:
>
> This is marathon REST API document:
> https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps .
> Usually we define a task json file and call the rest api.
>
> For example, create tasks.json which content is
>
> ```
> {
> "i

Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
jupyter is working fine.
i tried to run wordpress and i get this error in stderr of mesos:

error: missing WORDPRESS_DB_HOST and MYSQL_PORT_3306_TCP environment
variables

  Did you forget to --link some_mysql_container:mysql or set an external db

  with -e WORDPRESS_DB_HOST=hostname:port?



Some one of you know this issue?












2016-04-26 15:51 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> However thank you so much to all!
>
> 2016-04-26 15:22 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> i found the answer by my self sorry if i disturbed you.
>>
>> 2016-04-26 15:19 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>
>>> Now that it is running, how can i check the User Interface?
>>>
>>>
>>> 2016-04-26 15:18 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>>> Yes, now it's running!!! June you are awesome!!!
>>>>
>>>> 2016-04-26 15:16 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>
>>>>> i have done these 2 commands, now jupyter is in deploying in marathon,
>>>>> staging in mesos.
>>>>> Is there some additional configuration needed?
>>>>>
>>>>> 2016-04-26 15:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>
>>>>>> June i tried to run your json, but the task is waiting, and if starts
>>>>>> it failed immediately.
>>>>>>
>>>>>> I guess because i did not type this commands:
>>>>>>
>>>>>>
>>>>>>1.
>>>>>>
>>>>>>echo 'docker,mesos' > /etc/mesos-slave/containerizers
>>>>>>
>>>>>>2.
>>>>>>
>>>>>>$ echo '5mins' > /etc/mesos-slave/executor_registration_timeout
>>>>>>
>>>>>>
>>>>>> Could it be the problem?
>>>>>>
>>>>>> 2016-04-26 15:02 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>>
>>>>>>> Thank you June taylor, it is axactly what i was intending.
>>>>>>> if it is not disturbing you, i try jupyter notebook as well, just to
>>>>>>> make some tests on how to launch marathon.
>>>>>>> stay tuned :)
>>>>>>>
>>>>>>> 2016-04-26 14:58 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>>>
>>>>>>>> thanks haosdent.
>>>>>>>> actually i have run this kind of apps through rest api.
>>>>>>>> Now i want learn how to laung docker files. I found this exaple:
>>>>>>>>
>>>>>>>> {
>>>>>>>>   "container": {
>>>>>>>> "type": "DOCKER",
>>>>>>>> "docker": {
>>>>>>>>   "network": "HOST",
>>>>>>>>   "image": "group/image"
>>>>>>>> },
>>>>>>>> "volumes": [
>>>>>>>>   {
>>>>>>>> "containerPath": "/etc/a",
>>>>>>>> "hostPath": "/var/data/a",
>>>>>>>> "mode": "RO"
>>>>>>>>   },
>>>>>>>>   {
>>>>>>>> "containerPath": "/etc/b",
>>>>>>>>     "hostPath": "/var/data/b",
>>>>>>>> "mode": "RW"
>>>>>>>>   }
>>>>>>>> ]
>>>>>>>>   }}
>>>>>>>>
>>>>>>>>
>>>>>>>> I am able to link the correspondent field in the marathon UI with
>>>>>>>> what is written in this json.
>>>>>>>> What i need to understand is, what i should write in:
>>>>>>>>
>>>>>>>>  "image": "group/image"
>>>>>>>>
>>>>>>>> i mean, with what i have to replace group and image?
>>>>>>>> For instance, if i would run wordpress container on docker hub what
>>>>>>>> i should put replacing "group/image" ?
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> 2016-04-26 14:30 GMT+02:00 haosdent <haosd...@gmail.com>:
>>>>>>>>
>>>>>>>>> This is marathon REST API document:
>>>>>>>>> https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps
>>>>>>>>> . Usually we define a task json file and call the rest api.
>>>>>>>>>
>>>>>>>>> For example, create tasks.json which content is
>>>>>>>>>
>>>>>>>>> ```
>>>>>>>>> {
>>>>>>>>> "id": "/test-sleep",
>>>>>>>>> "cmd": "sleep 200"
>>>>>>>>> }
>>>>>>>>> ```
>>>>>>>>>
>>>>>>>>> And
>>>>>>>>>
>>>>>>>>> ```
>>>>>>>>> curl -X POST -H "Content-type: application/json" 
>>>>>>>>> http://${YOUR_MARATHON_ADDR}:8080/v2/apps
>>>>>>>>> -d @tasks.json
>>>>>>>>> ```
>>>>>>>>>
>>>>>>>>> You could find more field definitions in their document.
>>>>>>>>>
>>>>>>>>> On Tue, Apr 26, 2016 at 8:24 PM, Stefano Bianchi <
>>>>>>>>> jazzist...@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Hi guys
>>>>>>>>>>
>>>>>>>>>> i'm trying to follow the instructions on mesosphere
>>>>>>>>>> documentation, but it is a little bit unlear for me that i am new to 
>>>>>>>>>> this
>>>>>>>>>> world.
>>>>>>>>>> i' would like to launch a wordpress container, present on docker
>>>>>>>>>> hub here https://hub.docker.com/_/wordpress/ , from marathon UI
>>>>>>>>>> but i don't understand the mechanism.
>>>>>>>>>> I understood that i don't have to specify a command in "Command"
>>>>>>>>>> field, but i don't know how to fill the dockers fields in marathon 
>>>>>>>>>> UI to
>>>>>>>>>> launch wordpress container.
>>>>>>>>>> Could you please help me or tell me where i can find a clearer
>>>>>>>>>> documentation?
>>>>>>>>>>
>>>>>>>>>> Thanks.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Best Regards,
>>>>>>>>> Haosdent Huang
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>


Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
However thank you so much to all!

2016-04-26 15:22 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> i found the answer by my self sorry if i disturbed you.
>
> 2016-04-26 15:19 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> Now that it is running, how can i check the User Interface?
>>
>>
>> 2016-04-26 15:18 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>
>>> Yes, now it's running!!! June you are awesome!!!
>>>
>>> 2016-04-26 15:16 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>>> i have done these 2 commands, now jupyter is in deploying in marathon,
>>>> staging in mesos.
>>>> Is there some additional configuration needed?
>>>>
>>>> 2016-04-26 15:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>
>>>>> June i tried to run your json, but the task is waiting, and if starts
>>>>> it failed immediately.
>>>>>
>>>>> I guess because i did not type this commands:
>>>>>
>>>>>
>>>>>1.
>>>>>
>>>>>echo 'docker,mesos' > /etc/mesos-slave/containerizers
>>>>>
>>>>>2.
>>>>>
>>>>>$ echo '5mins' > /etc/mesos-slave/executor_registration_timeout
>>>>>
>>>>>
>>>>> Could it be the problem?
>>>>>
>>>>> 2016-04-26 15:02 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>
>>>>>> Thank you June taylor, it is axactly what i was intending.
>>>>>> if it is not disturbing you, i try jupyter notebook as well, just to
>>>>>> make some tests on how to launch marathon.
>>>>>> stay tuned :)
>>>>>>
>>>>>> 2016-04-26 14:58 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>>
>>>>>>> thanks haosdent.
>>>>>>> actually i have run this kind of apps through rest api.
>>>>>>> Now i want learn how to laung docker files. I found this exaple:
>>>>>>>
>>>>>>> {
>>>>>>>   "container": {
>>>>>>> "type": "DOCKER",
>>>>>>> "docker": {
>>>>>>>   "network": "HOST",
>>>>>>>   "image": "group/image"
>>>>>>> },
>>>>>>> "volumes": [
>>>>>>>   {
>>>>>>> "containerPath": "/etc/a",
>>>>>>> "hostPath": "/var/data/a",
>>>>>>> "mode": "RO"
>>>>>>>   },
>>>>>>>   {
>>>>>>> "containerPath": "/etc/b",
>>>>>>> "hostPath": "/var/data/b",
>>>>>>> "mode": "RW"
>>>>>>>   }
>>>>>>> ]
>>>>>>>   }}
>>>>>>>
>>>>>>>
>>>>>>> I am able to link the correspondent field in the marathon UI with
>>>>>>> what is written in this json.
>>>>>>> What i need to understand is, what i should write in:
>>>>>>>
>>>>>>>  "image": "group/image"
>>>>>>>
>>>>>>> i mean, with what i have to replace group and image?
>>>>>>> For instance, if i would run wordpress container on docker hub what
>>>>>>> i should put replacing "group/image" ?
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> 2016-04-26 14:30 GMT+02:00 haosdent <haosd...@gmail.com>:
>>>>>>>
>>>>>>>> This is marathon REST API document:
>>>>>>>> https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps
>>>>>>>> . Usually we define a task json file and call the rest api.
>>>>>>>>
>>>>>>>> For example, create tasks.json which content is
>>>>>>>>
>>>>>>>> ```
>>>>>>>> {
>>>>>>>> "id": "/test-sleep",
>>>>>>>> "cmd": "sleep 200"
>>>>>>>> }
>>>>>>>> ```
>>>>>>>>
>>>>>>>> And
>>>>>>>>
>>>>>>>> ```
>>>>>>>> curl -X POST -H "Content-type: application/json" 
>>>>>>>> http://${YOUR_MARATHON_ADDR}:8080/v2/apps
>>>>>>>> -d @tasks.json
>>>>>>>> ```
>>>>>>>>
>>>>>>>> You could find more field definitions in their document.
>>>>>>>>
>>>>>>>> On Tue, Apr 26, 2016 at 8:24 PM, Stefano Bianchi <
>>>>>>>> jazzist...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi guys
>>>>>>>>>
>>>>>>>>> i'm trying to follow the instructions on mesosphere documentation,
>>>>>>>>> but it is a little bit unlear for me that i am new to this world.
>>>>>>>>> i' would like to launch a wordpress container, present on docker
>>>>>>>>> hub here https://hub.docker.com/_/wordpress/ , from marathon UI
>>>>>>>>> but i don't understand the mechanism.
>>>>>>>>> I understood that i don't have to specify a command in "Command"
>>>>>>>>> field, but i don't know how to fill the dockers fields in marathon UI 
>>>>>>>>> to
>>>>>>>>> launch wordpress container.
>>>>>>>>> Could you please help me or tell me where i can find a clearer
>>>>>>>>> documentation?
>>>>>>>>>
>>>>>>>>> Thanks.
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Best Regards,
>>>>>>>> Haosdent Huang
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>


Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
i found the answer by my self sorry if i disturbed you.

2016-04-26 15:19 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> Now that it is running, how can i check the User Interface?
>
>
> 2016-04-26 15:18 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> Yes, now it's running!!! June you are awesome!!!
>>
>> 2016-04-26 15:16 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>
>>> i have done these 2 commands, now jupyter is in deploying in marathon,
>>> staging in mesos.
>>> Is there some additional configuration needed?
>>>
>>> 2016-04-26 15:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>>> June i tried to run your json, but the task is waiting, and if starts
>>>> it failed immediately.
>>>>
>>>> I guess because i did not type this commands:
>>>>
>>>>
>>>>1.
>>>>
>>>>    echo 'docker,mesos' > /etc/mesos-slave/containerizers
>>>>
>>>>2.
>>>>
>>>>$ echo '5mins' > /etc/mesos-slave/executor_registration_timeout
>>>>
>>>>
>>>> Could it be the problem?
>>>>
>>>> 2016-04-26 15:02 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>
>>>>> Thank you June taylor, it is axactly what i was intending.
>>>>> if it is not disturbing you, i try jupyter notebook as well, just to
>>>>> make some tests on how to launch marathon.
>>>>> stay tuned :)
>>>>>
>>>>> 2016-04-26 14:58 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>
>>>>>> thanks haosdent.
>>>>>> actually i have run this kind of apps through rest api.
>>>>>> Now i want learn how to laung docker files. I found this exaple:
>>>>>>
>>>>>> {
>>>>>>   "container": {
>>>>>> "type": "DOCKER",
>>>>>> "docker": {
>>>>>>   "network": "HOST",
>>>>>>   "image": "group/image"
>>>>>> },
>>>>>> "volumes": [
>>>>>>   {
>>>>>> "containerPath": "/etc/a",
>>>>>> "hostPath": "/var/data/a",
>>>>>> "mode": "RO"
>>>>>>   },
>>>>>>   {
>>>>>> "containerPath": "/etc/b",
>>>>>> "hostPath": "/var/data/b",
>>>>>> "mode": "RW"
>>>>>>   }
>>>>>> ]
>>>>>>   }}
>>>>>>
>>>>>>
>>>>>> I am able to link the correspondent field in the marathon UI with
>>>>>> what is written in this json.
>>>>>> What i need to understand is, what i should write in:
>>>>>>
>>>>>>  "image": "group/image"
>>>>>>
>>>>>> i mean, with what i have to replace group and image?
>>>>>> For instance, if i would run wordpress container on docker hub what i
>>>>>> should put replacing "group/image" ?
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> 2016-04-26 14:30 GMT+02:00 haosdent <haosd...@gmail.com>:
>>>>>>
>>>>>>> This is marathon REST API document:
>>>>>>> https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps
>>>>>>> . Usually we define a task json file and call the rest api.
>>>>>>>
>>>>>>> For example, create tasks.json which content is
>>>>>>>
>>>>>>> ```
>>>>>>> {
>>>>>>> "id": "/test-sleep",
>>>>>>> "cmd": "sleep 200"
>>>>>>> }
>>>>>>> ```
>>>>>>>
>>>>>>> And
>>>>>>>
>>>>>>> ```
>>>>>>> curl -X POST -H "Content-type: application/json" 
>>>>>>> http://${YOUR_MARATHON_ADDR}:8080/v2/apps
>>>>>>> -d @tasks.json
>>>>>>> ```
>>>>>>>
>>>>>>> You could find more field definitions in their document.
>>>>>>>
>>>>>>> On Tue, Apr 26, 2016 at 8:24 PM, Stefano Bianchi <
>>>>>>> jazzist...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi guys
>>>>>>>>
>>>>>>>> i'm trying to follow the instructions on mesosphere documentation,
>>>>>>>> but it is a little bit unlear for me that i am new to this world.
>>>>>>>> i' would like to launch a wordpress container, present on docker
>>>>>>>> hub here https://hub.docker.com/_/wordpress/ , from marathon UI
>>>>>>>> but i don't understand the mechanism.
>>>>>>>> I understood that i don't have to specify a command in "Command"
>>>>>>>> field, but i don't know how to fill the dockers fields in marathon UI 
>>>>>>>> to
>>>>>>>> launch wordpress container.
>>>>>>>> Could you please help me or tell me where i can find a clearer
>>>>>>>> documentation?
>>>>>>>>
>>>>>>>> Thanks.
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Best Regards,
>>>>>>> Haosdent Huang
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>


Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
Yes, now it's running!!! June you are awesome!!!

2016-04-26 15:16 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> i have done these 2 commands, now jupyter is in deploying in marathon,
> staging in mesos.
> Is there some additional configuration needed?
>
> 2016-04-26 15:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> June i tried to run your json, but the task is waiting, and if starts it
>> failed immediately.
>>
>> I guess because i did not type this commands:
>>
>>
>>1.
>>
>>echo 'docker,mesos' > /etc/mesos-slave/containerizers
>>
>>2.
>>
>>$ echo '5mins' > /etc/mesos-slave/executor_registration_timeout
>>
>>
>> Could it be the problem?
>>
>> 2016-04-26 15:02 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>
>>> Thank you June taylor, it is axactly what i was intending.
>>> if it is not disturbing you, i try jupyter notebook as well, just to
>>> make some tests on how to launch marathon.
>>> stay tuned :)
>>>
>>> 2016-04-26 14:58 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>>> thanks haosdent.
>>>> actually i have run this kind of apps through rest api.
>>>> Now i want learn how to laung docker files. I found this exaple:
>>>>
>>>> {
>>>>   "container": {
>>>> "type": "DOCKER",
>>>> "docker": {
>>>>   "network": "HOST",
>>>>   "image": "group/image"
>>>> },
>>>> "volumes": [
>>>>   {
>>>> "containerPath": "/etc/a",
>>>> "hostPath": "/var/data/a",
>>>> "mode": "RO"
>>>>   },
>>>>   {
>>>> "containerPath": "/etc/b",
>>>> "hostPath": "/var/data/b",
>>>> "mode": "RW"
>>>>   }
>>>> ]
>>>>   }}
>>>>
>>>>
>>>> I am able to link the correspondent field in the marathon UI with what
>>>> is written in this json.
>>>> What i need to understand is, what i should write in:
>>>>
>>>>  "image": "group/image"
>>>>
>>>> i mean, with what i have to replace group and image?
>>>> For instance, if i would run wordpress container on docker hub what i
>>>> should put replacing "group/image" ?
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> 2016-04-26 14:30 GMT+02:00 haosdent <haosd...@gmail.com>:
>>>>
>>>>> This is marathon REST API document:
>>>>> https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps
>>>>> . Usually we define a task json file and call the rest api.
>>>>>
>>>>> For example, create tasks.json which content is
>>>>>
>>>>> ```
>>>>> {
>>>>> "id": "/test-sleep",
>>>>> "cmd": "sleep 200"
>>>>> }
>>>>> ```
>>>>>
>>>>> And
>>>>>
>>>>> ```
>>>>> curl -X POST -H "Content-type: application/json" 
>>>>> http://${YOUR_MARATHON_ADDR}:8080/v2/apps
>>>>> -d @tasks.json
>>>>> ```
>>>>>
>>>>> You could find more field definitions in their document.
>>>>>
>>>>> On Tue, Apr 26, 2016 at 8:24 PM, Stefano Bianchi <jazzist...@gmail.com
>>>>> > wrote:
>>>>>
>>>>>> Hi guys
>>>>>>
>>>>>> i'm trying to follow the instructions on mesosphere documentation,
>>>>>> but it is a little bit unlear for me that i am new to this world.
>>>>>> i' would like to launch a wordpress container, present on docker hub
>>>>>> here https://hub.docker.com/_/wordpress/ , from marathon UI but i
>>>>>> don't understand the mechanism.
>>>>>> I understood that i don't have to specify a command in "Command"
>>>>>> field, but i don't know how to fill the dockers fields in marathon UI to
>>>>>> launch wordpress container.
>>>>>> Could you please help me or tell me where i can find a clearer
>>>>>> documentation?
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Best Regards,
>>>>> Haosdent Huang
>>>>>
>>>>
>>>>
>>>
>>
>


Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
i have done these 2 commands, now jupyter is in deploying in marathon,
staging in mesos.
Is there some additional configuration needed?

2016-04-26 15:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> June i tried to run your json, but the task is waiting, and if starts it
> failed immediately.
>
> I guess because i did not type this commands:
>
>
>1.
>
>echo 'docker,mesos' > /etc/mesos-slave/containerizers
>
>2.
>
>$ echo '5mins' > /etc/mesos-slave/executor_registration_timeout
>
>
> Could it be the problem?
>
> 2016-04-26 15:02 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> Thank you June taylor, it is axactly what i was intending.
>> if it is not disturbing you, i try jupyter notebook as well, just to make
>> some tests on how to launch marathon.
>> stay tuned :)
>>
>> 2016-04-26 14:58 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>
>>> thanks haosdent.
>>> actually i have run this kind of apps through rest api.
>>> Now i want learn how to laung docker files. I found this exaple:
>>>
>>> {
>>>   "container": {
>>> "type": "DOCKER",
>>> "docker": {
>>>   "network": "HOST",
>>>   "image": "group/image"
>>> },
>>> "volumes": [
>>>   {
>>> "containerPath": "/etc/a",
>>> "hostPath": "/var/data/a",
>>> "mode": "RO"
>>>   },
>>>   {
>>> "containerPath": "/etc/b",
>>> "hostPath": "/var/data/b",
>>> "mode": "RW"
>>>   }
>>> ]
>>>   }}
>>>
>>>
>>> I am able to link the correspondent field in the marathon UI with what
>>> is written in this json.
>>> What i need to understand is, what i should write in:
>>>
>>>  "image": "group/image"
>>>
>>> i mean, with what i have to replace group and image?
>>> For instance, if i would run wordpress container on docker hub what i
>>> should put replacing "group/image" ?
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> 2016-04-26 14:30 GMT+02:00 haosdent <haosd...@gmail.com>:
>>>
>>>> This is marathon REST API document:
>>>> https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps
>>>> . Usually we define a task json file and call the rest api.
>>>>
>>>> For example, create tasks.json which content is
>>>>
>>>> ```
>>>> {
>>>> "id": "/test-sleep",
>>>> "cmd": "sleep 200"
>>>> }
>>>> ```
>>>>
>>>> And
>>>>
>>>> ```
>>>> curl -X POST -H "Content-type: application/json" 
>>>> http://${YOUR_MARATHON_ADDR}:8080/v2/apps
>>>> -d @tasks.json
>>>> ```
>>>>
>>>> You could find more field definitions in their document.
>>>>
>>>> On Tue, Apr 26, 2016 at 8:24 PM, Stefano Bianchi <jazzist...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi guys
>>>>>
>>>>> i'm trying to follow the instructions on mesosphere documentation, but
>>>>> it is a little bit unlear for me that i am new to this world.
>>>>> i' would like to launch a wordpress container, present on docker hub
>>>>> here https://hub.docker.com/_/wordpress/ , from marathon UI but i
>>>>> don't understand the mechanism.
>>>>> I understood that i don't have to specify a command in "Command"
>>>>> field, but i don't know how to fill the dockers fields in marathon UI to
>>>>> launch wordpress container.
>>>>> Could you please help me or tell me where i can find a clearer
>>>>> documentation?
>>>>>
>>>>> Thanks.
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Best Regards,
>>>> Haosdent Huang
>>>>
>>>
>>>
>>
>


Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
June i tried to run your json, but the task is waiting, and if starts it
failed immediately.

I guess because i did not type this commands:


   1.

   echo 'docker,mesos' > /etc/mesos-slave/containerizers

   2.

   $ echo '5mins' > /etc/mesos-slave/executor_registration_timeout


Could it be the problem?

2016-04-26 15:02 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> Thank you June taylor, it is axactly what i was intending.
> if it is not disturbing you, i try jupyter notebook as well, just to make
> some tests on how to launch marathon.
> stay tuned :)
>
> 2016-04-26 14:58 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> thanks haosdent.
>> actually i have run this kind of apps through rest api.
>> Now i want learn how to laung docker files. I found this exaple:
>>
>> {
>>   "container": {
>> "type": "DOCKER",
>> "docker": {
>>   "network": "HOST",
>>   "image": "group/image"
>> },
>> "volumes": [
>>   {
>> "containerPath": "/etc/a",
>> "hostPath": "/var/data/a",
>> "mode": "RO"
>>   },
>>   {
>> "containerPath": "/etc/b",
>> "hostPath": "/var/data/b",
>> "mode": "RW"
>>   }
>> ]
>>   }}
>>
>>
>> I am able to link the correspondent field in the marathon UI with what is
>> written in this json.
>> What i need to understand is, what i should write in:
>>
>>  "image": "group/image"
>>
>> i mean, with what i have to replace group and image?
>> For instance, if i would run wordpress container on docker hub what i
>> should put replacing "group/image" ?
>>
>>
>>
>>
>>
>>
>>
>> 2016-04-26 14:30 GMT+02:00 haosdent <haosd...@gmail.com>:
>>
>>> This is marathon REST API document:
>>> https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps .
>>> Usually we define a task json file and call the rest api.
>>>
>>> For example, create tasks.json which content is
>>>
>>> ```
>>> {
>>> "id": "/test-sleep",
>>> "cmd": "sleep 200"
>>> }
>>> ```
>>>
>>> And
>>>
>>> ```
>>> curl -X POST -H "Content-type: application/json" 
>>> http://${YOUR_MARATHON_ADDR}:8080/v2/apps
>>> -d @tasks.json
>>> ```
>>>
>>> You could find more field definitions in their document.
>>>
>>> On Tue, Apr 26, 2016 at 8:24 PM, Stefano Bianchi <jazzist...@gmail.com>
>>> wrote:
>>>
>>>> Hi guys
>>>>
>>>> i'm trying to follow the instructions on mesosphere documentation, but
>>>> it is a little bit unlear for me that i am new to this world.
>>>> i' would like to launch a wordpress container, present on docker hub
>>>> here https://hub.docker.com/_/wordpress/ , from marathon UI but i
>>>> don't understand the mechanism.
>>>> I understood that i don't have to specify a command in "Command" field,
>>>> but i don't know how to fill the dockers fields in marathon UI to launch
>>>> wordpress container.
>>>> Could you please help me or tell me where i can find a clearer
>>>> documentation?
>>>>
>>>> Thanks.
>>>>
>>>
>>>
>>>
>>> --
>>> Best Regards,
>>> Haosdent Huang
>>>
>>
>>
>


Re: Launch docker container from Marathon UI

2016-04-26 Thread Stefano Bianchi
thanks haosdent.
actually i have run this kind of apps through rest api.
Now i want learn how to laung docker files. I found this exaple:

{
  "container": {
"type": "DOCKER",
"docker": {
  "network": "HOST",
  "image": "group/image"
},
"volumes": [
  {
"containerPath": "/etc/a",
"hostPath": "/var/data/a",
"mode": "RO"
  },
  {
"containerPath": "/etc/b",
"hostPath": "/var/data/b",
"mode": "RW"
  }
]
  }}


I am able to link the correspondent field in the marathon UI with what is
written in this json.
What i need to understand is, what i should write in:

 "image": "group/image"

i mean, with what i have to replace group and image?
For instance, if i would run wordpress container on docker hub what i
should put replacing "group/image" ?







2016-04-26 14:30 GMT+02:00 haosdent <haosd...@gmail.com>:

> This is marathon REST API document:
> https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps .
> Usually we define a task json file and call the rest api.
>
> For example, create tasks.json which content is
>
> ```
> {
> "id": "/test-sleep",
> "cmd": "sleep 200"
> }
> ```
>
> And
>
> ```
> curl -X POST -H "Content-type: application/json" 
> http://${YOUR_MARATHON_ADDR}:8080/v2/apps
> -d @tasks.json
> ```
>
> You could find more field definitions in their document.
>
> On Tue, Apr 26, 2016 at 8:24 PM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> Hi guys
>>
>> i'm trying to follow the instructions on mesosphere documentation, but it
>> is a little bit unlear for me that i am new to this world.
>> i' would like to launch a wordpress container, present on docker hub here
>> https://hub.docker.com/_/wordpress/ , from marathon UI but i don't
>> understand the mechanism.
>> I understood that i don't have to specify a command in "Command" field,
>> but i don't know how to fill the dockers fields in marathon UI to launch
>> wordpress container.
>> Could you please help me or tell me where i can find a clearer
>> documentation?
>>
>> Thanks.
>>
>
>
>
> --
> Best Regards,
> Haosdent Huang
>


List of possible mesos tasks to run

2016-04-22 Thread Stefano Bianchi
I guys.
I have finally deployed my disttibuted mesos cluster. Of course im on
openstack and it is a simplified view of a real distributing cluster,
however mesos is able to disttibute tasks ok different networks.
Now i need to test come long running applications that can be launched from
marathon. I mean something that is visually viewable from my web browser.
I am not so aware of these apps do i would ask to you soke suggestions.
My department would like, for instance, run hadoop, i mean from marathon
launch hadoop which will be allocated to a certain slave. Is it possible? I
m open to other sugvestions.

Best regards and thanks  to all of you

Stefano
Il 22/apr/2016 11:12, "haosdent"  ha scritto:

> Could you show stderr and stdout both? How about `export GLOG_v=1` and
> restart mesos-slave to see whether more details in log and stdout/stderr?
> Could that agent start MessoContainerizer tasks successfully?
>
> On Fri, Apr 22, 2016 at 4:55 PM, tommy xiao  wrote:
>
>> only one mesos slave can't starting. dig slave log, master log, marathon
>> log. can't found any clue to debug.  Attached overall infos.
>>
>> --
>> Deshi Xiao
>> Twitter: xds2000
>> E-mail: xiaods(AT)gmail.com
>>
>
>
>
> --
> Best Regards,
> Haosdent Huang
>


Re: removed slace "ID": (131.154.96.172): health check timed out

2016-04-19 Thread Stefano Bianchi
Now it seems working.
I guess for 2 reasons:
1) I set up /etc/mesos-master/ip and etc/mesos-slave/ip thanks for your
suggestion.
2) i added in the routing table the gateway to reach the other network.
the second point continue to be strange, since only for 3 machines i had to
place the routing rule, while for other machine there were not necessary.
However, now i have 2 mesos masters on network 1 and 1 mesos master on
network 2 connected each other, and all the slaves are connected to the
leader without disconnecting.
Thanks a lot guys if i have other issues i will share with you!

2016-04-19 10:09 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> However i have omitted to say that on these machines is running docker, on
> some machines docker is running a service on other dont, i saw the docker
> interface typing ifconfig, i guess this is what you mean Dick Davies?
> Il 19/apr/2016 09:22, "Stefano Bianchi" <jazzist...@gmail.com> ha scritto:
>
>> Actualli the majority of these settings i have already done, out of
>> /etc/mesos-master/ip, here should i write the ip of master interface ? And
>> /etc/mesos-slave/ip, here i should write the ip of slave interface ?
>> Your suggest seems the right one, because if i try to ping some machines
>> from a network to another someone is reachable some other don't, and these
>> latters sometimes, commonly at boot, are able to ping and aftwr a while
>> dont.
>> Thanks for your suggestion i m going to try.
>> Il 19/apr/2016 03:12, "Dick Davies" <d...@hellooperator.net> ha scritto:
>>
>>> On our network a lot of the hosts have multiple interfaces, which let
>>> some asymmetric routing
>>> issues creep in that prevented our masters replying to slaves, which
>>> reminded me of your symptoms.
>>>
>>> So we set an IP address in /etc/mesos-slave/ip and
>>> /etc/mesos-master/ip so that they only listen
>>> on one interface, and then check connectivity between those IPs.
>>>
>>> The Ansible repo we use to build the stack now has a 'signoff'
>>> playbook to check network connectivity
>>> is correct between the services it deploys to a new environment.
>>>
>>> It won't be much use to you on its own I'm afraid, but
>>> here's a checklist cribbed from that playbook (ports might be
>>> different in your setup).
>>>
>>> You can SSH to the servers and check reachability between them with
>>> netcat or telnet.
>>>
>>>
>>> zookeepers:
>>>
>>> - need to be able to reach each other on the election port (usually
>>> tcp/3888)
>>>
>>> masters:
>>>
>>> * must be able to reach zookeepers on tcp/2181
>>> * must be able to reach each other on tcp/5050
>>> * must be able to reach slaves on tcp/5051
>>>
>>> mesos slaves:
>>>
>>> - must be able to reach masters on tcp/5050
>>> - must be able to reach zookeepers on tcp/2181
>>> - another other connectivity to services your application needs
>>> (database, caches, whatever)
>>>
>>> I think that's it.
>>>
>>> On 18 April 2016 at 20:39, Stefano Bianchi <jazzist...@gmail.com> wrote:
>>> > Hi Dick Davies
>>> >
>>> > Could you please share your solution?
>>> > How did you set up mesos/Zookeeper to interconnect masters and slaves
>>> among
>>> > networks?
>>> >
>>> > Thanks a lot!
>>> >
>>> > 2016-04-18 20:56 GMT+02:00 Dick Davies <d...@hellooperator.net>:
>>> >>
>>> >> +1 for that theory, we had some screwy issues when we tried to span
>>> >> subnets until we set every slave and master
>>> >> to listen on a specific IP so we could tie down routing correctly.
>>> >>
>>> >> Saw very similar symptoms that have been described.
>>> >>
>>> >> On 18 April 2016 at 18:35, Alex Rukletsov <a...@mesosphere.com>
>>> wrote:
>>> >> > I believe it's because slaves are able to connect to the master,
>>> but the
>>> >> > master is not able to connect to the slaves. That's why you see them
>>> >> > connected for some time and gone afterwards.
>>> >> >
>>> >> > On Mon, Apr 18, 2016 at 6:47 PM, Stefano Bianchi <
>>> jazzist...@gmail.com>
>>> >> > wrote:
>>> >> >>
>>> >> >> Indeed, i dont know why, i am not able to reach all the machines
>>&g

Re: removed slace "ID": (131.154.96.172): health check timed out

2016-04-19 Thread Stefano Bianchi
However i have omitted to say that on these machines is running docker, on
some machines docker is running a service on other dont, i saw the docker
interface typing ifconfig, i guess this is what you mean Dick Davies?
Il 19/apr/2016 09:22, "Stefano Bianchi" <jazzist...@gmail.com> ha scritto:

> Actualli the majority of these settings i have already done, out of
> /etc/mesos-master/ip, here should i write the ip of master interface ? And
> /etc/mesos-slave/ip, here i should write the ip of slave interface ?
> Your suggest seems the right one, because if i try to ping some machines
> from a network to another someone is reachable some other don't, and these
> latters sometimes, commonly at boot, are able to ping and aftwr a while
> dont.
> Thanks for your suggestion i m going to try.
> Il 19/apr/2016 03:12, "Dick Davies" <d...@hellooperator.net> ha scritto:
>
>> On our network a lot of the hosts have multiple interfaces, which let
>> some asymmetric routing
>> issues creep in that prevented our masters replying to slaves, which
>> reminded me of your symptoms.
>>
>> So we set an IP address in /etc/mesos-slave/ip and
>> /etc/mesos-master/ip so that they only listen
>> on one interface, and then check connectivity between those IPs.
>>
>> The Ansible repo we use to build the stack now has a 'signoff'
>> playbook to check network connectivity
>> is correct between the services it deploys to a new environment.
>>
>> It won't be much use to you on its own I'm afraid, but
>> here's a checklist cribbed from that playbook (ports might be
>> different in your setup).
>>
>> You can SSH to the servers and check reachability between them with
>> netcat or telnet.
>>
>>
>> zookeepers:
>>
>> - need to be able to reach each other on the election port (usually
>> tcp/3888)
>>
>> masters:
>>
>> * must be able to reach zookeepers on tcp/2181
>> * must be able to reach each other on tcp/5050
>> * must be able to reach slaves on tcp/5051
>>
>> mesos slaves:
>>
>> - must be able to reach masters on tcp/5050
>> - must be able to reach zookeepers on tcp/2181
>> - another other connectivity to services your application needs
>> (database, caches, whatever)
>>
>> I think that's it.
>>
>> On 18 April 2016 at 20:39, Stefano Bianchi <jazzist...@gmail.com> wrote:
>> > Hi Dick Davies
>> >
>> > Could you please share your solution?
>> > How did you set up mesos/Zookeeper to interconnect masters and slaves
>> among
>> > networks?
>> >
>> > Thanks a lot!
>> >
>> > 2016-04-18 20:56 GMT+02:00 Dick Davies <d...@hellooperator.net>:
>> >>
>> >> +1 for that theory, we had some screwy issues when we tried to span
>> >> subnets until we set every slave and master
>> >> to listen on a specific IP so we could tie down routing correctly.
>> >>
>> >> Saw very similar symptoms that have been described.
>> >>
>> >> On 18 April 2016 at 18:35, Alex Rukletsov <a...@mesosphere.com> wrote:
>> >> > I believe it's because slaves are able to connect to the master, but
>> the
>> >> > master is not able to connect to the slaves. That's why you see them
>> >> > connected for some time and gone afterwards.
>> >> >
>> >> > On Mon, Apr 18, 2016 at 6:47 PM, Stefano Bianchi <
>> jazzist...@gmail.com>
>> >> > wrote:
>> >> >>
>> >> >> Indeed, i dont know why, i am not able to reach all the machines
>> from a
>> >> >> network to the other, just some machines can interconnect with some
>> >> >> others
>> >> >> among the networks.
>> >> >> On mesos i see that all the slaves at a certain time are all
>> connected,
>> >> >> then disconnected and after a while connected again, it seems like
>> they
>> >> >> are
>> >> >> able to connect for a while.
>> >> >> However is an openstack issue i guess.
>> >> >>
>> >> >> Does this also happen when master3 is leading? My guess is that
>> you're
>> >> >> not
>> >> >> allowong incoming connections from master1 and master2 to slave3.
>> >> >> Generally,
>> >> >> masters should be able to connect to slaves, not just respond to
>> their
>> >> >> requests.
>> >> >>
>> >

Re: removed slace "ID": (131.154.96.172): health check timed out

2016-04-19 Thread Stefano Bianchi
Actualli the majority of these settings i have already done, out of
/etc/mesos-master/ip, here should i write the ip of master interface ? And
/etc/mesos-slave/ip, here i should write the ip of slave interface ?
Your suggest seems the right one, because if i try to ping some machines
from a network to another someone is reachable some other don't, and these
latters sometimes, commonly at boot, are able to ping and aftwr a while
dont.
Thanks for your suggestion i m going to try.
Il 19/apr/2016 03:12, "Dick Davies" <d...@hellooperator.net> ha scritto:

> On our network a lot of the hosts have multiple interfaces, which let
> some asymmetric routing
> issues creep in that prevented our masters replying to slaves, which
> reminded me of your symptoms.
>
> So we set an IP address in /etc/mesos-slave/ip and
> /etc/mesos-master/ip so that they only listen
> on one interface, and then check connectivity between those IPs.
>
> The Ansible repo we use to build the stack now has a 'signoff'
> playbook to check network connectivity
> is correct between the services it deploys to a new environment.
>
> It won't be much use to you on its own I'm afraid, but
> here's a checklist cribbed from that playbook (ports might be
> different in your setup).
>
> You can SSH to the servers and check reachability between them with
> netcat or telnet.
>
>
> zookeepers:
>
> - need to be able to reach each other on the election port (usually
> tcp/3888)
>
> masters:
>
> * must be able to reach zookeepers on tcp/2181
> * must be able to reach each other on tcp/5050
> * must be able to reach slaves on tcp/5051
>
> mesos slaves:
>
> - must be able to reach masters on tcp/5050
> - must be able to reach zookeepers on tcp/2181
> - another other connectivity to services your application needs
> (database, caches, whatever)
>
> I think that's it.
>
> On 18 April 2016 at 20:39, Stefano Bianchi <jazzist...@gmail.com> wrote:
> > Hi Dick Davies
> >
> > Could you please share your solution?
> > How did you set up mesos/Zookeeper to interconnect masters and slaves
> among
> > networks?
> >
> > Thanks a lot!
> >
> > 2016-04-18 20:56 GMT+02:00 Dick Davies <d...@hellooperator.net>:
> >>
> >> +1 for that theory, we had some screwy issues when we tried to span
> >> subnets until we set every slave and master
> >> to listen on a specific IP so we could tie down routing correctly.
> >>
> >> Saw very similar symptoms that have been described.
> >>
> >> On 18 April 2016 at 18:35, Alex Rukletsov <a...@mesosphere.com> wrote:
> >> > I believe it's because slaves are able to connect to the master, but
> the
> >> > master is not able to connect to the slaves. That's why you see them
> >> > connected for some time and gone afterwards.
> >> >
> >> > On Mon, Apr 18, 2016 at 6:47 PM, Stefano Bianchi <
> jazzist...@gmail.com>
> >> > wrote:
> >> >>
> >> >> Indeed, i dont know why, i am not able to reach all the machines
> from a
> >> >> network to the other, just some machines can interconnect with some
> >> >> others
> >> >> among the networks.
> >> >> On mesos i see that all the slaves at a certain time are all
> connected,
> >> >> then disconnected and after a while connected again, it seems like
> they
> >> >> are
> >> >> able to connect for a while.
> >> >> However is an openstack issue i guess.
> >> >>
> >> >> Does this also happen when master3 is leading? My guess is that
> you're
> >> >> not
> >> >> allowong incoming connections from master1 and master2 to slave3.
> >> >> Generally,
> >> >> masters should be able to connect to slaves, not just respond to
> their
> >> >> requests.
> >> >>
> >> >> On 18 Apr 2016 13:17, "Stefano Bianchi" <jazzist...@gmail.com>
> wrote:
> >> >>>
> >> >>> Hi
> >> >>> On openstack i plugged two virtual networks to the same virtual
> router
> >> >>> so
> >> >>> that the hosts on the 2 networks can communicate each other.
> >> >>> this is my topology:
> >> >>>
> >> >>> ---internet---
> >> >>> |
> >> >>>Router1
> >> >>> |
> 

Re: removed slace "ID": (131.154.96.172): health check timed out

2016-04-18 Thread Stefano Bianchi
Hi Dick Davies

Could you please share your solution?
How did you set up mesos/Zookeeper to interconnect masters and slaves among
networks?

Thanks a lot!

2016-04-18 20:56 GMT+02:00 Dick Davies <d...@hellooperator.net>:

> +1 for that theory, we had some screwy issues when we tried to span
> subnets until we set every slave and master
> to listen on a specific IP so we could tie down routing correctly.
>
> Saw very similar symptoms that have been described.
>
> On 18 April 2016 at 18:35, Alex Rukletsov <a...@mesosphere.com> wrote:
> > I believe it's because slaves are able to connect to the master, but the
> > master is not able to connect to the slaves. That's why you see them
> > connected for some time and gone afterwards.
> >
> > On Mon, Apr 18, 2016 at 6:47 PM, Stefano Bianchi <jazzist...@gmail.com>
> > wrote:
> >>
> >> Indeed, i dont know why, i am not able to reach all the machines from a
> >> network to the other, just some machines can interconnect with some
> others
> >> among the networks.
> >> On mesos i see that all the slaves at a certain time are all connected,
> >> then disconnected and after a while connected again, it seems like they
> are
> >> able to connect for a while.
> >> However is an openstack issue i guess.
> >>
> >> Does this also happen when master3 is leading? My guess is that you're
> not
> >> allowong incoming connections from master1 and master2 to slave3.
> Generally,
> >> masters should be able to connect to slaves, not just respond to their
> >> requests.
> >>
> >> On 18 Apr 2016 13:17, "Stefano Bianchi" <jazzist...@gmail.com> wrote:
> >>>
> >>> Hi
> >>> On openstack i plugged two virtual networks to the same virtual router
> so
> >>> that the hosts on the 2 networks can communicate each other.
> >>> this is my topology:
> >>>
> >>> ---internet---
> >>> |
> >>>Router1
> >>> |
> >>> 
> >>> | |
> >>> Net1Net2
> >>> Master1 Master2 Master3
> >>> Slave1 slave2  Slave3
> >>>
> >>> I have set zookeeper in with this line:
> >>>
> >>> zk://Master1_IP:2181,Master2_IP:2181,Master3_IP:2181/mesos
> >>>
> >>> The 3 masters, even though on 2 separated networks, elect the leader
> >>> correclty.
> >>> Now i have started the slaves, and in a first time i see all 3
> correctly
> >>> registered, but after a while the slave 3, independently form who is
> the
> >>> master, disconnects.
> >>> I saw in the log and i get the message in the object.
> >>> Can you help me to solve this problem?
> >>>
> >>>
> >>> Thanks to all.
> >
> >
>


Re: removed slace "ID": (131.154.96.172): health check timed out

2016-04-18 Thread Stefano Bianchi
Indeed, i dont know why, i am not able to reach all the machines from a
network to the other, just some machines can interconnect with some others
among the networks.
On mesos i see that all the slaves at a certain time are all connected,
then disconnected and after a while connected again, it seems like they are
able to connect for a while.
However is an openstack issue i guess.

Does this also happen when master3 is leading? My guess is that you're not
allowong incoming connections from master1 and master2 to slave3.
Generally, masters should be able to connect to slaves, not just respond to
their requests.
On 18 Apr 2016 13:17, "Stefano Bianchi" <jazzist...@gmail.com> wrote:

> Hi
> On openstack i plugged two virtual networks to the same virtual router so
> that the hosts on the 2 networks can communicate each other.
> this is my topology:
>
> ---internet---
> |
>Router1
> |
> 
> | |
> Net1Net2
> Master1 Master2 Master3
> Slave1 slave2  Slave3
>
> I have set zookeeper in with this line:
>
> zk://Master1_IP:2181,Master2_IP:2181,Master3_IP:2181/mesos
>
> The 3 masters, even though on 2 separated networks, elect the leader
> correclty.
> Now i have started the slaves, and in a first time i see all 3 correctly
> registered, but after a while the slave 3, independently form who is the
> master, disconnects.
> I saw in the log and i get the message in the object.
> Can you help me to solve this problem?
>
>
> Thanks to all.
>


removed slace "ID": (131.154.96.172): health check timed out

2016-04-18 Thread Stefano Bianchi
Hi
On openstack i plugged two virtual networks to the same virtual router so
that the hosts on the 2 networks can communicate each other.
this is my topology:

---internet---
|
   Router1
|

| |
Net1Net2
Master1 Master2 Master3
Slave1 slave2  Slave3

I have set zookeeper in with this line:

zk://Master1_IP:2181,Master2_IP:2181,Master3_IP:2181/mesos

The 3 masters, even though on 2 separated networks, elect the leader
correclty.
Now i have started the slaves, and in a first time i see all 3 correctly
registered, but after a while the slave 3, independently form who is the
master, disconnects.
I saw in the log and i get the message in the object.
Can you help me to solve this problem?


Thanks to all.


Re: Mesos Clusters on different Network

2016-04-15 Thread Stefano Bianchi
Maybe i found a solution is an openstack isshe.
Probably i need jus to use the same virtual router for both netwoks.
I will keep you updated
Il 15/apr/2016 10:30, "Stefano Bianchi" <jazzist...@gmail.com> ha scritto:

> Hi
>
> I already asked this question but idecided to open a new topic since where
> i wrote before were not the correspondent topic.
>
> So, as many of you have already understood, i'm working on openstack,
> where there is not a DNS.
> I have made 2 networks, NetA and NetB, on each of them there is a mesos
> cluster.
> I would like to connect them, im using zookeeper for the masters
> coordination and slaves registratuons.
> My question is, if i have a DNS which make all the machines on NetA and
> NetB communicating each other, pinging them or telnet or ssh, configuring
> zookeeper files with private IP can i reach the condition of distributed
> mesos clusters?
> Il 15/apr/2016 04:05, "Rodrick Brown" <rodr...@orchard-app.com> ha
> scritto:
>
>> I have hundreds of small spark jobs running on my Mesos cluster
>> causing starvation to other frameworks like Marathon on my cluster.
>>
>> Is their a way to prevent these frameworks from getting offers so often?
>>
>> Apr 15 02:00:12 prod-mesos-m-3.$SERVER.com mesos-master[10259]: I0415
>> 02:00:12.503734 10266 master.cpp:3641] Processing DECLINE call for offers:
>> [ 50ceafa4-f3c1-4738-a9eb-c5d3bf0ff742-O7112667 ] for
>> framework 50ceafa4-f3c1-4738-a9eb-c5d3bf0ff742-15936 
>> (KafkaDirectConsumer[trades-topic])
>> at scheduler-9e557d33-e4a4-44ce-9dbe-0a7ca7c4842d@172.1.121.183:34858.
>>
>>
>>
>>
>>
>> --
>>
>> *Rodrick Brown* / Systems Engineer
>>
>> +1 917 445 6839 / rodr...@orchardplatform.com
>> <char...@orchardplatform.com>
>>
>> *Orchard Platform*
>>
>> 101 5th Avenue, 4th Floor, New York, NY 10003
>>
>> http://www.orchardplatform.com
>>
>> Orchard Blog <http://www.orchardplatform.com/blog/> | Marketplace
>> Lending Meetup <http://www.meetup.com/Peer-to-Peer-Lending-P2P/>
>>
>> *NOTICE TO RECIPIENTS*: This communication is confidential and intended
>> for the use of the addressee only. If you are not an intended recipient of
>> this communication, please delete it immediately and notify the sender
>> by return email. Unauthorized reading, dissemination, distribution or
>> copying of this communication is prohibited. This communication does not 
>> constitute
>> an offer to sell or a solicitation of an indication of interest to purchase
>> any loan, security or any other financial product or instrument, nor is it
>> an offer to sell or a solicitation of an indication of interest to purchase
>> any products or services to any persons who are prohibited from receiving
>> such information under applicable law. The contents of this communication
>> may not be accurate or complete and are subject to change without notice.
>> As such, Orchard App, Inc. (including its subsidiaries and affiliates,
>> "Orchard") makes no representation regarding the accuracy or
>> completeness of the information contained herein. The intended recipient is
>> advised to consult its own professional advisors, including those
>> specializing in legal, tax and accounting matters. Orchard does not
>> provide legal, tax or accounting advice.
>>
>


Mesos Clusters on different Network

2016-04-15 Thread Stefano Bianchi
Hi

I already asked this question but idecided to open a new topic since where
i wrote before were not the correspondent topic.

So, as many of you have already understood, i'm working on openstack, where
there is not a DNS.
I have made 2 networks, NetA and NetB, on each of them there is a mesos
cluster.
I would like to connect them, im using zookeeper for the masters
coordination and slaves registratuons.
My question is, if i have a DNS which make all the machines on NetA and
NetB communicating each other, pinging them or telnet or ssh, configuring
zookeeper files with private IP can i reach the condition of distributed
mesos clusters?
Il 15/apr/2016 04:05, "Rodrick Brown"  ha scritto:

> I have hundreds of small spark jobs running on my Mesos cluster
> causing starvation to other frameworks like Marathon on my cluster.
>
> Is their a way to prevent these frameworks from getting offers so often?
>
> Apr 15 02:00:12 prod-mesos-m-3.$SERVER.com mesos-master[10259]: I0415
> 02:00:12.503734 10266 master.cpp:3641] Processing DECLINE call for offers:
> [ 50ceafa4-f3c1-4738-a9eb-c5d3bf0ff742-O7112667 ] for
> framework 50ceafa4-f3c1-4738-a9eb-c5d3bf0ff742-15936 
> (KafkaDirectConsumer[trades-topic])
> at scheduler-9e557d33-e4a4-44ce-9dbe-0a7ca7c4842d@172.1.121.183:34858.
>
>
>
>
>
> --
>
> *Rodrick Brown* / Systems Engineer
>
> +1 917 445 6839 / rodr...@orchardplatform.com
> 
>
> *Orchard Platform*
>
> 101 5th Avenue, 4th Floor, New York, NY 10003
>
> http://www.orchardplatform.com
>
> Orchard Blog  | Marketplace Lending
> Meetup 
>
> *NOTICE TO RECIPIENTS*: This communication is confidential and intended
> for the use of the addressee only. If you are not an intended recipient of
> this communication, please delete it immediately and notify the sender by
> return email. Unauthorized reading, dissemination, distribution or copying
> of this communication is prohibited. This communication does not constitute
> an offer to sell or a solicitation of an indication of interest to purchase
> any loan, security or any other financial product or instrument, nor is it
> an offer to sell or a solicitation of an indication of interest to purchase
> any products or services to any persons who are prohibited from receiving
> such information under applicable law. The contents of this communication
> may not be accurate or complete and are subject to change without notice.
> As such, Orchard App, Inc. (including its subsidiaries and affiliates,
> "Orchard") makes no representation regarding the accuracy or completeness
> of the information contained herein. The intended recipient is advised to
> consult its own professional advisors, including those specializing in
> legal, tax and accounting matters. Orchard does not provide legal, tax or
> accounting advice.
>


Re: Mesos-DNS Failed to connect to...

2016-04-14 Thread Stefano Bianchi
shakeel

Dig command are perfectly working, i see the correct address on which i
have mesos-dns running
Unfortunately in the openstack environment where i am working there is not
a DNS.
And this miss it's causing me a lot a issues also for other stuff.

2016-04-14 15:22 GMT+02:00 shakeel <shakeel.suf...@motortrak.com>:

> Hi,
>
> Once you have mesos-dns running from marathon, test that it's working
> properly with dig.
>
> (You migth want to add you main dns servers as resolvers within the
> mesos-dns config and allow recursion.)
>
> Otherwise, configure you slaves to use the mesos-dns as their dns servers.
>
> I created a subdomain on my main dns server for the mesos-dns subdomain
> which points to the slave where mesos-dns is running.
>
> This way when you try to access the mesos-dns url from your browser, you
> main dns server will know where to forward the request.
>
> HTH.
>
> Kind Regards
> Shakeel Suffee
>
> On 14/04/16 14:06, Chris Baker wrote:
> > Also, make sure that the machine you're trying to launch from has
> > Mesos-DNS as its DNS server :)
> >
> > On Thu, Apr 14, 2016 at 3:33 AM Stefano Bianchi <jazzist...@gmail.com
> > <mailto:jazzist...@gmail.com>> wrote:
> >
> > Im correctly running mesos-dns from marathon and it seems to work.
> > But when i launch:
> >
> > http://test.marathon.mesos
> >
> > (where test is a funning task on marathon)
> >
> > I get:
> >
> > curl: (7) Failed connect to test.marathon.mesos:80; Connection
> refused
> >
> > Where am i wrong?
> >
> > Il 13/apr/2016 17:46, "June Taylor" <j...@umn.edu
> > <mailto:j...@umn.edu>> ha scritto:
> >
> > We are running pyspark against our cluster in coarse-grained
> > mode by specifying the --master mesos://host:5050 flag, which
> > properly creates one task on each node.
> >
> > However, if the driver is shut down, it appears that these
> > executors become orphaned_tasks, still consuming resources on
> > the slave, but no longer being represented in the master's
> > understanding of available resources.
> >
> > Examining the stdout/stderr shows it exited:
> >
> > Registered executor on node4
> > Starting task 0
> > sh -c 'cd spark-1*;  ./bin/spark-class
> > org.apache.spark.executor.CoarseGrainedExecutorBackend
> > --driver-url
> > spark://CoarseGrainedScheduler@128.101.163.200:41563
> > <http://CoarseGrainedScheduler@128.101.163.200:41563>
> > --executor-id aa1337b6-43b0-4236-b445-c8ccbfb60506-S2/0
> > --hostname node4 --cores 31 --app-id
> > aa1337b6-43b0-4236-b445-c8ccbfb60506-0097'
> > Forked command at 117620
> > Command exited with status 1 (pid: 117620)
> >
> > But, these executors are remaining on all the slaves.
> >
> > What can we do to clear them out? Stopping mesos-slave and
> > removing the full work-dir is successful, but also destroys our
> > other tasks.
> >
> > Thanks,
> > June Taylor
> > System Administrator, Minnesota Population Center
> > University of Minnesota
> >
>
> --
> The information contained in this message is for the intended addressee
> only and may contain confidential and/or privileged information. If you are
> not the intended addressee, please delete this message and notify the
> sender; do not copy or distribute this message or disclose its contents to
> anyone. Any views or opinions expressed in this message are those of the
> author and do not necessarily represent those of Motortrak Limited or of
> any of its associated companies. No reliance may be placed on this message
> without written confirmation from an authorised representative of the
> company.
>
> Registered in England 3098391 V.A.T. Registered No. 667463890
>


Re: Mesos Masters Leader Keeps Fluctuating

2016-04-14 Thread Stefano Bianchi
Ok please follow me in this strange story.
At the beginning i have set 3 mesos master on the same cluster using mesos
0.27
now i deleted one of these 3 mesos 0.27 masters and build a mesos 0.28 to
joint to the other 2.
I get the problem i described after 10 seconds i get failed to connect, but
the election of new one works fine because the new leader is 0.27 which is
stable.
How to send to you logs?

2016-04-13 23:53 GMT+02:00 Adam Bordelon <a...@mesosphere.io>:

> See also http://mesos.apache.org/documentation/latest/operational-guide/
>
> On Wed, Apr 13, 2016 at 2:44 PM, Adam Bordelon <a...@mesosphere.io> wrote:
>
>> Having 2 masters (even with a quorum of 2) is no more useful than having
>> a single master, since if one of your 2 masters goes down you lose quorum,
>> and your cluster will fail to recover, since it cannot write state changes
>> to both masters.
>>
>> Setting the quorum to 1 for a cluster with 2 masters would expose you to
>> potential split-brain problems, in case of a network partition. You would
>> then have 2 masters that each think they are the leader, and they would be
>> unable to reconcile their differences if the partition ends and they
>> reconnect to each other.
>>
>> It is intended that you will have an odd number of masters (similar to
>> the requirement to have an odd number of ZKs), and quorum =
>> ceiling(numMasters / 2); so you would have 1 master (quorum=1), 3 masters
>> (quorum=2), or 5 masters (quorum=3).
>>
>> On Wed, Apr 13, 2016 at 8:44 AM, haosdent <haosd...@gmail.com> wrote:
>>
>>> It sounds like an issue in 0.28. I create a ticket
>>> https://issues.apache.org/jira/browse/MESOS-5207 from this to continue
>>> to
>>>  investigate. If @suruchi you could attach logs of mesos masters and
>>> your zookeeper configuration, I think it would more helpful for
>>> investigating.
>>>
>>> On Wed, Apr 13, 2016 at 8:24 PM, Stefano Bianchi <jazzist...@gmail.com>
>>> wrote:
>>>
>>>> Thanks for your reply @haosdent.
>>>> I destroyed my VM and re build mesos 0.28 with just one master, and now
>>>> is working.
>>>> i will try to add another master but for the moment, since on openstack
>>>> i don't have much resources i need to use that VM as a slave.
>>>> However in the previous configuration the switch between two masters
>>>> was ok, just when the master was leading after, more or less 30 seconds,
>>>> there was that Failed to connect message.
>>>>
>>>> 2016-04-13 13:08 GMT+02:00 haosdent <haosd...@gmail.com>:
>>>>
>>>>> Hi, @Stefano Could you show conf/zoo.cfg? And how many zookeper nodes
>>>>> you haved? And "but after a while again Failed to connec"​, how long
>>>>> the interval here? Is it always "few seconds"?
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Best Regards,
>>> Haosdent Huang
>>>
>>
>>
>


Mesos-DNS Failed to connect to...

2016-04-14 Thread Stefano Bianchi
Im correctly running mesos-dns from marathon and it seems to work.
But when i launch:

http://test.marathon.mesos

(where test is a funning task on marathon)

I get:

curl: (7) Failed connect to test.marathon.mesos:80; Connection refused

Where am i wrong?
Il 13/apr/2016 17:46, "June Taylor"  ha scritto:

> We are running pyspark against our cluster in coarse-grained mode by
> specifying the --master mesos://host:5050 flag, which properly creates
> one task on each node.
>
> However, if the driver is shut down, it appears that these executors
> become orphaned_tasks, still consuming resources on the slave, but no
> longer being represented in the master's understanding of available
> resources.
>
> Examining the stdout/stderr shows it exited:
>
> Registered executor on node4
> Starting task 0
> sh -c 'cd spark-1*;  ./bin/spark-class
> org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url spark://
> CoarseGrainedScheduler@128.101.163.200:41563 --executor-id
> aa1337b6-43b0-4236-b445-c8ccbfb60506-S2/0 --hostname node4 --cores 31
> --app-id aa1337b6-43b0-4236-b445-c8ccbfb60506-0097'
> Forked command at 117620
> Command exited with status 1 (pid: 117620)
>
> But, these executors are remaining on all the slaves.
>
> What can we do to clear them out? Stopping mesos-slave and removing the
> full work-dir is successful, but also destroys our other tasks.
>
> Thanks,
> June Taylor
> System Administrator, Minnesota Population Center
> University of Minnesota
>


Re: Mesos interconnection among clusters project calico

2016-04-13 Thread Stefano Bianchi
I found it sorry :-)

2016-04-14 0:23 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> Thanks Jeff.
> Sorry i am not sufficiently familiar with mesos mailing list, where i can
> find the jira issue you are talking about?
>
> Thanks again.
>
> 2016-04-13 23:23 GMT+02:00 Jeff Schroeder <jeffschroe...@computer.org>:
>
>> Stefano, you might also follow the jira issue MESOS-3548, which is for
>> mesos to support federation amongst multiple clusters natively.
>>
>>
>> On Wednesday, April 13, 2016, Stefano Bianchi <jazzist...@gmail.com>
>> wrote:
>>
>>> Ah ok.
>>> No problem.
>>> See you and best regards!!!
>>> Il 13/apr/2016 21:09, "June Taylor" <j...@umn.edu> ha scritto:
>>>
>>>> Stefano,
>>>>
>>>> We are not currently using CoreOS - it just seemed that it had a
>>>> feature you're looking for. We are new to Mesos as well. I apologize that I
>>>> cannot be more helpful.
>>>>
>>>>
>>>> Thanks,
>>>> June Taylor
>>>> System Administrator, Minnesota Population Center
>>>> University of Minnesota
>>>>
>>>> On Wed, Apr 13, 2016 at 2:07 PM, Stefano Bianchi <jazzist...@gmail.com>
>>>> wrote:
>>>>
>>>>> June Taylor, is there another channel on which i can contact you?
>>>>> Since i am a simple student doing his master thesis on mesos/calico, i
>>>>> need all the support possible :P
>>>>> I already have of course from my supervisor and advisor, but sometimes
>>>>> is better have discussions with more skilled people.
>>>>>
>>>>> 2016-04-13 17:33 GMT+02:00 June Taylor <j...@umn.edu>:
>>>>>
>>>>>> Stefano,
>>>>>>
>>>>>> That's the feature, yes.
>>>>>>
>>>>>> Unfortunately I don't know the answer to your questions further.
>>>>>>
>>>>>>
>>>>>> Thanks,
>>>>>> June Taylor
>>>>>> System Administrator, Minnesota Population Center
>>>>>> University of Minnesota
>>>>>>
>>>>>> On Wed, Apr 13, 2016 at 10:26 AM, Stefano Bianchi <
>>>>>> jazzist...@gmail.com> wrote:
>>>>>>
>>>>>>> Thanks to your reply June.
>>>>>>>
>>>>>>> You mean this feature?
>>>>>>> https://coreos.com/etcd/docs/latest/clustering.html
>>>>>>> Because for sure i know that calico exploit etcd as datastore, but i
>>>>>>> need to know if, and if yes how, i can manage etcd as DNS.
>>>>>>>
>>>>>>> 2016-04-13 15:04 GMT+02:00 June Taylor <j...@umn.edu>:
>>>>>>>
>>>>>>>> Stefano,
>>>>>>>>
>>>>>>>> We are exploring CoreOS, and I believe it has the feature you're
>>>>>>>> looking for.
>>>>>>>>
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> June Taylor
>>>>>>>> System Administrator, Minnesota Population Center
>>>>>>>> University of Minnesota
>>>>>>>>
>>>>>>>> On Tue, Apr 12, 2016 at 5:35 PM, Stefano Bianchi <
>>>>>>>> jazzist...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi all
>>>>>>>>>
>>>>>>>>> i have to set up two mesos clusters.
>>>>>>>>> On each cluster i should integrate Project calico in order to
>>>>>>>>> distribute tasks among the agents. But these tasks should be sent 
>>>>>>>>> also from
>>>>>>>>> a slave of one cluster to the slave of the other cluster.
>>>>>>>>> I know that when i start calico on each slaves, it registers the
>>>>>>>>> hosts to the ETCD_AUTHORITY so calico use etcd.
>>>>>>>>> In order to have interconnection among 2 mesos clusters, i should
>>>>>>>>> have the same etcd datastore for both my Mesos/Calico clusters.
>>>>>>>>> Someone knows how to reach this condition?
>>>>>>>>>
>>>>>>>>> Thanks in advance
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>
>> --
>> Text by Jeff, typos by iPhone
>>
>
>


Re: Mesos interconnection among clusters project calico

2016-04-13 Thread Stefano Bianchi
Thanks Jeff.
Sorry i am not sufficiently familiar with mesos mailing list, where i can
find the jira issue you are talking about?

Thanks again.

2016-04-13 23:23 GMT+02:00 Jeff Schroeder <jeffschroe...@computer.org>:

> Stefano, you might also follow the jira issue MESOS-3548, which is for
> mesos to support federation amongst multiple clusters natively.
>
>
> On Wednesday, April 13, 2016, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> Ah ok.
>> No problem.
>> See you and best regards!!!
>> Il 13/apr/2016 21:09, "June Taylor" <j...@umn.edu> ha scritto:
>>
>>> Stefano,
>>>
>>> We are not currently using CoreOS - it just seemed that it had a feature
>>> you're looking for. We are new to Mesos as well. I apologize that I cannot
>>> be more helpful.
>>>
>>>
>>> Thanks,
>>> June Taylor
>>> System Administrator, Minnesota Population Center
>>> University of Minnesota
>>>
>>> On Wed, Apr 13, 2016 at 2:07 PM, Stefano Bianchi <jazzist...@gmail.com>
>>> wrote:
>>>
>>>> June Taylor, is there another channel on which i can contact you?
>>>> Since i am a simple student doing his master thesis on mesos/calico, i
>>>> need all the support possible :P
>>>> I already have of course from my supervisor and advisor, but sometimes
>>>> is better have discussions with more skilled people.
>>>>
>>>> 2016-04-13 17:33 GMT+02:00 June Taylor <j...@umn.edu>:
>>>>
>>>>> Stefano,
>>>>>
>>>>> That's the feature, yes.
>>>>>
>>>>> Unfortunately I don't know the answer to your questions further.
>>>>>
>>>>>
>>>>> Thanks,
>>>>> June Taylor
>>>>> System Administrator, Minnesota Population Center
>>>>> University of Minnesota
>>>>>
>>>>> On Wed, Apr 13, 2016 at 10:26 AM, Stefano Bianchi <
>>>>> jazzist...@gmail.com> wrote:
>>>>>
>>>>>> Thanks to your reply June.
>>>>>>
>>>>>> You mean this feature?
>>>>>> https://coreos.com/etcd/docs/latest/clustering.html
>>>>>> Because for sure i know that calico exploit etcd as datastore, but i
>>>>>> need to know if, and if yes how, i can manage etcd as DNS.
>>>>>>
>>>>>> 2016-04-13 15:04 GMT+02:00 June Taylor <j...@umn.edu>:
>>>>>>
>>>>>>> Stefano,
>>>>>>>
>>>>>>> We are exploring CoreOS, and I believe it has the feature you're
>>>>>>> looking for.
>>>>>>>
>>>>>>>
>>>>>>> Thanks,
>>>>>>> June Taylor
>>>>>>> System Administrator, Minnesota Population Center
>>>>>>> University of Minnesota
>>>>>>>
>>>>>>> On Tue, Apr 12, 2016 at 5:35 PM, Stefano Bianchi <
>>>>>>> jazzist...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi all
>>>>>>>>
>>>>>>>> i have to set up two mesos clusters.
>>>>>>>> On each cluster i should integrate Project calico in order to
>>>>>>>> distribute tasks among the agents. But these tasks should be sent also 
>>>>>>>> from
>>>>>>>> a slave of one cluster to the slave of the other cluster.
>>>>>>>> I know that when i start calico on each slaves, it registers the
>>>>>>>> hosts to the ETCD_AUTHORITY so calico use etcd.
>>>>>>>> In order to have interconnection among 2 mesos clusters, i should
>>>>>>>> have the same etcd datastore for both my Mesos/Calico clusters.
>>>>>>>> Someone knows how to reach this condition?
>>>>>>>>
>>>>>>>> Thanks in advance
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>
> --
> Text by Jeff, typos by iPhone
>


Re: Mesos Master and Slave on same server?

2016-04-13 Thread Stefano Bianchi
I have set an HA cluster.
3 mesos slaves with one leader and quorum 2.
3 mesos slaves.
I can easily start tasks from marathon.
The common way is set the slaves on other machines.
However if you are running the mesos-slave service also on the master is it
not a problem.

2016-04-13 19:24 GMT+02:00 Paul Bell <arach...@gmail.com>:

> Hi June,
>
> In addition to doing what Pradeep suggests, I also now & then run a single
> node "cluster" that houses mesos-master, mesos-slave, and Marathon.
>
> Works fine.
>
> Cordially,
>
> Paul
>
> On Wed, Apr 13, 2016 at 12:36 PM, Pradeep Chhetri <
> pradeep.chhetr...@gmail.com> wrote:
>
>> I would suggest you to run mesos-master and zookeeper and marathon on
>> same set of hosts (maybe call them as coordinator nodes) and use completely
>> different set of nodes for mesos slaves. This way you can do the
>> maintenance of such hosts in a very planned fashion.
>>
>> On Wed, Apr 13, 2016 at 4:22 PM, Stefano Bianchi <jazzist...@gmail.com>
>> wrote:
>>
>>> For sure it is possible.
>>> Simply Mesos-master will the the resources offered by the machine on
>>> which is running mesos-slave also, transparently.
>>>
>>> 2016-04-13 16:34 GMT+02:00 June Taylor <j...@umn.edu>:
>>>
>>>> All of our node servers are identical hardware. Is it reasonable for me
>>>> to install the Mesos-Master and Mesos-Slave on the same physical hardware?
>>>>
>>>> Thanks,
>>>> June Taylor
>>>> System Administrator, Minnesota Population Center
>>>> University of Minnesota
>>>>
>>>
>>>
>>
>>
>> --
>> Regards,
>> Pradeep Chhetri
>>
>
>


Re: Mesos interconnection among clusters project calico

2016-04-13 Thread Stefano Bianchi
Ah ok.
No problem.
See you and best regards!!!
Il 13/apr/2016 21:09, "June Taylor" <j...@umn.edu> ha scritto:

> Stefano,
>
> We are not currently using CoreOS - it just seemed that it had a feature
> you're looking for. We are new to Mesos as well. I apologize that I cannot
> be more helpful.
>
>
> Thanks,
> June Taylor
> System Administrator, Minnesota Population Center
> University of Minnesota
>
> On Wed, Apr 13, 2016 at 2:07 PM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> June Taylor, is there another channel on which i can contact you?
>> Since i am a simple student doing his master thesis on mesos/calico, i
>> need all the support possible :P
>> I already have of course from my supervisor and advisor, but sometimes is
>> better have discussions with more skilled people.
>>
>> 2016-04-13 17:33 GMT+02:00 June Taylor <j...@umn.edu>:
>>
>>> Stefano,
>>>
>>> That's the feature, yes.
>>>
>>> Unfortunately I don't know the answer to your questions further.
>>>
>>>
>>> Thanks,
>>> June Taylor
>>> System Administrator, Minnesota Population Center
>>> University of Minnesota
>>>
>>> On Wed, Apr 13, 2016 at 10:26 AM, Stefano Bianchi <jazzist...@gmail.com>
>>> wrote:
>>>
>>>> Thanks to your reply June.
>>>>
>>>> You mean this feature?
>>>> https://coreos.com/etcd/docs/latest/clustering.html
>>>> Because for sure i know that calico exploit etcd as datastore, but i
>>>> need to know if, and if yes how, i can manage etcd as DNS.
>>>>
>>>> 2016-04-13 15:04 GMT+02:00 June Taylor <j...@umn.edu>:
>>>>
>>>>> Stefano,
>>>>>
>>>>> We are exploring CoreOS, and I believe it has the feature you're
>>>>> looking for.
>>>>>
>>>>>
>>>>> Thanks,
>>>>> June Taylor
>>>>> System Administrator, Minnesota Population Center
>>>>> University of Minnesota
>>>>>
>>>>> On Tue, Apr 12, 2016 at 5:35 PM, Stefano Bianchi <jazzist...@gmail.com
>>>>> > wrote:
>>>>>
>>>>>> Hi all
>>>>>>
>>>>>> i have to set up two mesos clusters.
>>>>>> On each cluster i should integrate Project calico in order to
>>>>>> distribute tasks among the agents. But these tasks should be sent also 
>>>>>> from
>>>>>> a slave of one cluster to the slave of the other cluster.
>>>>>> I know that when i start calico on each slaves, it registers the
>>>>>> hosts to the ETCD_AUTHORITY so calico use etcd.
>>>>>> In order to have interconnection among 2 mesos clusters, i should
>>>>>> have the same etcd datastore for both my Mesos/Calico clusters.
>>>>>> Someone knows how to reach this condition?
>>>>>>
>>>>>> Thanks in advance
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>


Re: Mesos interconnection among clusters project calico

2016-04-13 Thread Stefano Bianchi
June Taylor, is there another channel on which i can contact you?
Since i am a simple student doing his master thesis on mesos/calico, i need
all the support possible :P
I already have of course from my supervisor and advisor, but sometimes is
better have discussions with more skilled people.

2016-04-13 17:33 GMT+02:00 June Taylor <j...@umn.edu>:

> Stefano,
>
> That's the feature, yes.
>
> Unfortunately I don't know the answer to your questions further.
>
>
> Thanks,
> June Taylor
> System Administrator, Minnesota Population Center
> University of Minnesota
>
> On Wed, Apr 13, 2016 at 10:26 AM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> Thanks to your reply June.
>>
>> You mean this feature?
>> https://coreos.com/etcd/docs/latest/clustering.html
>> Because for sure i know that calico exploit etcd as datastore, but i need
>> to know if, and if yes how, i can manage etcd as DNS.
>>
>> 2016-04-13 15:04 GMT+02:00 June Taylor <j...@umn.edu>:
>>
>>> Stefano,
>>>
>>> We are exploring CoreOS, and I believe it has the feature you're looking
>>> for.
>>>
>>>
>>> Thanks,
>>> June Taylor
>>> System Administrator, Minnesota Population Center
>>> University of Minnesota
>>>
>>> On Tue, Apr 12, 2016 at 5:35 PM, Stefano Bianchi <jazzist...@gmail.com>
>>> wrote:
>>>
>>>> Hi all
>>>>
>>>> i have to set up two mesos clusters.
>>>> On each cluster i should integrate Project calico in order to
>>>> distribute tasks among the agents. But these tasks should be sent also from
>>>> a slave of one cluster to the slave of the other cluster.
>>>> I know that when i start calico on each slaves, it registers the hosts
>>>> to the ETCD_AUTHORITY so calico use etcd.
>>>> In order to have interconnection among 2 mesos clusters, i should have the
>>>> same etcd datastore for both my Mesos/Calico clusters.
>>>> Someone knows how to reach this condition?
>>>>
>>>> Thanks in advance
>>>>
>>>>
>>>
>>
>


Re: Mesos interconnection among clusters project calico

2016-04-13 Thread Stefano Bianchi
Thanks to your reply June.

You mean this feature?
https://coreos.com/etcd/docs/latest/clustering.html
Because for sure i know that calico exploit etcd as datastore, but i need
to know if, and if yes how, i can manage etcd as DNS.

2016-04-13 15:04 GMT+02:00 June Taylor <j...@umn.edu>:

> Stefano,
>
> We are exploring CoreOS, and I believe it has the feature you're looking
> for.
>
>
> Thanks,
> June Taylor
> System Administrator, Minnesota Population Center
> University of Minnesota
>
> On Tue, Apr 12, 2016 at 5:35 PM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> Hi all
>>
>> i have to set up two mesos clusters.
>> On each cluster i should integrate Project calico in order to distribute
>> tasks among the agents. But these tasks should be sent also from a slave of
>> one cluster to the slave of the other cluster.
>> I know that when i start calico on each slaves, it registers the hosts to
>> the ETCD_AUTHORITY so calico use etcd.
>> In order to have interconnection among 2 mesos clusters, i should have the
>> same etcd datastore for both my Mesos/Calico clusters.
>> Someone knows how to reach this condition?
>>
>> Thanks in advance
>>
>>
>


Re: Mesos Master and Slave on same server?

2016-04-13 Thread Stefano Bianchi
For sure it is possible.
Simply Mesos-master will the the resources offered by the machine on which
is running mesos-slave also, transparently.

2016-04-13 16:34 GMT+02:00 June Taylor :

> All of our node servers are identical hardware. Is it reasonable for me to
> install the Mesos-Master and Mesos-Slave on the same physical hardware?
>
> Thanks,
> June Taylor
> System Administrator, Minnesota Population Center
> University of Minnesota
>


Re: Mesos Masters Leader Keeps Fluctuating

2016-04-13 Thread Stefano Bianchi
Thanks for your reply @haosdent.
I destroyed my VM and re build mesos 0.28 with just one master, and now is
working.
i will try to add another master but for the moment, since on openstack i
don't have much resources i need to use that VM as a slave.
However in the previous configuration the switch between two masters was
ok, just when the master was leading after, more or less 30 seconds, there
was that Failed to connect message.

2016-04-13 13:08 GMT+02:00 haosdent :

> Hi, @Stefano Could you show conf/zoo.cfg? And how many zookeper nodes you
> haved? And "but after a while again Failed to connec"​, how long the
> interval here? Is it always "few seconds"?
>


Mesos interconnection among clusters project calico

2016-04-12 Thread Stefano Bianchi
Hi all

i have to set up two mesos clusters.
On each cluster i should integrate Project calico in order to distribute
tasks among the agents. But these tasks should be sent also from a slave of
one cluster to the slave of the other cluster.
I know that when i start calico on each slaves, it registers the hosts to
the ETCD_AUTHORITY so calico use etcd.
In order to have interconnection among 2 mesos clusters, i should have the
same etcd datastore for both my Mesos/Calico clusters.
Someone knows how to reach this condition?

Thanks in advance


Re: how to change mesos resources

2016-04-10 Thread Stefano Bianchi
YS haosdent!
that exactly works! And is exactly what i mean!!! Thank you a lot, thank
you all, and sorry if i asked you so many times.

Maybe is better if i present myself to you.

My name is Stefano Bianchi, Italian student of Telecommunication
engineering, i'm currently doing my master thesis at INFN European Nuclear
physics institute in Bologna city. I'm working on Tier 1 CNAF
infrastructure where the cloud infrastructure is based on an Openstack IaaS.
Here i have run 6 virtual machines 3 masters, for high availability, and 3
slaves, on one slave i'm running mesos DNS.
the final goal should be the implementation of a PaaS for science European
community which allows the exploitation of distributed datacenter resources
for some computations or experiments. For this purpose i have to integrate
projcect calico plugin in on mesos, in roder to distribute the tasks among
different network in a transparent way.

I'm describing my master thesis since i saw that many of you are Professors
and engineers, so you could have interest on that.

Thanks a lot, probbly in the next few months i will come to write here, for
the moment i really appreciate your help.
Thanks again!


2016-04-10 5:12 GMT+02:00 haosdent <haosd...@gmail.com>:

> Good to see you solve the chronos problem. For your current problem, you
> could edit the /etc/default/mesos-slave file and append the configuration
> to it
>
> ```
> MESOS_MASTER=131.154.96.32:5050
> MESOS_HOSTNAME=131.154.96.52
> MESOS_RESOURCES='cpu(*):1;mem(*):1300;disk(*):9000'
> MESOS_LOG_DIR=/var/log/mesos
> ```
>
> Then service mesos-slave restart
>
> On Sun, Apr 10, 2016 at 8:32 AM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> Ops,i did not hide the IP addresses, sorry please don't hack :P
>>
>> 2016-04-10 2:30 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>
>>> i solved the chronos problem creating a hostname file in /etc/chronos
>>> specifying the floating IP inside it.
>>> Now all is working with changed resources, the only one problem that
>>> persist is that after launching the command:
>>>
>>> mesos-slave --master=131.154.96.32:5050 --hostname=131.154.96.52
>>> --resources='cpu(*):1;mem(*):1300;disk(*):9000' --log_dir=/var/log/mesos
>>>
>>> i still have some messages in command line and i cannot use the command
>>> line.
>>>
>>> You're right haosdent i want run mesos-slave as service, but to do that
>>> i shoulf press ctrl+c to be able to use the command line, then i commonly
>>> use: service mesos-slave start command, but running it i obtain that the
>>> slave registers to the master allocating the default resources.
>>> How can i fix the changes of resources and run mesos-slave with service
>>> command?
>>>
>>> Thanks again!
>>>
>>> 2016-04-09 22:14 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>>> Im sorry, the command was just:
>>>>
>>>> mesos-slave --master=131.154.xxx.xxx:5050 --hostname=131.154.xxx.xxx
>>>> --resources='cpu(*):1;mem(*):1000;disk(*):8000'
>>>>
>>>> Where i specify the hostname with the floating IP.
>>>>
>>>> Without
>>>> rm -f /tmp/mesos/meta/slaves/latest
>>>> Actually i dont know what this command means...even if i have run it
>>>> before.
>>>> Il 09/apr/2016 20:51, "haosdent" <haosd...@gmail.com> ha scritto:
>>>>
>>>>> Yes, remove /tmp/mesos/meta/slaves/latest could cause this.
>>>>>
>>>>> On Sun, Apr 10, 2016 at 2:47 AM, Stefano Bianchi <jazzist...@gmail.com
>>>>> > wrote:
>>>>>
>>>>>> Sorry maybe i was not clear.
>>>>>> After that error with chronos i stopped the mesos slave and restarted
>>>>>> it witj service mesos-slave start, and in this way chronos job is 
>>>>>> working.
>>>>>> Of i stop the slavr and start it again with the command that changes
>>>>>> the resources i get the error.
>>>>>> In both cases i see in framework tab of mesos, that the hostname
>>>>>> related to chronos is non resolvable "mesos2.novalocal"
>>>>>> Im asking to my self if this can cause problem with this comamand:
>>>>>>
>>>>>> rm -f /tmp/mesos/meta/slaves/latest
>>>>>>
>>>>>>
>>>>>> mesos-slave --master=131.154.xxx.xxx:5050 --hostname=131.154.xxx.xxx
>>>>>> --resources='cpu(*):1;mem(*):1000;disk(*):8000'
>>>&g

Re: how to change mesos resources

2016-04-09 Thread Stefano Bianchi
Ops,i did not hide the IP addresses, sorry please don't hack :P

2016-04-10 2:30 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> i solved the chronos problem creating a hostname file in /etc/chronos
> specifying the floating IP inside it.
> Now all is working with changed resources, the only one problem that
> persist is that after launching the command:
>
> mesos-slave --master=131.154.96.32:5050 --hostname=131.154.96.52
> --resources='cpu(*):1;mem(*):1300;disk(*):9000' --log_dir=/var/log/mesos
>
> i still have some messages in command line and i cannot use the command
> line.
>
> You're right haosdent i want run mesos-slave as service, but to do that i
> shoulf press ctrl+c to be able to use the command line, then i commonly
> use: service mesos-slave start command, but running it i obtain that the
> slave registers to the master allocating the default resources.
> How can i fix the changes of resources and run mesos-slave with service
> command?
>
> Thanks again!
>
> 2016-04-09 22:14 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> Im sorry, the command was just:
>>
>> mesos-slave --master=131.154.xxx.xxx:5050 --hostname=131.154.xxx.xxx
>> --resources='cpu(*):1;mem(*):1000;disk(*):8000'
>>
>> Where i specify the hostname with the floating IP.
>>
>> Without
>> rm -f /tmp/mesos/meta/slaves/latest
>> Actually i dont know what this command means...even if i have run it
>> before.
>> Il 09/apr/2016 20:51, "haosdent" <haosd...@gmail.com> ha scritto:
>>
>>> Yes, remove /tmp/mesos/meta/slaves/latest could cause this.
>>>
>>> On Sun, Apr 10, 2016 at 2:47 AM, Stefano Bianchi <jazzist...@gmail.com>
>>> wrote:
>>>
>>>> Sorry maybe i was not clear.
>>>> After that error with chronos i stopped the mesos slave and restarted
>>>> it witj service mesos-slave start, and in this way chronos job is working.
>>>> Of i stop the slavr and start it again with the command that changes
>>>> the resources i get the error.
>>>> In both cases i see in framework tab of mesos, that the hostname
>>>> related to chronos is non resolvable "mesos2.novalocal"
>>>> Im asking to my self if this can cause problem with this comamand:
>>>>
>>>> rm -f /tmp/mesos/meta/slaves/latest
>>>>
>>>>
>>>> mesos-slave --master=131.154.xxx.xxx:5050 --hostname=131.154.xxx.xxx
>>>> --resources='cpu(*):1;mem(*):1000;disk(*):8000'
>>>> Il 09/apr/2016 19:28, "haosdent" <haosd...@gmail.com> ha scritto:
>>>>
>>>> >No it does not happen normally, that message comes out only after i
>>>> launched the command to change the reaources. Maybe i should create, as i
>>>> made both for mesos and marathon, the hostname file for Chronos in 
>>>> /etc/chronos
>>>> and put it inside the public IP resolvable?
>>>>
>>>> Sorry could not get your points here. What happens if you create a new
>>>> chronos job and launch it? Is it still error?
>>>>
>>>> On Sun, Apr 10, 2016 at 1:03 AM, Stefano Bianchi <jazzist...@gmail.com>
>>>> wrote:
>>>>
>>>>>
>>>>> "I think maybe you clear your work_dir in agent. So those messages
>>>>> disappear now. Does this always happen when you create a new chronos job?"
>>>>>
>>>>> No it does not happen normally, that message comes out only after i
>>>>> launched the command to change the reaources. Maybe i should create, as i
>>>>> made both for mesos and marathon, the hostname file for Chronos in
>>>>> /etc/chronos and put it inside the public IP resolvable ?
>>>>>
>>>>> Il 09/apr/2016 18:29, "haosdent" <haosd...@gmail.com> ha scritto:
>>>>> >
>>>>> > >Framework with ID 'c01b5040-6079-4f55-8ef2-089f0d4d1987-' does
>>>>> not exist on slave with ID 'ad490064-1a6e-415c-8536-daef0d8e3572-S20'.
>>>>> >
>>>>> > I think maybe you clear your work_dir in agent. So those messages
>>>>> disappear now. Does this always happen when you create a new chronos job?
>>>>> >
>>>>> > > However i tried to launch your command but i still unable to use
>>>>> the terminal after that :P, this is another and minor issue.
>>>>> >
>>>>> > I suppose you want to make mesos agent become a systemclt service.
>>>

Re: how to change mesos resources

2016-04-09 Thread Stefano Bianchi
i solved the chronos problem creating a hostname file in /etc/chronos
specifying the floating IP inside it.
Now all is working with changed resources, the only one problem that
persist is that after launching the command:

mesos-slave --master=131.154.96.32:5050 --hostname=131.154.96.52
--resources='cpu(*):1;mem(*):1300;disk(*):9000' --log_dir=/var/log/mesos

i still have some messages in command line and i cannot use the command
line.

You're right haosdent i want run mesos-slave as service, but to do that i
shoulf press ctrl+c to be able to use the command line, then i commonly
use: service mesos-slave start command, but running it i obtain that the
slave registers to the master allocating the default resources.
How can i fix the changes of resources and run mesos-slave with service
command?

Thanks again!

2016-04-09 22:14 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> Im sorry, the command was just:
>
> mesos-slave --master=131.154.xxx.xxx:5050 --hostname=131.154.xxx.xxx
> --resources='cpu(*):1;mem(*):1000;disk(*):8000'
>
> Where i specify the hostname with the floating IP.
>
> Without
> rm -f /tmp/mesos/meta/slaves/latest
> Actually i dont know what this command means...even if i have run it
> before.
> Il 09/apr/2016 20:51, "haosdent" <haosd...@gmail.com> ha scritto:
>
>> Yes, remove /tmp/mesos/meta/slaves/latest could cause this.
>>
>> On Sun, Apr 10, 2016 at 2:47 AM, Stefano Bianchi <jazzist...@gmail.com>
>> wrote:
>>
>>> Sorry maybe i was not clear.
>>> After that error with chronos i stopped the mesos slave and restarted it
>>> witj service mesos-slave start, and in this way chronos job is working.
>>> Of i stop the slavr and start it again with the command that changes the
>>> resources i get the error.
>>> In both cases i see in framework tab of mesos, that the hostname related
>>> to chronos is non resolvable "mesos2.novalocal"
>>> Im asking to my self if this can cause problem with this comamand:
>>>
>>> rm -f /tmp/mesos/meta/slaves/latest
>>>
>>>
>>> mesos-slave --master=131.154.xxx.xxx:5050 --hostname=131.154.xxx.xxx
>>> --resources='cpu(*):1;mem(*):1000;disk(*):8000'
>>> Il 09/apr/2016 19:28, "haosdent" <haosd...@gmail.com> ha scritto:
>>>
>>> >No it does not happen normally, that message comes out only after i
>>> launched the command to change the reaources. Maybe i should create, as i
>>> made both for mesos and marathon, the hostname file for Chronos in 
>>> /etc/chronos
>>> and put it inside the public IP resolvable?
>>>
>>> Sorry could not get your points here. What happens if you create a new
>>> chronos job and launch it? Is it still error?
>>>
>>> On Sun, Apr 10, 2016 at 1:03 AM, Stefano Bianchi <jazzist...@gmail.com>
>>> wrote:
>>>
>>>>
>>>> "I think maybe you clear your work_dir in agent. So those messages
>>>> disappear now. Does this always happen when you create a new chronos job?"
>>>>
>>>> No it does not happen normally, that message comes out only after i
>>>> launched the command to change the reaources. Maybe i should create, as i
>>>> made both for mesos and marathon, the hostname file for Chronos in
>>>> /etc/chronos and put it inside the public IP resolvable ?
>>>>
>>>> Il 09/apr/2016 18:29, "haosdent" <haosd...@gmail.com> ha scritto:
>>>> >
>>>> > >Framework with ID 'c01b5040-6079-4f55-8ef2-089f0d4d1987-' does
>>>> not exist on slave with ID 'ad490064-1a6e-415c-8536-daef0d8e3572-S20'.
>>>> >
>>>> > I think maybe you clear your work_dir in agent. So those messages
>>>> disappear now. Does this always happen when you create a new chronos job?
>>>> >
>>>> > > However i tried to launch your command but i still unable to use
>>>> the terminal after that :P, this is another and minor issue.
>>>> >
>>>> > I suppose you want to make mesos agent become a systemclt service. If
>>>> you use `apt/yum` install mesos from mesosphere, it should OK when you use
>>>>  `systemctl` to start mesos agent. If you install it from source code, I
>>>> think you need take some works to write systemctl service files for mesos.
>>>> >
>>>> > On Sun, Apr 10, 2016 at 12:21 AM, Stefano Bianchi <
>>>> jazzist...@gmail.com> wrote:
>>>>
>>>> >>
>>>>
>>>> >> i checke

Re: how to change mesos resources

2016-04-09 Thread Stefano Bianchi
Im sorry, the command was just:

mesos-slave --master=131.154.xxx.xxx:5050 --hostname=131.154.xxx.xxx
--resources='cpu(*):1;mem(*):1000;disk(*):8000'

Where i specify the hostname with the floating IP.

Without
rm -f /tmp/mesos/meta/slaves/latest
Actually i dont know what this command means...even if i have run it before.
Il 09/apr/2016 20:51, "haosdent" <haosd...@gmail.com> ha scritto:

> Yes, remove /tmp/mesos/meta/slaves/latest could cause this.
>
> On Sun, Apr 10, 2016 at 2:47 AM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> Sorry maybe i was not clear.
>> After that error with chronos i stopped the mesos slave and restarted it
>> witj service mesos-slave start, and in this way chronos job is working.
>> Of i stop the slavr and start it again with the command that changes the
>> resources i get the error.
>> In both cases i see in framework tab of mesos, that the hostname related
>> to chronos is non resolvable "mesos2.novalocal"
>> Im asking to my self if this can cause problem with this comamand:
>>
>> rm -f /tmp/mesos/meta/slaves/latest
>>
>>
>> mesos-slave --master=131.154.xxx.xxx:5050 --hostname=131.154.xxx.xxx
>> --resources='cpu(*):1;mem(*):1000;disk(*):8000'
>> Il 09/apr/2016 19:28, "haosdent" <haosd...@gmail.com> ha scritto:
>>
>> >No it does not happen normally, that message comes out only after i
>> launched the command to change the reaources. Maybe i should create, as i
>> made both for mesos and marathon, the hostname file for Chronos in 
>> /etc/chronos
>> and put it inside the public IP resolvable?
>>
>> Sorry could not get your points here. What happens if you create a new
>> chronos job and launch it? Is it still error?
>>
>> On Sun, Apr 10, 2016 at 1:03 AM, Stefano Bianchi <jazzist...@gmail.com>
>> wrote:
>>
>>>
>>> "I think maybe you clear your work_dir in agent. So those messages
>>> disappear now. Does this always happen when you create a new chronos job?"
>>>
>>> No it does not happen normally, that message comes out only after i
>>> launched the command to change the reaources. Maybe i should create, as i
>>> made both for mesos and marathon, the hostname file for Chronos in
>>> /etc/chronos and put it inside the public IP resolvable ?
>>>
>>> Il 09/apr/2016 18:29, "haosdent" <haosd...@gmail.com> ha scritto:
>>> >
>>> > >Framework with ID 'c01b5040-6079-4f55-8ef2-089f0d4d1987-' does
>>> not exist on slave with ID 'ad490064-1a6e-415c-8536-daef0d8e3572-S20'.
>>> >
>>> > I think maybe you clear your work_dir in agent. So those messages
>>> disappear now. Does this always happen when you create a new chronos job?
>>> >
>>> > > However i tried to launch your command but i still unable to use the
>>> terminal after that :P, this is another and minor issue.
>>> >
>>> > I suppose you want to make mesos agent become a systemclt service. If
>>> you use `apt/yum` install mesos from mesosphere, it should OK when you use
>>>  `systemctl` to start mesos agent. If you install it from source code, I
>>> think you need take some works to write systemctl service files for mesos.
>>> >
>>> > On Sun, Apr 10, 2016 at 12:21 AM, Stefano Bianchi <
>>> jazzist...@gmail.com> wrote:
>>>
>>> >>
>>>
>>> >> i checked in framework, and i see that in correspondence of chronos
>>> host tab there is a non resolvable hostname... Why?
>>> >>
>>> >> 2016-04-09 18:14 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>
>>> >>>
>>>
>>> >>> Thanks haosdent.
>>> >>> However i tried to see launch that command and what i see is:
>>> >>> 1) Resources are increased, this is what i expected, good;
>>> >>> 2) A Chronos Job that run each 2 minutes, is allocated and then
>>> "Staged";
>>> >>> is i click on sandbox i obtain this message:
>>> >>>
>>> >>> Framework with ID 'c01b5040-6079-4f55-8ef2-089f0d4d1987-' does
>>> not exist on slave with ID 'ad490064-1a6e-415c-8536-daef0d8e3572-S20'.
>>> >>>
>>> >>> What does it means? How can i solve it?
>>> >>> However i tried to launch your command but i still unable to use the
>>> terminal after that :P, this is another and minor issue.
>>> >>>
>>&g

Re: how to change mesos resources

2016-04-09 Thread Stefano Bianchi
Sorry maybe i was not clear.
After that error with chronos i stopped the mesos slave and restarted it
witj service mesos-slave start, and in this way chronos job is working.
Of i stop the slavr and start it again with the command that changes the
resources i get the error.
In both cases i see in framework tab of mesos, that the hostname related to
chronos is non resolvable "mesos2.novalocal"
Im asking to my self if this can cause problem with this comamand:

rm -f /tmp/mesos/meta/slaves/latest


mesos-slave --master=131.154.xxx.xxx:5050 --hostname=131.154.xxx.xxx
--resources='cpu(*):1;mem(*):1000;disk(*):8000'
Il 09/apr/2016 19:28, "haosdent" <haosd...@gmail.com> ha scritto:

>No it does not happen normally, that message comes out only after i
launched the command to change the reaources. Maybe i should create, as i
made both for mesos and marathon, the hostname file for Chronos in /etc/chronos
and put it inside the public IP resolvable?

Sorry could not get your points here. What happens if you create a new
chronos job and launch it? Is it still error?

On Sun, Apr 10, 2016 at 1:03 AM, Stefano Bianchi <jazzist...@gmail.com>
wrote:

>
> "I think maybe you clear your work_dir in agent. So those messages
> disappear now. Does this always happen when you create a new chronos job?"
>
> No it does not happen normally, that message comes out only after i
> launched the command to change the reaources. Maybe i should create, as i
> made both for mesos and marathon, the hostname file for Chronos in
> /etc/chronos and put it inside the public IP resolvable ?
>
> Il 09/apr/2016 18:29, "haosdent" <haosd...@gmail.com> ha scritto:
> >
> > >Framework with ID 'c01b5040-6079-4f55-8ef2-089f0d4d1987-' does not
> exist on slave with ID 'ad490064-1a6e-415c-8536-daef0d8e3572-S20'.
> >
> > I think maybe you clear your work_dir in agent. So those messages
> disappear now. Does this always happen when you create a new chronos job?
> >
> > > However i tried to launch your command but i still unable to use the
> terminal after that :P, this is another and minor issue.
> >
> > I suppose you want to make mesos agent become a systemclt service. If
> you use `apt/yum` install mesos from mesosphere, it should OK when you use
>  `systemctl` to start mesos agent. If you install it from source code, I
> think you need take some works to write systemctl service files for mesos.
> >
> > On Sun, Apr 10, 2016 at 12:21 AM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
> >>
>
> >> i checked in framework, and i see that in correspondence of chronos
> host tab there is a non resolvable hostname... Why?
> >>
> >> 2016-04-09 18:14 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
> >>>
>
> >>> Thanks haosdent.
> >>> However i tried to see launch that command and what i see is:
> >>> 1) Resources are increased, this is what i expected, good;
> >>> 2) A Chronos Job that run each 2 minutes, is allocated and then
> "Staged";
> >>> is i click on sandbox i obtain this message:
> >>>
> >>> Framework with ID 'c01b5040-6079-4f55-8ef2-089f0d4d1987-' does not
> exist on slave with ID 'ad490064-1a6e-415c-8536-daef0d8e3572-S20'.
> >>>
> >>> What does it means? How can i solve it?
> >>> However i tried to launch your command but i still unable to use the
> terminal after that :P, this is another and minor issue.
> >>>
> >>>
> >>> 2016-04-09 17:34 GMT+02:00 haosdent <haosd...@gmail.com>:
>
> >>>>
>
> >>>> Hi, @Stefano You could specify the flag --log_dir when you start
> Mesos Agent. For example:
> >>>>
> >>>> mesos-slave --master=MASTER_ADDRESS:5050
> --hostname=slave_public_IP_i_set
> --resources='cpu(*):1;mem(*):1000;disk(*):8000' --log_dir=/var/log/mesos
> >>>>
> >>>> So it would log to files under /var/log/mesos instead of console.
> >>>>
> >>>> On Sat, Apr 9, 2016 at 10:08 PM, Stefano Bianchi <
> jazzist...@gmail.com> wrote:
>
> >>>>>
>
> >>>>> Hi
> >>>>> All is working fine!
> >>>>> I can see more disk space and more RAM!
> >>>>> The only thing that is different is that with the Arjun last
> command, i obtain a verbose output, i mean a lot of messages continuously
> shown, on command line. i would like to hide them and continue to use the
> command line, is it possible?
> >>>>>
> >>>>> Thanks again!
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> Best Regards,
> >>>> Haosdent Huang
> >>>
> >>>
> >>
> >
> >
> >
> > --
> > Best Regards,
> > Haosdent Huang
>



-- 
Best Regards,
Haosdent Huang


Re: how to change mesos resources

2016-04-09 Thread Stefano Bianchi
"I think maybe you clear your work_dir in agent. So those messages
disappear now. Does this always happen when you create a new chronos job?"

No it does not happen normally, that message comes out only after i
launched the command to change the reaources. Maybe i should create, as i
made both for mesos and marathon, the hostname file for Chronos in
/etc/chronos and put it inside the public IP resolvable ?

Il 09/apr/2016 18:29, "haosdent" <haosd...@gmail.com> ha scritto:
>
> >Framework with ID 'c01b5040-6079-4f55-8ef2-089f0d4d1987-' does not
exist on slave with ID 'ad490064-1a6e-415c-8536-daef0d8e3572-S20'.
>
> I think maybe you clear your work_dir in agent. So those messages
disappear now. Does this always happen when you create a new chronos job?
>
> > However i tried to launch your command but i still unable to use the
terminal after that :P, this is another and minor issue.
>
> I suppose you want to make mesos agent become a systemclt service. If you
use `apt/yum` install mesos from mesosphere, it should OK when you use
 `systemctl` to start mesos agent. If you install it from source code, I
think you need take some works to write systemctl service files for mesos.
>
> On Sun, Apr 10, 2016 at 12:21 AM, Stefano Bianchi <jazzist...@gmail.com>
wrote:

>>

>> i checked in framework, and i see that in correspondence of chronos host
tab there is a non resolvable hostname... Why?
>>
>> 2016-04-09 18:14 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

>>>

>>> Thanks haosdent.
>>> However i tried to see launch that command and what i see is:
>>> 1) Resources are increased, this is what i expected, good;
>>> 2) A Chronos Job that run each 2 minutes, is allocated and then
"Staged";
>>> is i click on sandbox i obtain this message:
>>>
>>> Framework with ID 'c01b5040-6079-4f55-8ef2-089f0d4d1987-' does not
exist on slave with ID 'ad490064-1a6e-415c-8536-daef0d8e3572-S20'.
>>>
>>> What does it means? How can i solve it?
>>> However i tried to launch your command but i still unable to use the
terminal after that :P, this is another and minor issue.
>>>
>>>
>>> 2016-04-09 17:34 GMT+02:00 haosdent <haosd...@gmail.com>:

>>>>

>>>> Hi, @Stefano You could specify the flag --log_dir when you start Mesos
Agent. For example:
>>>>
>>>> mesos-slave --master=MASTER_ADDRESS:5050
--hostname=slave_public_IP_i_set
--resources='cpu(*):1;mem(*):1000;disk(*):8000' --log_dir=/var/log/mesos
>>>>
>>>> So it would log to files under /var/log/mesos instead of console.
>>>>
>>>> On Sat, Apr 9, 2016 at 10:08 PM, Stefano Bianchi <jazzist...@gmail.com>
wrote:

>>>>>

>>>>> Hi
>>>>> All is working fine!
>>>>> I can see more disk space and more RAM!
>>>>> The only thing that is different is that with the Arjun last command,
i obtain a verbose output, i mean a lot of messages continuously shown, on
command line. i would like to hide them and continue to use the command
line, is it possible?
>>>>>
>>>>> Thanks again!
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Best Regards,
>>>> Haosdent Huang
>>>
>>>
>>
>
>
>
> --
> Best Regards,
> Haosdent Huang


Re: how to change mesos resources

2016-04-09 Thread Stefano Bianchi
i checked in framework, and i see that in correspondence of chronos host
tab there is a non resolvable hostname... Why?

2016-04-09 18:14 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> Thanks haosdent.
> However i tried to see launch that command and what i see is:
> 1) Resources are increased, this is what i expected, good;
> 2) A Chronos Job that run each 2 minutes, is allocated and then "Staged";
> is i click on sandbox i obtain this message:
>
> Framework with ID 'c01b5040-6079-4f55-8ef2-089f0d4d1987-' does not
> exist on slave with ID 'ad490064-1a6e-415c-8536-daef0d8e3572-S20'.
>
> What does it means? How can i solve it?
> However i tried to launch your command but i still unable to use the
> terminal after that :P, this is another and minor issue.
>
>
> 2016-04-09 17:34 GMT+02:00 haosdent <haosd...@gmail.com>:
>
>> Hi, @Stefano You could specify the flag --log_dir when you start Mesos
>> Agent. For example:
>>
>> mesos-slave --master=MASTER_ADDRESS:5050 --hostname=slave_public_IP_i_set
>> --resources='cpu(*):1;mem(*):1000;disk(*):8000' --log_dir=/var/log/mesos
>>
>> So it would log to files under /var/log/mesos instead of console.
>>
>> On Sat, Apr 9, 2016 at 10:08 PM, Stefano Bianchi <jazzist...@gmail.com>
>> wrote:
>>
>>> Hi
>>> All is working fine!
>>> I can see more disk space and more RAM!
>>> The only thing that is different is that with the Arjun last command, i
>>> obtain a verbose output, i mean a lot of messages continuously shown, on
>>> command line. i would like to hide them and continue to use the command
>>> line, is it possible?
>>>
>>> Thanks again!
>>>
>>
>>
>>
>> --
>> Best Regards,
>> Haosdent Huang
>>
>
>


Re: how to change mesos resources

2016-04-09 Thread Stefano Bianchi
Thanks haosdent.
However i tried to see launch that command and what i see is:
1) Resources are increased, this is what i expected, good;
2) A Chronos Job that run each 2 minutes, is allocated and then "Staged";
is i click on sandbox i obtain this message:

Framework with ID 'c01b5040-6079-4f55-8ef2-089f0d4d1987-' does not
exist on slave with ID 'ad490064-1a6e-415c-8536-daef0d8e3572-S20'.

What does it means? How can i solve it?
However i tried to launch your command but i still unable to use the
terminal after that :P, this is another and minor issue.


2016-04-09 17:34 GMT+02:00 haosdent <haosd...@gmail.com>:

> Hi, @Stefano You could specify the flag --log_dir when you start Mesos
> Agent. For example:
>
> mesos-slave --master=MASTER_ADDRESS:5050 --hostname=slave_public_IP_i_set
> --resources='cpu(*):1;mem(*):1000;disk(*):8000' --log_dir=/var/log/mesos
>
> So it would log to files under /var/log/mesos instead of console.
>
> On Sat, Apr 9, 2016 at 10:08 PM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> Hi
>> All is working fine!
>> I can see more disk space and more RAM!
>> The only thing that is different is that with the Arjun last command, i
>> obtain a verbose output, i mean a lot of messages continuously shown, on
>> command line. i would like to hide them and continue to use the command
>> line, is it possible?
>>
>> Thanks again!
>>
>
>
>
> --
> Best Regards,
> Haosdent Huang
>


Re: how to change mesos resources

2016-04-09 Thread Stefano Bianchi
Hi
All is working fine!
I can see more disk space and more RAM!
The only thing that is different is that with the Arjun last command, i
obtain a verbose output, i mean a lot of messages continuously shown, on
command line. i would like to hide them and continue to use the command
line, is it possible?

Thanks again!


Re: how to change mesos resources

2016-04-09 Thread Stefano Bianchi
Can you please confirm the procedure i have written?

Thanks to all!

2016-04-09 0:28 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:

> yes i imagined that, indeed i will not allocate that amount of RAM, but at
> least a number higher than 920 M.
> OK so summarizing:
> 1) i stop mesos slave with: service mesos-slave stop
> 2)then as June suggest i run: sudo sh -c "echo
> MESOS_WORK_DIR=/scratch.local/mesos >> /etc/default/mesos-slave"
> 3) then as Arjun suggets:
>
> rm -f /tmp/mesos/meta/slaves/latest
>
> mesos-slave --master=MASTER_ADDRESS:5050 --hostname=slave_public_IP_i_set
> --resources='cpu(*):1;mem(*):1000;disk(*):8000'
>
>
>
>
>
>
>
> Is this correct procedure?
>
>
>
>
> 2016-04-08 23:57 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> i tried the command: free -m
>> and i obtained this output:
>>   totalusedfree  shared
>> buff/cache   available
>>
>> Mem:   1840 1201407  40 312
>>   1507
>>
>> Swap: 0   0   0
>>
>> so there is not 2048 MB of RAM? i'm sure that openstack tells me that
>> this is a machine with 2048 MB of RAM...
>>
>> 2016-04-08 23:44 GMT+02:00 Arkal Arjun Rao <aa...@ucsc.edu>:
>>
>>> You set it up with 2048MB but you  probably don't really get all of it
>>> (try `free -m` on the slave). Same with Disk (look at the value of df).
>>> from the book "Building Applications in Mesos":
>>> "The slave will reserve 1 GB or 50% of detected memory, whichever is
>>> smaller, in order to run itself and other operating system services.
>>> Likewise, it will reserve 5 GB or 50% of detected disk, whichever is
>>> smaller."
>>>
>>> If you want to explicitly reserve a value, first ensure you have the
>>> resources you want per slave then run this
>>> 
>>> rm -f /tmp/mesos/meta/slaves/latest
>>> mesos-slave --master=MASTER_ADDRESS:5050
>>> --hostname=slave_public_IP_i_set
>>> --resources='cpu(*):1;mem(*):2000;disk(*):9000'
>>>
>>> Arjun
>>>
>>> On Fri, Apr 8, 2016 at 2:23 PM, Stefano Bianchi <jazzist...@gmail.com>
>>> wrote:
>>>
>>>> What has to be clear is that i'm running virtual machines on openstack,
>>>> so i am not on bare metal.
>>>> All the VMs are Openstack Images, and each slave has been built with
>>>> 2048 MB of RAM, so since slaves are 3 i should see in mesos something close
>>>> to 6144 MB, but mesos shows only 2.7 GB.
>>>> If you look at the command output i posted in previous messages, the
>>>> current mesos resources configuration allows 920 MB and 5112 MB of disk
>>>> space for each slave. I would like that mesos can see for instance 2000 MB
>>>> of RAM and 9000 MB of disk. and for this reason i have run: mesos-slave
>>>> --master=MASTER_ADDRESS:5050 --resources='cpu:1;mem:2000;disk:9000'
>>>>
>>>> June Taylor, i need to understand:
>>>> 1) What the command you suggest do?
>>>> 2) Should i stop mesos-slave before? and then run your command?
>>>>
>>>> Thanks in advance.
>>>>
>>>> 2016-04-08 21:28 GMT+02:00 June Taylor <j...@umn.edu>:
>>>>
>>>>> How much actual RAM do your slaves contain? You can only make
>>>>> available up to that amount, minus the bit that the slave reserves.
>>>>>
>>>>>
>>>>> Thanks,
>>>>> June Taylor
>>>>> System Administrator, Minnesota Population Center
>>>>> University of Minnesota
>>>>>
>>>>> On Fri, Apr 8, 2016 at 1:29 PM, Stefano Bianchi <jazzist...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hi i would like to enter in this mailing list.
>>>>>> i'm currently doing my Master Thesis on Mesos and Calico.
>>>>>> I'm working at INFN, institute of nuclear physics. The goal of the
>>>>>> thesis is to build a PaaS where mesos is the scheduler and Calico must
>>>>>> allow the interconnection between multiple datacenters linked to the 
>>>>>> CERN.
>>>>>>
>>>>>> I'm exploiting an IaaS based on Openstack, here i have created 6
>>>>>> Virtual Machines, 3 Masters and 3 Slaves, on one slave is running 
>>>>>> Mesos-DNS
>>>>>> from Mar

Re: how to change mesos resources

2016-04-08 Thread Stefano Bianchi
i tried the command: free -m
and i obtained this output:
  totalusedfree  shared  buff/cache
  available

Mem:   1840 1201407  40 312
1507

Swap: 0   0   0

so there is not 2048 MB of RAM? i'm sure that openstack tells me that this
is a machine with 2048 MB of RAM...

2016-04-08 23:44 GMT+02:00 Arkal Arjun Rao <aa...@ucsc.edu>:

> You set it up with 2048MB but you  probably don't really get all of it
> (try `free -m` on the slave). Same with Disk (look at the value of df).
> from the book "Building Applications in Mesos":
> "The slave will reserve 1 GB or 50% of detected memory, whichever is
> smaller, in order to run itself and other operating system services.
> Likewise, it will reserve 5 GB or 50% of detected disk, whichever is
> smaller."
>
> If you want to explicitly reserve a value, first ensure you have the
> resources you want per slave then run this
> 
> rm -f /tmp/mesos/meta/slaves/latest
> mesos-slave --master=MASTER_ADDRESS:5050 --hostname=slave_public_IP_i_set
> --resources='cpu(*):1;mem(*):2000;disk(*):9000'
>
> Arjun
>
> On Fri, Apr 8, 2016 at 2:23 PM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> What has to be clear is that i'm running virtual machines on openstack,
>> so i am not on bare metal.
>> All the VMs are Openstack Images, and each slave has been built with 2048
>> MB of RAM, so since slaves are 3 i should see in mesos something close to
>> 6144 MB, but mesos shows only 2.7 GB.
>> If you look at the command output i posted in previous messages, the
>> current mesos resources configuration allows 920 MB and 5112 MB of disk
>> space for each slave. I would like that mesos can see for instance 2000 MB
>> of RAM and 9000 MB of disk. and for this reason i have run: mesos-slave
>> --master=MASTER_ADDRESS:5050 --resources='cpu:1;mem:2000;disk:9000'
>>
>> June Taylor, i need to understand:
>> 1) What the command you suggest do?
>> 2) Should i stop mesos-slave before? and then run your command?
>>
>> Thanks in advance.
>>
>> 2016-04-08 21:28 GMT+02:00 June Taylor <j...@umn.edu>:
>>
>>> How much actual RAM do your slaves contain? You can only make available
>>> up to that amount, minus the bit that the slave reserves.
>>>
>>>
>>> Thanks,
>>> June Taylor
>>> System Administrator, Minnesota Population Center
>>> University of Minnesota
>>>
>>> On Fri, Apr 8, 2016 at 1:29 PM, Stefano Bianchi <jazzist...@gmail.com>
>>> wrote:
>>>
>>>> Hi i would like to enter in this mailing list.
>>>> i'm currently doing my Master Thesis on Mesos and Calico.
>>>> I'm working at INFN, institute of nuclear physics. The goal of the
>>>> thesis is to build a PaaS where mesos is the scheduler and Calico must
>>>> allow the interconnection between multiple datacenters linked to the CERN.
>>>>
>>>> I'm exploiting an IaaS based on Openstack, here i have created 6
>>>> Virtual Machines, 3 Masters and 3 Slaves, on one slave is running Mesos-DNS
>>>> from Marathon.
>>>> All is perfectly working, since i am on another network i changed
>>>> correctly the hostnames such that on mesos are resolvable and i tried to
>>>> run from marathon a simple http server which is scalable on all my machine.
>>>> So all is fine and working.
>>>>
>>>> The only thing that i don't like is that each 3 slaves have 1 CPU 10 GB
>>>> of disk memory and 2GB of RAM, but mesos currently show for each one only 5
>>>> GB of disk memory and 900MB of RAM.
>>>> So checking in documentation i found the command to manage the
>>>> resources.
>>>> I stopped Slave1, for instance, and i have run this command:
>>>>
>>>> mesos-slave --master=MASTER_ADDRESS:5050
>>>> --resources='cpu:1;mem:2000;disk:9000'
>>>>
>>>> where i want set 2000 GB of RAM and 9000GB of disk memory.
>>>>  The output is the following:
>>>>
>>>> I0408 15:11:00.915324  7892 main.cpp:215] Build: 2016-03-10 20:32:58 by 
>>>> root
>>>>
>>>> I0408 15:11:00.915436  7892 main.cpp:217] Version: 0.27.2
>>>>
>>>> I0408 15:11:00.915448  7892 main.cpp:220] Git tag: 0.27.2
>>>>
>>>> I0408 15:11:00.915459  7892 main.cpp:224] Git SHA: 
>>>> 3c9ec4a0f34420b7803848af597de00fedefe0e2
>>>>
>>>> I0408 15:11:00.923334  7892 syst

Re: how to change mesos resources

2016-04-08 Thread Stefano Bianchi
What has to be clear is that i'm running virtual machines on openstack, so
i am not on bare metal.
All the VMs are Openstack Images, and each slave has been built with 2048
MB of RAM, so since slaves are 3 i should see in mesos something close to
6144 MB, but mesos shows only 2.7 GB.
If you look at the command output i posted in previous messages, the
current mesos resources configuration allows 920 MB and 5112 MB of disk
space for each slave. I would like that mesos can see for instance 2000 MB
of RAM and 9000 MB of disk. and for this reason i have run: mesos-slave
--master=MASTER_ADDRESS:5050 --resources='cpu:1;mem:2000;disk:9000'

June Taylor, i need to understand:
1) What the command you suggest do?
2) Should i stop mesos-slave before? and then run your command?

Thanks in advance.

2016-04-08 21:28 GMT+02:00 June Taylor <j...@umn.edu>:

> How much actual RAM do your slaves contain? You can only make available up
> to that amount, minus the bit that the slave reserves.
>
>
> Thanks,
> June Taylor
> System Administrator, Minnesota Population Center
> University of Minnesota
>
> On Fri, Apr 8, 2016 at 1:29 PM, Stefano Bianchi <jazzist...@gmail.com>
> wrote:
>
>> Hi i would like to enter in this mailing list.
>> i'm currently doing my Master Thesis on Mesos and Calico.
>> I'm working at INFN, institute of nuclear physics. The goal of the thesis
>> is to build a PaaS where mesos is the scheduler and Calico must allow the
>> interconnection between multiple datacenters linked to the CERN.
>>
>> I'm exploiting an IaaS based on Openstack, here i have created 6 Virtual
>> Machines, 3 Masters and 3 Slaves, on one slave is running Mesos-DNS from
>> Marathon.
>> All is perfectly working, since i am on another network i changed
>> correctly the hostnames such that on mesos are resolvable and i tried to
>> run from marathon a simple http server which is scalable on all my machine.
>> So all is fine and working.
>>
>> The only thing that i don't like is that each 3 slaves have 1 CPU 10 GB
>> of disk memory and 2GB of RAM, but mesos currently show for each one only 5
>> GB of disk memory and 900MB of RAM.
>> So checking in documentation i found the command to manage the resources.
>> I stopped Slave1, for instance, and i have run this command:
>>
>> mesos-slave --master=MASTER_ADDRESS:5050
>> --resources='cpu:1;mem:2000;disk:9000'
>>
>> where i want set 2000 GB of RAM and 9000GB of disk memory.
>>  The output is the following:
>>
>> I0408 15:11:00.915324  7892 main.cpp:215] Build: 2016-03-10 20:32:58 by root
>>
>> I0408 15:11:00.915436  7892 main.cpp:217] Version: 0.27.2
>>
>> I0408 15:11:00.915448  7892 main.cpp:220] Git tag: 0.27.2
>>
>> I0408 15:11:00.915459  7892 main.cpp:224] Git SHA: 
>> 3c9ec4a0f34420b7803848af597de00fedefe0e2
>>
>> I0408 15:11:00.923334  7892 systemd.cpp:236] systemd version `219` detected
>>
>> I0408 15:11:00.923384  7892 main.cpp:232] Inializing systemd state
>>
>> I0408 15:11:00.950050  7892 systemd.cpp:324] Started systemd slice 
>> `mesos_executors.slice`
>>
>> I0408 15:11:00.951529  7892 containerizer.cpp:143] Using isolation: 
>> posix/cpu,posix/mem,filesystem/posix
>>
>> I0408 15:11:00.963232  7892 linux_launcher.cpp:101] Using 
>> /sys/fs/cgroup/freezer as the freezer hierarchy for the Linux launcher
>>
>> I0408 15:11:00.965541  7892 main.cpp:320] Starting Mesos slave
>>
>> I0408 15:11:00.966008  7892 slave.cpp:192] Slave started on 
>> 1)@192.168.100.56:5051
>>
>> I0408 15:11:00.966023  7892 slave.cpp:193] Flags at startup: 
>> --appc_store_dir="/tmp/mesos/store/appc" --authenticatee="crammd5" 
>> --cgroups_cpu_enable_pids_and_tids_count="false" 
>> --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" 
>> --cgroups_limit_swap="false" --cgroups_root="mesos" 
>> --container_disk_watch_interval="15secs" --containerizers="mesos" 
>> --default_role="*" --disk_watch_interval="1mins" --docker="docker" 
>> --docker_auth_server="https://auth.docker.io; --docker_kill_orphans="true" 
>> --docker_puller_timeout="60" 
>> --docker_registry="https://registry-1.docker.io; 
>> --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" 
>> --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker" 
>> --enforce_container_disk_quota="false" 
>> --executor_registration_timeout="1mins" 
>> --executor_shutdown

how to change mesos resources

2016-04-08 Thread Stefano Bianchi
Hi i would like to enter in this mailing list.
i'm currently doing my Master Thesis on Mesos and Calico.
I'm working at INFN, institute of nuclear physics. The goal of the thesis
is to build a PaaS where mesos is the scheduler and Calico must allow the
interconnection between multiple datacenters linked to the CERN.

I'm exploiting an IaaS based on Openstack, here i have created 6 Virtual
Machines, 3 Masters and 3 Slaves, on one slave is running Mesos-DNS from
Marathon.
All is perfectly working, since i am on another network i changed correctly
the hostnames such that on mesos are resolvable and i tried to run from
marathon a simple http server which is scalable on all my machine. So all
is fine and working.

The only thing that i don't like is that each 3 slaves have 1 CPU 10 GB of
disk memory and 2GB of RAM, but mesos currently show for each one only 5 GB
of disk memory and 900MB of RAM.
So checking in documentation i found the command to manage the resources.
I stopped Slave1, for instance, and i have run this command:

mesos-slave --master=MASTER_ADDRESS:5050
--resources='cpu:1;mem:2000;disk:9000'

where i want set 2000 GB of RAM and 9000GB of disk memory.
 The output is the following:

I0408 15:11:00.915324  7892 main.cpp:215] Build: 2016-03-10 20:32:58 by root

I0408 15:11:00.915436  7892 main.cpp:217] Version: 0.27.2

I0408 15:11:00.915448  7892 main.cpp:220] Git tag: 0.27.2

I0408 15:11:00.915459  7892 main.cpp:224] Git SHA:
3c9ec4a0f34420b7803848af597de00fedefe0e2

I0408 15:11:00.923334  7892 systemd.cpp:236] systemd version `219` detected

I0408 15:11:00.923384  7892 main.cpp:232] Inializing systemd state

I0408 15:11:00.950050  7892 systemd.cpp:324] Started systemd slice
`mesos_executors.slice`

I0408 15:11:00.951529  7892 containerizer.cpp:143] Using isolation:
posix/cpu,posix/mem,filesystem/posix

I0408 15:11:00.963232  7892 linux_launcher.cpp:101] Using
/sys/fs/cgroup/freezer as the freezer hierarchy for the Linux launcher

I0408 15:11:00.965541  7892 main.cpp:320] Starting Mesos slave

I0408 15:11:00.966008  7892 slave.cpp:192] Slave started on
1)@192.168.100.56:5051

I0408 15:11:00.966023  7892 slave.cpp:193] Flags at startup:
--appc_store_dir="/tmp/mesos/store/appc" --authenticatee="crammd5"
--cgroups_cpu_enable_pids_and_tids_count="false"
--cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup"
--cgroups_limit_swap="false" --cgroups_root="mesos"
--container_disk_watch_interval="15secs" --containerizers="mesos"
--default_role="*" --disk_watch_interval="1mins" --docker="docker"
--docker_auth_server="https://auth.docker.io;
--docker_kill_orphans="true" --docker_puller_timeout="60"
--docker_registry="https://registry-1.docker.io;
--docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock"
--docker_stop_timeout="0ns"
--docker_store_dir="/tmp/mesos/store/docker"
--enforce_container_disk_quota="false"
--executor_registration_timeout="1mins"
--executor_shutdown_grace_period="5secs"
--fetcher_cache_dir="/tmp/mesos/fetch" --fetcher_cache_size="2GB"
--frameworks_home="" --gc_delay="1weeks" --gc_disk_headroom="0.1"
--hadoop_home="" --help="false" --hostname_lookup="true"
--image_provisioner_backend="copy" --initialize_driver_logging="true"
--isolation="posix/cpu,posix/mem" --launcher_dir="/usr/libexec/mesos"
--logbufsecs="0" --logging_level="INFO" --master="192.168.100.55:5050"
--oversubscribed_resources_interval="15secs" --perf_duration="10secs"
--perf_interval="1mins" --port="5051"
--qos_correction_interval_min="0ns" --quiet="false"
--recover="reconnect" --recovery_timeout="15mins"
--registration_backoff_factor="1secs"
--resources="cpu:1;mem:2000;disk:9000"
--revocable_cpu_low_priority="true"
--sandbox_directory="/mnt/mesos/sandbox" --strict="true"
--switch_user="true" --systemd_enable_support="true"
--systemd_runtime_directory="/run/systemd/system" --version="false"
--work_dir="/tmp/mesos"

I0408 15:11:00.967485  7892 slave.cpp:463] Slave resources: cpu(*):1;
mem(*):2000; disk(*):9000; cpus(*):1; ports(*):[31000-32000]

I0408 15:11:00.967547  7892 slave.cpp:471] Slave attributes: [  ]

I0408 15:11:00.967560  7892 slave.cpp:476] Slave hostname: slave1.openstacklocal

I0408 15:11:00.971304  7893 state.cpp:58] Recovering state from
'/tmp/mesos/meta'

*Failed to perform recovery: Incompatible slave info detected*.



Old slave info:

hostname: "*slave_public_IP_i_set*"

resources {

  name: "cpus"

  type: SCALAR

  scalar {

value: 1

  }

  role: "*"

}

resources {

  name: "mem"

  type: SCALAR

  scalar {

value: 920

  }

  role: "*"

}

resources {

  name: "disk"

  type: SCALAR

  scalar {

value: 5112

  }

  role: "*"

}

resources {

  name: "ports"

  type: RANGES

  ranges {

range {

  begin: 31000

  end: 32000

}

  }

  role: "*"

}

id {

  value: "ad490064-1a6e-415c-8536-daef0d8e3572-S7"

}

checkpoint: true

port: 5051