Hi, I am not talking about mesos-master or mesos-slave but about the spark driver (using libmesos as a framework). As it declares itself diring mesos registration comming from default interface of the desktop instead of the VPN one.
So mesos-master tries to access to an interface it cannot reach. Spark using "spark.driver.host 10.69.69.45" see netstat : tcp 0 0 0.0.0.0:44424 0.0.0.0:* LISTEN 1000 3076384 6779/java tcp 0 0 10.69.69.45:39698 10.50.0.1:5050 ESTABLISHED 1000 3068664 6779/java tcp6 0 0 :::43430 :::* LISTEN 1000 3077940 6779/java tcp6 0 0 :::37926 :::* LISTEN 1000 3077939 6779/java tcp6 0 0 :::4040 :::* LISTEN 1000 3077942 6779/java tcp6 0 0 :::51154 :::* LISTEN 1000 3077938 6779/java tcp6 0 0 10.69.69.45:34610 :::* LISTEN 1000 3076383 6779/java tcp6 0 0 :::43122 :::* LISTEN 1000 3077884 6779/java We can see spark interface are well binded to 10.69.69.45 but problem still exist for port 44424 that is supposed to be reached by mesos-master during registration. I would like to make libmesos, used by framework, bind to the rigth interface. Le 01/07/2014 13:34, Tomas Barton a écrit : > Hi, > > have you tried setting '--ip 10.69.69.45' ? > > So, mesos-master is binded to a wrong interface? Or you have problem > with mesos-slaves? > > Tomas > > > On 1 July 2014 12:16, Damien Hardy <dha...@viadeoteam.com > <mailto:dha...@viadeoteam.com>> wrote: > > Hello, > > We would like to use spark on mesos but mesos cluster is accessible > via VPN. > When running spark-shell we can see registrations attemps rununing with > defaut public interface of the desktop : > > ``` > I0701 12:07:34.710917 2440 <tel:710917%20%202440> master.cpp:820] > Framework > 20140612-135938-16790026-5050-2407-0537 > (scheduler(1)@192.168.2.92:42731 <http://192.168.2.92:42731>) > already registered, resending > acknowledgement > I0701 12:07:35.711632 2430 master.cpp:815] Received registration > request from scheduler(1)@192.168.2.92:42731 <http://192.168.2.92:42731> > ``` > > But we would like it register with the VPN interface. > > This is working when changing my /etc/hosts file and setting hostname on > my VPN address: > ``` > I0701 12:03:54.193022 2441 master.cpp:815] Received registration > request from scheduler(1)@10.69.69.45:47440 <http://10.69.69.45:47440> > I0701 12:03:54.193094 2441 master.cpp:833] Registering framework > 20140612-135938-16790026-5050-2407-0536 at > scheduler(1)@10.69.69.45:47440 <http://10.69.69.45:47440> > ``` > > I tried spark with > ``` > spark.driver.host 10.69.69.45 > ``` > I can see spark binding to the rigth interfa ce but mesos keep > registring with default one. (and fail) > > I hope envvar $MESOS_hostname would do the trick but without success... > > Thank for help. > > -- > Damien HARDY > IT Infrastructure Architect > Viadeo - 30 rue de la Victoire - 75009 Paris - France > PGP : 45D7F89A > > -- Damien HARDY IT Infrastructure Architect Viadeo - 30 rue de la Victoire - 75009 Paris - France PGP : 45D7F89A
signature.asc
Description: OpenPGP digital signature
