LIBPROCESS_IP has zero hits in the Spark code base. This seems to be a Mesos-specific setting.
Have you tried setting SPARK_LOCAL_IP? On Wed, Dec 16, 2015 at 5:07 PM, Aaron <aarongm...@gmail.com> wrote: > Found this thread that talked about it to help understand it better: > > > https://mail-archives.apache.org/mod_mbox/mesos-user/201507.mbox/%3ccajq68qf9pejgnwomasm2dqchyaxpcaovnfkfgggxxpzj2jo...@mail.gmail.com%3E > > > > > When you run Spark on Mesos it needs to run > > > > spark driver > > mesos scheduler > > > > and both need to be visible to outside world on public iface IP > > > > you need to tell Spark and Mesos on which interface to bind - by default > > they resolve node hostname to ip - this is loopback address in your case > > > > Possible solutions - on slave node with public IP 192.168.56.50 > > > > 1. Set > > > > export LIBPROCESS_IP=192.168.56.50 > > export SPARK_LOCAL_IP=192.168.56.50 > > > > 2. Ensure your hostname resolves to public iface IP - (for testing) edit > > /etc/hosts to resolve your domain name to 192.168.56.50 > > 3. Set correct hostname/ip in mesos configuration - see Nikolaos answer > > > > Cheers, > Aaron > > On Wed, Dec 16, 2015 at 11:00 AM, Iulian Dragoș > <iulian.dra...@typesafe.com> wrote: > > Hi Aaron, > > > > I never had to use that variable. What is it for? > > > > On Wed, Dec 16, 2015 at 2:00 PM, Aaron <aarongm...@gmail.com> wrote: > >> > >> In going through running various Spark jobs, both Spark 1.5.2 and the > >> new Spark 1.6 SNAPSHOTs, on a Mesos cluster (currently 0.25), we > >> noticed that is in order to run the Spark shells (both python and > >> scala), we needed to set the LIBPROCESS_IP environment variable before > >> running. > >> > >> Was curious if the Spark on Mesos docs should be updated, under the > >> Client Mode section, to include setting this environment variable? > >> > >> Cheers > >> Aaron > >> > >> --------------------------------------------------------------------- > >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > >> For additional commands, e-mail: dev-h...@spark.apache.org > >> > > > > > > > > -- > > > > -- > > Iulian Dragos > > > > ------ > > Reactive Apps on the JVM > > www.typesafe.com > > > -- -- Iulian Dragos ------ Reactive Apps on the JVM www.typesafe.com
