Mesos 0.23.0, Spark 1.4.1, I’m using binary spark-assembly-1.4.1-hadoop2.6.0.jar executor placed in S3.
Every client machine has next lines in spark-env.sh: export MESOS_NATIVE_JAVA_LIBRARY=/usr/lib/libmesos.so export SPARK_EXECUTOR_URI=https://<S3 Path>/spark-1.4.1-bin-hadoop2.6.tgz export MASTER=mesos://zk://<zookeeper hosts>/mesos export SPARK_PUBLIC_DNS=<client machine EC2 public DNS name> -- Anton Kirillov Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Wednesday, July 29, 2015 at 1:13 AM, Philip Weaver wrote: > For me, it's 0.23.0 and 1.4.0, respectively. > > On Tue, Jul 28, 2015 at 4:08 PM, Adam Bordelon <a...@mesosphere.io > (mailto:a...@mesosphere.io)> wrote: > > Spark should be setting the FrameworkInfo.webui_url on scheduler startup. > > https://github.com/apache/spark/blob/v1.4.1/core/src/main/scala/org/apache/spark/deploy/mesos/MesosClusterDispatcher.scala#L76 > > What versions of Mesos and Spark are you using? > > > > On Tue, Jul 28, 2015 at 3:40 PM, Philip Weaver <philip.wea...@gmail.com > > (mailto:philip.wea...@gmail.com)> wrote: > > > I also have this problem, thanks! > > > > > > On Tue, Jul 28, 2015 at 3:34 PM, Anton Kirillov > > > <antonv.kiril...@gmail.com (mailto:antonv.kiril...@gmail.com)> wrote: > > > > Hi everyone, > > > > > > > > I’m trying to get access to Spark web UI from Mesos Master but with no > > > > success: the host name displayed properly, but the link is not active, > > > > just text. Maybe it’s a well-known issue or I misconfigured something, > > > > but this problem is really annoying. > > > > > > > > When running spark-submit in client mode framework is registered > > > > properly and Spark UI is available on client node but in Master’s > > > > interface hostname is just text. When launching in cluster mode > > > > (dispatcher is already launched) there’s only drivers information > > > > available with no reference to driver UI. > > > > > > > > Maybe I miss something, but really appreciate any help! > > > > > > > > -- > > > > Anton Kirillov > > > > Sent with Sparrow (http://www.sparrowmailapp.com/?sig) > > > > > > > > > >
