>From SparkUI.scala : def getUIPort(conf: SparkConf): Int = { conf.getInt("spark.ui.port", SparkUI.DEFAULT_PORT) } Better retrieve effective UI port before probing.
Cheers On Sat, Apr 11, 2015 at 2:38 PM, Nicholas Chammas < nicholas.cham...@gmail.com> wrote: > So basically, to tell if the master is ready to accept slaves, just poll > http://master-node:4040 for an HTTP 200 response? > > > On Sat, Apr 11, 2015 at 2:42 PM Shivaram Venkataraman < > shiva...@eecs.berkeley.edu> wrote: > > > Yeah from what I remember it was set defensively. I don't know of a good > > way to check if the master is up though. I guess we could poll the Master > > Web UI and see if we get a 200/ok response > > > > Shivaram > > > > On Fri, Apr 10, 2015 at 8:24 PM, Nicholas Chammas < > > nicholas.cham...@gmail.com> wrote: > > > >> Check this out > >> < > >> > https://github.com/mesos/spark-ec2/blob/f0a48be1bb5aaeef508619a46065648beb8f1d92/spark-standalone/setup.sh#L26-L33 > >> > > >> (from spark-ec2): > >> > >> # Start Master$BIN_FOLDER/start-master.sh > > > > > >> # Pause > >> sleep 20 > >> # Start Workers$BIN_FOLDER/start-slaves.sh > >> > >> I know this was probably done defensively, but is there a more direct > way > >> to know when the master is ready? > >> > >> Nick > >> > >> > > >