When running in YARN, you can use the YARN Resource Manager UI to get to the ApplicationMaster url, irrespective of client or cluster mode.
Regards Sab On 15-Feb-2016 10:10 am, "Divya Gehlot" <divya.htco...@gmail.com> wrote: > Hi, > I have Hortonworks 2.3.4 cluster on EC2 and Have spark jobs as scala files > . > I am bit confused between using *master *options > I want to execute this spark job in YARN > > Curently running as > spark-shell --properties-file /TestDivya/Spark/Oracle.properties --jars > /usr/hdp/2.3.4.0-3485/spark/lib/ojdbc6.jar --driver-class-path > /usr/hdp/2.3.4.0-3485/spark/lib/ojdbc6.jar --packages > com.databricks:spark-csv_2.10:1.1.0 *--master yarn-client * -i > /TestDivya/Spark/Test.scala > > with this option I cant see the currently running jobs in Spark WEB UI > though it later appear in spark history server. > > My question with which --master option should I run my spark jobs so that > I can view the currently running jobs in spark web UI . > > Thanks, > Divya >
