See http://spark.apache.org/docs/latest/running-on-yarn.html, especially the parts that talk about spark.yarn.historyServer.address.
On Mon, May 2, 2016 at 2:14 PM, satish saley <satishsale...@gmail.com> wrote: > > > Hello, > > I am running pyspark job using yarn-cluster mode. I can see spark job in > yarn but I am able to go from any "log history" link from yarn to spark > history server. How would I keep track of yarn log and its corresponding log > in spark history server? Is there any setting in yarn/spark that let me > redirect to spark history server from yarn? > > Best, > Satish -- Marcelo --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
