I'm not sure why the UI appears broken like that either and haven't investigated it myself yet, but if you instead go to the YARN ResourceManager UI (port 8088 if you are using emr-4.x; port 9026 for 3.x, I believe), then you should be able to click on the ApplicationMaster link (or the History link for completed applications) to get to the Spark UI from there. The ApplicationMaster link will use the YARN Proxy Service (port 20888 on emr-4.x; not sure about 3.x) to proxy through the Spark application's UI, regardless of what port it's running on. For completed applications, the History link will send you directly to the Spark History Server UI on port 18080. Hope that helps!
~ Jonathan On 8/24/15, 10:51 PM, "Justin Pihony" <justin.pih...@gmail.com> wrote: >I am using the steps from this article ><https://aws.amazon.com/articles/Elastic-MapReduce/4926593393724923> to >get spark up and running on EMR through yarn. Once up and running I ssh in >and cd to the spark bin and run spark-shell --master yarn. Once this spins >up I can see that the UI is started at the internal ip of 4040. If I hit >the >public dns at 4040 with dynamic port tunneling and foxyproxy then I get a >crude UI (css seems broken), however the proxy continuously redirects me >to >the main page, so I cannot drill into anything. So, I tried static >tunneling, but can't seem to get through. > >So, how can I access the spark UI when running a spark shell in AWS yarn? > > > >-- >View this message in context: >http://apache-spark-user-list.1001560.n3.nabble.com/How-to-access-Spark-UI >-through-AWS-tp24436.html >Sent from the Apache Spark User List mailing list archive at Nabble.com. > >--------------------------------------------------------------------- >To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
