Instead of opening a tunnel to the Spark web ui port, could you open a tunnel to the YARN RM web ui instead? That should allow you to navigate to the Spark application's web ui through the RM proxy, and hopefully that will work better.
On Fri, Feb 6, 2015 at 9:08 PM, yangqch <davidyang...@gmail.com> wrote: > Hi folks, > > I am new to spark. I just get spark 1.2 to run on emr ami 3.3.1 (hadoop > 2.4). > I ssh to emr master node and submit the job or start the shell. Everything > runs well except the webUI. > > In order to see the UI, I used ssh tunnel which forward my dev machine port > to emr master node webUI port. > > When I open the webUI, at the very beginning of the application (during the > spark launch time), the webUI is as nice as shown in many spark docs. > However, once the YARN AmIpfilter started to work, the webUI becomes very > ugly. No pictures can be displayed, only text can be shown (just like you > view it in lynx). Meanwhile, in spark shell, it pops up "amfilter.AmIpFilter > (AmIpFilter.java:doFilter(157)) - Could not find proxy-user cookie, so user > will not be set”. > > Can anyone give me some help? Thank you! > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/WebUI-on-yarn-through-ssh-tunnel-affected-by-AmIpfilter-tp21540.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > -- Marcelo --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
