Yes, it should be possible, any interest to work on this together? Need more hands to add more features here :)
On Tue, May 17, 2022 at 2:06 PM Holden Karau <hol...@pigscanfly.ca> wrote: > Could we make it do the same sort of history server fallback approach? > > On Tue, May 17, 2022 at 10:41 PM bo yang <bobyan...@gmail.com> wrote: > >> It is like Web Application Proxy in YARN ( >> https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html), >> to provide easy access for Spark UI when the Spark application is running. >> >> When running Spark on Kubernetes with S3, there is no YARN. The reverse >> proxy here is to behave like that Web Application Proxy. It will >> simplify settings to access Spark UI on Kubernetes. >> >> >> On Mon, May 16, 2022 at 11:46 PM wilson <wil...@4shield.net> wrote: >> >>> what's the advantage of using reverse proxy for spark UI? >>> >>> Thanks >>> >>> On Tue, May 17, 2022 at 1:47 PM bo yang <bobyan...@gmail.com> wrote: >>> >>>> Hi Spark Folks, >>>> >>>> I built a web reverse proxy to access Spark UI on Kubernetes (working >>>> together with >>>> https://github.com/GoogleCloudPlatform/spark-on-k8s-operator). Want to >>>> share here in case other people have similar need. >>>> >>>> The reverse proxy code is here: >>>> https://github.com/datapunchorg/spark-ui-reverse-proxy >>>> >>>> Let me know if anyone wants to use or would like to contribute. >>>> >>>> Thanks, >>>> Bo >>>> >>>> -- > Twitter: https://twitter.com/holdenkarau > Books (Learning Spark, High Performance Spark, etc.): > https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau >
