It is like Web Application Proxy in YARN ( https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html), to provide easy access for Spark UI when the Spark application is running.
When running Spark on Kubernetes with S3, there is no YARN. The reverse proxy here is to behave like that Web Application Proxy. It will simplify settings to access Spark UI on Kubernetes. On Mon, May 16, 2022 at 11:46 PM wilson <wil...@4shield.net> wrote: > what's the advantage of using reverse proxy for spark UI? > > Thanks > > On Tue, May 17, 2022 at 1:47 PM bo yang <bobyan...@gmail.com> wrote: > >> Hi Spark Folks, >> >> I built a web reverse proxy to access Spark UI on Kubernetes (working >> together with >> https://github.com/GoogleCloudPlatform/spark-on-k8s-operator). Want to >> share here in case other people have similar need. >> >> The reverse proxy code is here: >> https://github.com/datapunchorg/spark-ui-reverse-proxy >> >> Let me know if anyone wants to use or would like to contribute. >> >> Thanks, >> Bo >> >>
