You need to use the spark.ui.filters setting on the history server
https://spark.apache.org/docs/latest/configuration.html#spark-ui:
spark.ui.filters=org.apache.hadoop.security.authentication.server.AuthenticationFilter
spark.org.apache.hadoop.security.authentication.server.AuthenticationFilter.pa
Hello,
I am sending this email to the mailing list, to get your help on a problem that
I can't seem to resolve myself.
I am trying to secure Spark history ui running with Yarn as master using Apache
Knox.
>From the Knox configuration point of view I managed to secure the Spark
>service, i