[ https://issues.apache.org/jira/browse/SPARK-37562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17454311#comment-17454311 ]
Dongjoon Hyun commented on SPARK-37562: --------------------------------------- Does this JIRA simply aim to advertise some random URLs (from the setting) by embedding it into the log? When you say `K8s and other CMs`, do you have any other goal to achieve in this JIRA? 1. K8s 2. Mesos 3. Standalone cluster 4. Notebook (like Zeppelin) I'm curious about the benefit of this JIRA issue. > Add Spark History Server Links for Kubernetes & other CMs > --------------------------------------------------------- > > Key: SPARK-37562 > URL: https://issues.apache.org/jira/browse/SPARK-37562 > Project: Spark > Issue Type: Improvement > Components: Kubernetes > Affects Versions: 3.2.1, 3.3.0 > Reporter: Holden Karau > Assignee: Holden Karau > Priority: Minor > > In YARN we have the Spark history server configured with > `spark.yarn.historyServer.address` which allows us to print out useful links > on startup for eventual debugging. More than just YARN can have the history > server. We should either add `spark.kubernetes.historyServer.address` or move > it to `spark.historyServer.address` w/a fall back to the old YARN specific > config. > -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org