[jira] [Updated] (SPARK-3287) When ResourceManager High Availability is enabled, ApplicationMaster webUI is not displayed.
[ https://issues.apache.org/jira/browse/SPARK-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3287: --- Component/s: (was: Spark Core) > When ResourceManager High Availability is enabled, ApplicationMaster webUI is > not displayed. > > > Key: SPARK-3287 > URL: https://issues.apache.org/jira/browse/SPARK-3287 > Project: Spark > Issue Type: Bug > Components: YARN >Affects Versions: 1.0.2 >Reporter: Benoy Antony > Attachments: SPARK-3287.patch > > > When ResourceManager High Availability is enabled, there will be multiple > resource managers and each of them could act as a proxy. > AmIpFilter is modified to accept multiple proxy hosts. But Spark > ApplicationMaster fails to read the ResourceManager IPs properly from the > configuration. > So AmIpFilter is initialized with an empty set of proxy hosts. So any access > to the ApplicationMaster WebUI will be redirected to port RM port on the > local host. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-3287) When ResourceManager High Availability is enabled, ApplicationMaster webUI is not displayed.
[ https://issues.apache.org/jira/browse/SPARK-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated SPARK-3287: Description: When ResourceManager High Availability is enabled, there will be multiple resource managers and each of them could act as a proxy. AmIpFilter is modified to accept multiple proxy hosts. But Spark ApplicationMaster fails to read the ResourceManager IPs properly from the configuration. So AmIpFilter is initialized with an empty set of proxy hosts. So any access to the ApplicationMaster WebUI will be redirected to port RM port on the local host. was: When ResourceManager High Availability is enabled, there will be multiple resource managers and each of them could act as a proxy. AmIpFilter is modified to accept multiple proxy hosts. But Spark ApplicationMaster fails read the ResourceManager IPs properly from the configuration. So AmIpFilter is initialized with an empty set of proxy hosts. So any access to the ApplicationMaster WebUI will be redirected to port RM port on the local host. > When ResourceManager High Availability is enabled, ApplicationMaster webUI is > not displayed. > > > Key: SPARK-3287 > URL: https://issues.apache.org/jira/browse/SPARK-3287 > Project: Spark > Issue Type: Bug > Components: Spark Core, YARN >Affects Versions: 1.0.2 >Reporter: Benoy Antony > Attachments: SPARK-3287.patch > > > When ResourceManager High Availability is enabled, there will be multiple > resource managers and each of them could act as a proxy. > AmIpFilter is modified to accept multiple proxy hosts. But Spark > ApplicationMaster fails to read the ResourceManager IPs properly from the > configuration. > So AmIpFilter is initialized with an empty set of proxy hosts. So any access > to the ApplicationMaster WebUI will be redirected to port RM port on the > local host. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-3287) When ResourceManager High Availability is enabled, ApplicationMaster webUI is not displayed.
[ https://issues.apache.org/jira/browse/SPARK-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated SPARK-3287: Attachment: SPARK-3287.patch In the attached patch, the resource manager list is read using new API. The Filter parameter which accept multiple hosts (PROXY_HOSTS instead of PROXY_HOST) and URL bases are used. Since the parameter values use comma as separator, they are url-encoded so that it won’t clash with separator for filter parameters. The unit tests need to be used. > When ResourceManager High Availability is enabled, ApplicationMaster webUI is > not displayed. > > > Key: SPARK-3287 > URL: https://issues.apache.org/jira/browse/SPARK-3287 > Project: Spark > Issue Type: Bug > Components: Spark Core, YARN >Affects Versions: 1.0.2 >Reporter: Benoy Antony > Attachments: SPARK-3287.patch > > > When ResourceManager High Availability is enabled, there will be multiple > resource managers and each of them could act as a proxy. > AmIpFilter is modified to accept multiple proxy hosts. But Spark > ApplicationMaster fails read the ResourceManager IPs properly from the > configuration. > So AmIpFilter is initialized with an empty set of proxy hosts. So any access > to the ApplicationMaster WebUI will be redirected to port RM port on the > local host. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
