Hi all, I am using Hadoop 2.6.5 and spark 2.1.0 and run a job using spark-submit and master is set to "yarn". When spark starts, I can load Spark UI page using port 4040 but no job is shown in the page. After the following logs (registering application master on yarn) spark UI is not accessible anymore, even from tracking UI (ApplicationMaster) in cluster UI.
The URL (http://z401:4040) is redirected to a new one ( http://z401:8088/proxy/application_1498135277395_0009) and can not be reached. Any idea? Thanks a lot in advance. 17/06/23 12:35:45 INFO cluster.YarnSchedulerBackend$YarnSchedulerEndpoint: ApplicationMaster registered as NettyRpcEndpointRef(null) 17/06/23 12:35:45 INFO cluster.YarnClientSchedulerBackend: Add WebUI Filter. org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter, Map(PROXY_HOSTS -> z401, PROXY_URI_BASES -> http://z401:8088/proxy/application_1498135277395_0009), /proxy/application_1498135277395_0009 17/06/23 12:35:45 INFO ui.JettyUtils: Adding filter: org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter 17/06/23 12:35:45 INFO yarn.Client: Application report for application_1498135277395_0009 (state: RUNNING)