We have streaming jobs and batch jobs running inside the docker containers with spark driver launched within the container
Now when we open the Resource manager UI http://<RM Node>:8080, and try to access the application tracking URL of any running job, the page times out with error: HTTP ERROR 500 Problem accessing /proxy/redirect/application_1509358290085_0011/jobs/. Reason: Connection to http://<containerIP>:<spark ui port> refused It works only when container is launched on the node that is currently the yarn RM master.On any other node it doesn't work