Re: Monitoring ongoing Spark Job when run in Yarn Cluster mode

It's linked from the YARN RM's Web UI (see the "Application Master" link for the running application). On Mon, Mar 13, 2017 at 6:53 AM, Sourav Mazumder wrote: > Hi, > > Is there a way to monitor an ongoing Spark Job when running in Yarn Cluster > mode ? > > In my

Re: Monitoring ongoing Spark Job when run in Yarn Cluster mode

I think it would be on port 4040 by default on the Node where driver is running. You should be able to navigate to that via Resource Manager's application master link as in cluster mode both AM and driver runs on same node. On Mon, Mar 13, 2017 at 6:53 AM, Sourav Mazumder <

Monitoring ongoing Spark Job when run in Yarn Cluster mode

Hi, Is there a way to monitor an ongoing Spark Job when running in Yarn Cluster mode ? In my understanding in Yarn Cluster mode Spark Monitoring UI for the ongoing job would not be available in 4040 port. So is there an alternative ? Regards, Sourav