This happens automatically as long as you submit with cluster mode instead of client mode. (e.g. ./spark-submit —master yarn-cluster …)
The property you mention would help right after that, although you will need to set it to a large value (e.g. 1000?) - as there is no “infinite” support. -adrian From: Jeetendra Gangele Date: Thursday, October 1, 2015 at 4:30 PM To: user Subject: automatic start of streaming job on failure on YARN We've a streaming application running on yarn and we would like to ensure that is up running 24/7. Is there a way to tell yarn to automatically restart a specific application on failure? There is property yarn.resourcemanager.am.max-attempts which is default set to 2 setting it to bigger value is the solution? Also I did observed this does not seems to work my application is failing and not starting automatically. Mesos has this build in support wondering why yarn is lacking here? Regards jeetendra
