To make it clear, Spark Standalone is similar to Yarn as a simple cluster management system.
Spark Master <---> Yarn Resource Manager Spark Worker <---> Yarn Node Manager On Mon, Aug 17, 2015 at 4:59 AM, Ruslan Dautkhanov <dautkha...@gmail.com> wrote: > There is no Spark master in YARN mode. It's standalone mode terminology. > In YARN cluster mode, Spark's Application Master (Spark Driver runs in it) > will be restarted > automatically by RM up to yarn.resourcemanager.am.max-retries > times (default is 2). > > -- > Ruslan Dautkhanov > > On Fri, Jul 17, 2015 at 1:29 AM, Bhaskar Dutta <bhas...@gmail.com> wrote: > >> Hi, >> >> Is Spark master high availability supported on YARN (yarn-client mode) >> analogous to >> https://spark.apache.org/docs/1.4.0/spark-standalone.html#high-availability >> ? >> >> Thanks >> Bhaskie >> > > -- Best Regards Jeff Zhang
