To make it clear, Spark Standalone is similar to Yarn as a simple cluster
management system.
Spark Master --- Yarn Resource Manager
Spark Worker --- Yarn Node Manager
On Mon, Aug 17, 2015 at 4:59 AM, Ruslan Dautkhanov dautkha...@gmail.com
wrote:
There is no Spark master in YARN mode.
There is no Spark master in YARN mode. It's standalone mode terminology.
In YARN cluster mode, Spark's Application Master (Spark Driver runs in it)
will be restarted
automatically by RM up to yarn.resourcemanager.am.max-retries
times (default is 2).
--
Ruslan Dautkhanov
On Fri, Jul 17, 2015 at
Hi,
Is Spark master high availability supported on YARN (yarn-client mode)
analogous to
https://spark.apache.org/docs/1.4.0/spark-standalone.html#high-availability?
Thanks
Bhaskie
