Cluster submit mode - only supported on Yarn?

2014-07-23 Thread Chris Schneider
We are starting to use Spark, but we don't have any existing infrastructure related to big-data, so we decided to setup the standalone cluster, rather than mess around with Yarn or Mesos. But it appears like the driver program has to stay up on the client for the full duration of the job (client

Re: Cluster submit mode - only supported on Yarn?

2014-07-23 Thread Steve Nunez
in a reasonable amount of time without disrupting the other jobs. - SteveN From: Chris Schneider ch...@christopher-schneider.com Reply-To: user@spark.apache.org Date: Wednesday, July 23, 2014 at 7:39 To: user@spark.apache.org Subject: Cluster submit mode - only supported on Yarn? We are starting

Re: Cluster submit mode - only supported on Yarn?

2014-07-23 Thread Chris Schneider
mode - only supported on Yarn? We are starting to use Spark, but we don't have any existing infrastructure related to big-data, so we decided to setup the standalone cluster, rather than mess around with Yarn or Mesos. But it appears like the driver program has to stay up on the client