use "--executor-cores 1" you will get 4 executors per worker since you have 4 cores per worker
On Tue, Sep 29, 2015 at 8:24 AM, James Pirz <james.p...@gmail.com> wrote: > Hi, > > I am using speak 1.5 (standalone mode) on a cluster with 10 nodes while > each machine has 12GB of RAM and 4 cores. On each machine I have one worker > which is running one executor that grabs all 4 cores. I am interested to > check the performance with "one worker but 4 executors per machine - each > with one core". > > I can see that "running multiple executors per worker in Standalone mode" > is possible based on the closed issue: > > https://issues.apache.org/jira/browse/SPARK-1706 > > But I can not find a way to do that. "SPARK_EXECUTOR_INSTANCES" is only > available for the Yarn mode, and in the standalone mode I can just set > "SPARK_WORKER_INSTANCES" and "SPARK_WORKER_CORES" and "SPARK_WORKER_MEMORY". > > Any hint or suggestion would be great. > > -- Best Regards Jeff Zhang
