Re: --driver-cores for Standalone and YARN only?! What about Mesos?

2016-06-02 Thread Holden Karau
Also seems like this might be better suited for dev@ On Thursday, June 2, 2016, Sun Rui wrote: > yes, I think you can fire a JIRA issue for this. > But why removing the default value. Seems the default core is 1 according > to > https://github.com/apache/spark/blob/master/core/src/main/scala/org

Re: --driver-cores for Standalone and YARN only?! What about Mesos?

2016-06-02 Thread Sun Rui
yes, I think you can fire a JIRA issue for this. But why removing the default value. Seems the default core is 1 according to https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/rest/mesos/MesosRestServer.scala#L110 On Jun 2, 2016, at 05:18, Jacek Laskowski w

--driver-cores for Standalone and YARN only?! What about Mesos?

2016-06-01 Thread Jacek Laskowski
Hi, I'm reviewing the code of spark-submit and can see that although --driver-cores is said to be for Standalone and YARN only, it is applicable for Mesos [1]. ➜ spark git:(master) ✗ ./bin/spark-shell --help Usage: ./bin/spark-shell [options] ... Spark standalone with cluster deploy mode only: