Re: Number of cores per executor on Spark Standalone

2015-03-01 Thread Deborah Siegel
Hi, Someone else will have a better answer. I think that for standalone mode, executors will grab whatever cores they can based on either configurations on the worker, or application specific configurations. Could be wrong, but I believe mesos is similar to this- and that YARN is alone in the abil

Number of cores per executor on Spark Standalone

2015-02-27 Thread bit1...@163.com
Hi , I know that spark on yarn has a configuration parameter(executor-cores NUM) to specify the number of cores per executor. How about spark standalone? I can specify the total cores, but how could I know how many cores each executor will take(presume one node one executor)? bit1...@163.c