[ https://issues.apache.org/jira/browse/SPARK-6350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739645#comment-14739645 ]
Andrew Or commented on SPARK-6350: ---------------------------------- re-opening this because it needs to be back ported into branch-1.5 > Make mesosExecutorCores configurable in mesos "fine-grained" mode > ----------------------------------------------------------------- > > Key: SPARK-6350 > URL: https://issues.apache.org/jira/browse/SPARK-6350 > Project: Spark > Issue Type: Improvement > Components: Mesos > Affects Versions: 1.0.0, 1.5.0 > Reporter: Jongyoul Lee > Assignee: Jongyoul Lee > Priority: Minor > Labels: backport-needed > Fix For: 1.4.0, 1.6.0 > > > When spark runs in mesos fine-grained mode, mesos slave launches executor > with # of cpus and memories. By the way, # of executor's cores is always > CPU_PER_TASKS as same as spark.task.cpus. If I set that values as 5 for > running intensive task, mesos executor always consume 5 cores without any > running task. This waste resources. We should set executor core as a > configuration variable. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org