[
https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Heller updated SPARK-15155:
---------------------------------
Description:
SPARK-6284 added support for Mesos roles, but the framework will still accept
resources from both the reserved role specified in {{spark.mesos.role}} and the
default role {{*}}.
I'd like to propose the addition of a new boolean property:
{{spark.mesos.ignoreDefaultRoleResources}}. When this property is set Spark
will only accept resources from the role passed in the {{spark.mesos.role}}
property. If {{spark.mesos.role}} has not been set,
{{spark.mesos.ignoreDefaultRoleResources}} has no effect.
was:
SPARK-6284 added support for Mesos roles, but the framework will still accept
resources from both the reserved role specified in {{spark.mesos.role}} and the
default role {{*}}.
I'd like to propose the addition of a new property
{{spark.mesos.acceptedResourceRoles}} which would be a comma-delimited list of
roles that the framework will accept resources from.
This is similar to {{spark.mesos.constraints}}, except that constraints look at
the attributes of an offer, and this will look at the role of a resource.
In the default case {{spark.mesos.acceptedResourceRoles}} will be set to
{{*[,spark.mesos.role]}} giving the exact same behavior to the framework if no
value is specified in the property.
> Optionally ignore default role resources
> ----------------------------------------
>
> Key: SPARK-15155
> URL: https://issues.apache.org/jira/browse/SPARK-15155
> Project: Spark
> Issue Type: Improvement
> Components: Mesos
> Affects Versions: 1.5.0, 1.6.0
> Reporter: Chris Heller
>
> SPARK-6284 added support for Mesos roles, but the framework will still accept
> resources from both the reserved role specified in {{spark.mesos.role}} and
> the default role {{*}}.
> I'd like to propose the addition of a new boolean property:
> {{spark.mesos.ignoreDefaultRoleResources}}. When this property is set Spark
> will only accept resources from the role passed in the {{spark.mesos.role}}
> property. If {{spark.mesos.role}} has not been set,
> {{spark.mesos.ignoreDefaultRoleResources}} has no effect.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
