[jira] [Assigned] (SPARK-13232) YARN executor node label expressions
[
https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13232:
Assignee: (was: Apache Spark)
> YARN executor node label expressions
>
>
> Key: SPARK-13232
> URL: https://issues.apache.org/jira/browse/SPARK-13232
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Environment: Scala 2.11.7, Hadoop 2.7.2, Spark 1.6.0
>Reporter: Atkins
>Priority: Minor
>
> Using node label expression for executor failed to request container request
> and throws *InvalidContainerRequestException*.
> The code
> {code:title=AMRMClientImpl.java}
> /**
>* Valid if a node label expression specified on container request is valid
> or
>* not
>*
>* @param containerRequest
>*/
> private void checkNodeLabelExpression(T containerRequest) {
> String exp = containerRequest.getNodeLabelExpression();
>
> if (null == exp || exp.isEmpty()) {
> return;
> }
> // Don't support specifying >= 2 node labels in a node label expression
> now
> if (exp.contains("&&") || exp.contains("||")) {
> throw new InvalidContainerRequestException(
> "Cannot specify more than two node labels"
> + " in a single node label expression");
> }
>
> // Don't allow specify node label against ANY request
> if ((containerRequest.getRacks() != null &&
> (!containerRequest.getRacks().isEmpty()))
> ||
> (containerRequest.getNodes() != null &&
> (!containerRequest.getNodes().isEmpty( {
> throw new InvalidContainerRequestException(
> "Cannot specify node label with rack and node");
> }
> }
> {code}
> doesn't allow node label with rack and node.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-13232) YARN executor node label expressions
[
https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13232:
Assignee: Apache Spark
> YARN executor node label expressions
>
>
> Key: SPARK-13232
> URL: https://issues.apache.org/jira/browse/SPARK-13232
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Environment: Scala 2.11.7, Hadoop 2.7.2, Spark 1.6.0
>Reporter: Atkins
>Assignee: Apache Spark
>Priority: Minor
>
> Using node label expression for executor failed to request container request
> and throws *InvalidContainerRequestException*.
> The code
> {code:title=AMRMClientImpl.java}
> /**
>* Valid if a node label expression specified on container request is valid
> or
>* not
>*
>* @param containerRequest
>*/
> private void checkNodeLabelExpression(T containerRequest) {
> String exp = containerRequest.getNodeLabelExpression();
>
> if (null == exp || exp.isEmpty()) {
> return;
> }
> // Don't support specifying >= 2 node labels in a node label expression
> now
> if (exp.contains("&&") || exp.contains("||")) {
> throw new InvalidContainerRequestException(
> "Cannot specify more than two node labels"
> + " in a single node label expression");
> }
>
> // Don't allow specify node label against ANY request
> if ((containerRequest.getRacks() != null &&
> (!containerRequest.getRacks().isEmpty()))
> ||
> (containerRequest.getNodes() != null &&
> (!containerRequest.getNodes().isEmpty( {
> throw new InvalidContainerRequestException(
> "Cannot specify node label with rack and node");
> }
> }
> {code}
> doesn't allow node label with rack and node.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
