[ 
https://issues.apache.org/jira/browse/YARN-7562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16268199#comment-16268199
 ] 

Wilfred Spiegelenburg commented on YARN-7562:
---------------------------------------------

The behaviour you are seeing is the correct behaviour. You have defined the 
_algo_ queue implicitly as a parent queue.
Your configuration is incomplete but even that already shows what you did wrong:
{code}
<queue name="algo">
<queue name="test">
...
{code}
Since you have not closed the definition of the queue named _algo_ with a 
{{</queue>}} tag the queue test is now seen as a parent queue.
Your first rule in the placement policy tries to find a queue directly below 
the root queue with the user name. The user name _algo_ matches the existing 
queue _algo_ and thus returns as expected. However you can not submit to a 
parent queue and thus you get the exception. It is also impossible to have a 
parent and leaf queue with the same name at one level. Not returning a *parent* 
queue in the rules would break the whole concept of hierarchical queues and the 
nested placement rules.

Your patch also breaks all existing queue setups with more than one level of 
queues.

> queuePlacementPolicy should not match parent queue
> --------------------------------------------------
>
>                 Key: YARN-7562
>                 URL: https://issues.apache.org/jira/browse/YARN-7562
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: fairscheduler, resourcemanager
>    Affects Versions: 2.7.1
>            Reporter: chuanjie.duan
>         Attachments: YARN-7562.patch
>
>
> User algo submit a mapreduce job, console log said "root.algo is not a leaf 
> queue exception".
> root.algo is a parent queue, it's meanless for me. Not sure why parent queue 
> added before
> <queue name="algo">
>   <queue name="test">
>   <minSharePreemptionTimeout>300</minSharePreemptionTimeout>
>   ....
> </queue>
> <queuePlacementPolicy>
>     <rule name="user" create="false" />
>     <rule name="specified" />
>     <rule name="default" queue="default"/>
> </queuePlacementPolicy>



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

Reply via email to