[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530223#comment-15530223 ]
Carlo Curino commented on YARN-5676: ------------------------------------ For very large queue structures, it is convenient to specify a policy for a subset of the queues (e.g., large/prod queues), and use something like the {{HashBasedRouterPolicy}} to automatically map all the small to subclusters. This is better than any of the randomized policies because the mapping between queue and sub-cluster tends to be more stable, hence there is some better chance for locality. I will post the patch soon (testing now). > Add a HashBasedRouterPolicy, that routes jobs based on queue name hash. > ----------------------------------------------------------------------- > > Key: YARN-5676 > URL: https://issues.apache.org/jira/browse/YARN-5676 > Project: Hadoop YARN > Issue Type: Sub-task > Components: nodemanager, resourcemanager > Affects Versions: YARN-2915 > Reporter: Carlo Curino > Assignee: Carlo Curino > -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org