[ https://issues.apache.org/jira/browse/YARN-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370783#comment-16370783 ]
Young Chen commented on YARN-7708: ---------------------------------- This patch introduces the LoadBasedGlobalPolicy. It's configurable in the following ways: * MAX_EDIT: The maximum number of sub clusters this policy will throttle. The top N clusters by pending load will have their policy weights scaled down. * MIN_PENDING: The minimum number of pending applications before a sub cluster weight qualifies for editing. * MAX_PENDING: The maximum number of pending applications in the scalable range. Sub clusters exceeding this will have their policy weights set to MIN_WEIGHT * MIN_WEIGHT: The minimum weight possible for a highly loaded sub cluster. * SCALING: The scaling method that maps pending load to sub cluster policy weight. Currently there are three scaling methods: quadratic, log, and linear. > [GPG] Load based policy generator > --------------------------------- > > Key: YARN-7708 > URL: https://issues.apache.org/jira/browse/YARN-7708 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Carlo Curino > Assignee: Young Chen > Priority: Major > Attachments: YARN-7708-YARN-7402.01.cumulative.patch > > > This policy reads load from the "pendingQueueLength" metrics and provides > scaling into a set of weights that influence the AMRMProxy and Router > behaviors. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org