[ 
https://issues.apache.org/jira/browse/YARN-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939147#comment-16939147
 ] 

Jonathan Hung commented on YARN-9858:
-------------------------------------

Thanks, good point.

I think instead we can just initialize this set in DefaultAMSProcessor / 
RMAppManager constructor since there's only one of each. Then we can avoid 
making changes to RMContext completely. I think it's best to avoid coupling 
RMContextImpl creation with setting exclusiveEnforcedPartitions, otherwise if 
another RMContextImpl is initialized in the future, it's not obvious this field 
needs to be set.

I'll post a patch for this shortly.

> Optimize RMContext getExclusiveEnforcedPartitions 
> --------------------------------------------------
>
>                 Key: YARN-9858
>                 URL: https://issues.apache.org/jira/browse/YARN-9858
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Jonathan Hung
>            Assignee: Jonathan Hung
>            Priority: Major
>              Labels: release-blocker
>         Attachments: YARN-9858.001.patch
>
>
> Follow-up from YARN-9730. RMContextImpl#getExclusiveEnforcedPartitions is a 
> hot code path, need to optimize it .
> Since AMS allocate invoked by multiple handlers locking on conf will occur
> {code}
> java.lang.Thread.State: BLOCKED (on object monitor)
>  at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2841)
>  - waiting to lock <0x00007f1f8107c748> (a 
> org.apache.hadoop.yarn.conf.YarnConfiguration)
>  at org.apache.hadoop.conf.Configuration.get(Configuration.java:1214)
>  at org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:1268)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

Reply via email to