[ https://issues.apache.org/jira/browse/YARN-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371732#comment-16371732 ]
Manikandan R commented on YARN-4488: ------------------------------------ [~leftnoteasy] Thanks. Overall approach (as described in YARN-4485) is # Set the request start time while creating ResourceRequest object # Once container is allocated, subtract #1 from now() to compute the time taken/duration # Use #2 to update the corresponding queue metrics. For example, Lets say, for a job using 2 containers, newly added Queue Metrics would look like {"ContainerAllocationDelayNumOps" : 2, "ContainerAllocationDelayAvgTime" : 1755.5} As described in YARN-7902, To set the start time in ResourceRequest (which is in hadoop-yarn-api package), it requires SystemClock class and its dependent Clock interface to be in hadoop-common instead of hadoop-yarn-common (which is dependent on hadoop-yarn-api package). Hence, idea is to move SystemClock class etc to hadoop-common package so that it can be used any packages (not only related to YARN). Subsequently, we will need to do corresponding import changes in all classes where those clock related classes has been used. Thoughts? If it makes sense, Can we also move other classes like MonotonicClock class etc? Main changes are in {{AppSchedulingInfo}}, {{QueueMetrics}} and {{ResourceRequest}} class. Attached patch covers metrics per Queue only. Once approach is confirmed, will do the same per app as it is also an requirement of this JIRA. > CapacityScheduler: Compute per-container allocation latency and roll up to > get per-application and per-queue > ------------------------------------------------------------------------------------------------------------ > > Key: YARN-4488 > URL: https://issues.apache.org/jira/browse/YARN-4488 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Karthik Kambatla > Assignee: Manikandan R > Priority: Major > Attachments: YARN-4485.001.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org