[ 
https://issues.apache.org/jira/browse/YARN-3652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701291#comment-14701291
 ] 

Xianyin Xin commented on YARN-3652:
-----------------------------------

A simple introduction of the preview patch: SchedulerMetrics is focus on 
metrics that related to the scheduler's performace. The following metrics are 
considered:

num of waiting events in the scheduler dispatch queue;
num of all kinds events in the scheduler dispatch queue;

events handling rate;
node update handling rate;

events adding rate;
node update adding rate;

statistical info of num of waiting events;
statistical info of num of waiting node update events;

containers allocation rate;

scheduling method exec rate, i.e., num of scheduling tries per second;

app allocation call duration;
nodeUpdate call duration;
scheduling call duration;

These metrics give rich information of the scheduler performance, which can be 
used to diagnose the anomaly of the scheduler.

> A SchedulerMetrics may be need for evaluating the scheduler's performance
> -------------------------------------------------------------------------
>
>                 Key: YARN-3652
>                 URL: https://issues.apache.org/jira/browse/YARN-3652
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: resourcemanager, scheduler
>            Reporter: Xianyin Xin
>         Attachments: YARN-3652-preview.patch
>
>
> As discussed in YARN-3630, a {{SchedulerMetrics}} may be need for evaluating 
> the scheduler's performance. The performance indexes includes #events waiting 
> for being handled by scheduler, the throughput, the scheduling delay and/or 
> other indicators.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to