Wenlong Lyu created FLINK-16864:
-----------------------------------

             Summary: Add idle metrics for Task
                 Key: FLINK-16864
                 URL: https://issues.apache.org/jira/browse/FLINK-16864
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Task
            Reporter: Wenlong Lyu


Currently there is no metric for user to measure how busy a task is concretely, 
which is important for user to decide how to tune a job.

We would like to propose adding an IdleTime which measure idle time of a task 
including the time cost for mail processor to wait for new mail and the time 
cost in record writer to waiting a new buffer. 

With the idle time:
1. when a job can not catch up with the speed of data generating, the vertex 
which idle time is near to zero is the bottle neck of the job.
2. when a job is not busy, idle time  can be used to guide user how much he can 
scale down the job.

In addition, measuring idle time can have little impaction on the performance 
of the job, because when a task is busy, we don't touch the code to measure 
wait-time in mailbox.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to