Ming Ma created HDFS-8874:
-----------------------------

             Summary: Add DN metrics for balancer and other block movement 
scenarios
                 Key: HDFS-8874
                 URL: https://issues.apache.org/jira/browse/HDFS-8874
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Ming Ma
            Assignee: Chris Trezzo


For balancer, mover and migrator (HDFS-8789), we want to know how close it is 
to the DN's throttling thresholds. Although DN has existing metrics such as 
{{BytesWritten}}, {{BytesRead}}, {{CopyBlockOpNumOps}} and 
{{ReplaceBlockOpNumOps}}, there is no metrics to indicate the number of bytes 
moved.

We can add {{ReplaceBlockBytesWritten}} and {{CopyBlockBytesRead}} to account 
for the bytes moved in ReplaceBlock and CopyBlock operations. In addition, we 
can also add throttling metrics for {{DataTransferThrottler}} and 
{{BlockBalanceThrottler}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to