[
https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated HDFS-8874:
-------------------------------
Attachment: HDFS-8874-trunk-v2.patch
[~mingma] V2 attached.
There was some refactoring needed for easier mocking in the replaceBlock and
copyBlock unit tests:
# Added sendBlock and receiveBlock methods in DataXceiver.
# Added a couple of accessor methods in DataNode.
> Add DN metrics for balancer and other block movement scenarios
> --------------------------------------------------------------
>
> Key: HDFS-8874
> URL: https://issues.apache.org/jira/browse/HDFS-8874
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Ming Ma
> Assignee: Chris Trezzo
> Attachments: HDFS-8874-trunk-v1.patch, HDFS-8874-trunk-v2.patch
>
>
> For balancer, mover and migrator (HDFS-8789), we want to know how close it is
> to the DN's throttling thresholds. Although DN has existing metrics such as
> {{BytesWritten}}, {{BytesRead}}, {{CopyBlockOpNumOps}} and
> {{ReplaceBlockOpNumOps}}, there is no metrics to indicate the number of bytes
> moved.
> We can add {{ReplaceBlockBytesWritten}} and {{CopyBlockBytesRead}} to account
> for the bytes moved in ReplaceBlock and CopyBlock operations. In addition, we
> can also add throttling metrics for {{DataTransferThrottler}} and
> {{BlockBalanceThrottler}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
