[
https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201220#comment-14201220
]
Aaron T. Myers commented on HDFS-7331:
--------------------------------------
{quote}
If I understand correctly, the metrics record failures for each DataXceiver
endpoint. I think you have the assumption that all accesses comes within the
cluster. The assumption no longer holds when the computation and storage are
separated.
I've no strong opinion on this, I'm fine with using a HashMap in this jira and
bounding its size down the road if problem occurs.
{quote}
Got it. I'd suggest then that we leave support for bounding the size in the
patch, and make it configurable, but default it to be unbounded. That way if it
ends up causing a problem for someone they can configure the size smaller
without having to deploy a new version of the software.
This brings up a related point - I think the current patch groups the counts by
remote address, which I believe includes the remote port. In the case of non-DN
clients, this port can be anything in the ephemeral port range, which isn't
very useful. I think better would be to group just by IP address, and not
include the port.
Do folks agree with the above?
> Add Datanode network counts to datanode jmx page
> ------------------------------------------------
>
> Key: HDFS-7331
> URL: https://issues.apache.org/jira/browse/HDFS-7331
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode
> Reporter: Charles Lamb
> Assignee: Charles Lamb
> Priority: Minor
> Attachments: HDFS-7331.001.patch, HDFS-7331.002.patch
>
>
> Add per-datanode counts to the datanode jmx page. For example, networkErrors
> could be exposed like this:
> {noformat}
> }, {
> ...
> "DatanodeNetworkCounts" : "{\"dn1\":{\"networkErrors\":1}}",
> ...
> "NamenodeAddresses" :
> "{\"localhost\":\"BP-1103235125-127.0.0.1-1415057084497\"}",
> "VolumeInfo" :
> "{\"/tmp/hadoop-cwl/dfs/data/current\":{\"freeSpace\":3092725760,\"usedSpace\":28672,\"reservedSpace\":0}}",
> "ClusterId" : "CID-4b38f2ae-5e58-4e15-b3cf-3ba3f46e724e"
> }, {
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
