[ https://issues.apache.org/jira/browse/HDFS-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17729891#comment-17729891 ]
ASF GitHub Bot commented on HDFS-16993: --------------------------------------- hfutatzhanghb commented on PR #5597: URL: https://github.com/apache/hadoop/pull/5597#issuecomment-1579770602 @ayushtkn , Sir, i am sorry for respond too late, i encounted a problem when writing unit test, because the datanode in local is all 127.0.0.1:xxxx. I will fix this soonly when i have time and could you give me some suggestions about this problems? Thanks sir. > Datanode supports configure TopN DatanodeNetworkCounts > ------------------------------------------------------ > > Key: HDFS-16993 > URL: https://issues.apache.org/jira/browse/HDFS-16993 > Project: Hadoop HDFS > Issue Type: Wish > Affects Versions: 3.3.5 > Reporter: farmmamba > Priority: Major > Labels: pull-request-available > > In our prod environment, we try to collect datanode metrics every 15s through > jmx_exporter. we found the datanodenetworkerror metric generates a lot. > for example, if we have a cluster with 1000 datanodes, every datanode may > generate 999 datanodenetworkerror metrics, and overall datanodes will > generate 1000 multiple 999 = 999000 metrics. This is a very expensive > operation. In most scenarios, we only need the topN of it. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org