[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320956#comment-14320956 ] Hadoop QA commented on HDFS-7773: - {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12698837/hdfs-7773.001.patch against trunk revision 8bb9a50. {color:red}-1 @author{color}. The patch appears to contain @author tags which the Hadoop community has agreed to not allow in code contributions. {color:green}+1 tests included{color}. The patch appears to include new or modified test files. {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9576//console This message is automatically generated. > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Anu Engineer >Assignee: Anu Engineer > Attachments: hdfs-7773.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321185#comment-14321185 ] Hadoop QA commented on HDFS-7773: - {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12698837/hdfs-7773.001.patch against trunk revision 0d521e3. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 2 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9579//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9579//console This message is automatically generated. > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Anu Engineer >Assignee: Anu Engineer > Attachments: hdfs-7773.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321595#comment-14321595 ] Chris Nauroth commented on HDFS-7773: - Hi, Anu. This looks good. I have just a few minor comments: # {{DataXceiver}}: There is a new local variable named {{size}}. However, I think this always ends up with the same value as the existing local variable {{read}}. I suggest declaring {{long read = 0;}} in the outer scope instead of introducing a new variable. # {{NameNodeMetrics}}: There are 2 lines of additional whitespace unrelated to {{totalFileOps}}. I suggest removing those from the patch. # {{TestNameNodeMetrics}}: Please check the formatting and indentation in this part of the patch. Thanks! > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Attachments: hdfs-7773.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325215#comment-14325215 ] Akira AJISAKA commented on HDFS-7773: - Hi [~anu], thank you for the patch. Would you document the new metrics to {{Metrics.md}}? > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Attachments: hdfs-7773.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326498#comment-14326498 ] Anu Engineer commented on HDFS-7773: addressed comments from [~ajisakaa] and [~cnauroth] > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326580#comment-14326580 ] Hadoop QA commented on HDFS-7773: - {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12699531/hdfs-7773.002.patch against trunk revision 2aa9979. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 2 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1155 javac compiler warnings (more than the trunk's current 1151 warnings). {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:red}-1 core tests{color}. The patch failed these unit tests in hadoop-common-project/hadoop-common: org.apache.hadoop.ipc.TestRPCWaitForProxy Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9612//testReport/ Javac warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/9612//artifact/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9612//console This message is automatically generated. > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326658#comment-14326658 ] Chris Nauroth commented on HDFS-7773: - This looks good, Anu. I have just one more small nitpick. There are 2 lines in {{TestNameNodeMetrics}} that exceed 80 characters. +1 after that's addressed. I cannot repro the test failure. Let's see what happens on the next Jenkins run. > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326735#comment-14326735 ] Anu Engineer commented on HDFS-7773: fixed > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326936#comment-14326936 ] Hadoop QA commented on HDFS-7773: - {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12699567/hdfs-7773.003.patch against trunk revision 9a3e292. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 2 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:red}-1 core tests{color}. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer org.apache.hadoop.hdfs.tools.TestDFSHAAdminMiniCluster org.apache.hadoop.hdfs.web.TestWebHDFS Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9615//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9615//console This message is automatically generated. > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14327959#comment-14327959 ] Chris Nauroth commented on HDFS-7773: - The failure of {{TestDFSHAAdminMiniCluster}} is unrelated, and it's tracked separately in HDFS-7813. The other failures appear to be the flaky Jenkins behavior we've seen lately, resulting in {{NoClassDefFoundError}}. They don't repro locally for me. Anu, this is all ready to commit to trunk, but I just remembered we'll need a separate patch file for branch-2. The only difference is that instead of modifying Metrics.md, you'll need to make the equivalent changes in Metrics.apt.vm. The documentation only just recently converted to markdown. That conversion was only done on trunk, hence the need for a separate patch. Thanks! > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329536#comment-14329536 ] Hudson commented on HDFS-7773: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7166 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/7166/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14330148#comment-14330148 ] Hudson commented on HDFS-7773: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #111 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/111/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14330178#comment-14330178 ] Hudson commented on HDFS-7773: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #845 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/845/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14330286#comment-14330286 ] Hudson commented on HDFS-7773: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2043 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2043/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14330307#comment-14330307 ] Hudson commented on HDFS-7773: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #102 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/102/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14332193#comment-14332193 ] Hudson commented on HDFS-7773: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #112 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/112/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14332221#comment-14332221 ] Hudson commented on HDFS-7773: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2062 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2062/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)