[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[
https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320956#comment-14320956
]
Hadoop QA commented on HDFS-7773:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12698837/hdfs-7773.001.patch
against trunk revision 8bb9a50.
{color:red}-1 @author{color}. The patch appears to contain @author tags
which the Hadoop community has agreed to not allow in code contributions.
{color:green}+1 tests included{color}. The patch appears to include new
or modified test files.
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9576//console
This message is automatically generated.
> Additional metrics in HDFS to be accessed via jmx.
> --
>
> Key: HDFS-7773
> URL: https://issues.apache.org/jira/browse/HDFS-7773
> Project: Hadoop HDFS
> Issue Type: Improvement
>Reporter: Anu Engineer
>Assignee: Anu Engineer
> Attachments: hdfs-7773.001.patch
>
>
> We would like to have the following metrics added to DataNode and name node
> this to improve Ambari dashboard
> 1) DN disk i/o utilization
> 2) DN network i/o utilization
> 3) Namenode read operations
> 4) Namenode write operations
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[
https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321185#comment-14321185
]
Hadoop QA commented on HDFS-7773:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12698837/hdfs-7773.001.patch
against trunk revision 0d521e3.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 2 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-hdfs-project/hadoop-hdfs.
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/9579//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9579//console
This message is automatically generated.
> Additional metrics in HDFS to be accessed via jmx.
> --
>
> Key: HDFS-7773
> URL: https://issues.apache.org/jira/browse/HDFS-7773
> Project: Hadoop HDFS
> Issue Type: Improvement
>Reporter: Anu Engineer
>Assignee: Anu Engineer
> Attachments: hdfs-7773.001.patch
>
>
> We would like to have the following metrics added to DataNode and name node
> this to improve Ambari dashboard
> 1) DN disk i/o utilization
> 2) DN network i/o utilization
> 3) Namenode read operations
> 4) Namenode write operations
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[
https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321595#comment-14321595
]
Chris Nauroth commented on HDFS-7773:
-
Hi, Anu. This looks good. I have just a few minor comments:
# {{DataXceiver}}: There is a new local variable named {{size}}. However, I
think this always ends up with the same value as the existing local variable
{{read}}. I suggest declaring {{long read = 0;}} in the outer scope instead of
introducing a new variable.
# {{NameNodeMetrics}}: There are 2 lines of additional whitespace unrelated to
{{totalFileOps}}. I suggest removing those from the patch.
# {{TestNameNodeMetrics}}: Please check the formatting and indentation in this
part of the patch.
Thanks!
> Additional metrics in HDFS to be accessed via jmx.
> --
>
> Key: HDFS-7773
> URL: https://issues.apache.org/jira/browse/HDFS-7773
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode, namenode
>Reporter: Anu Engineer
>Assignee: Anu Engineer
> Attachments: hdfs-7773.001.patch
>
>
> We would like to have the following metrics added to DataNode and name node
> this to improve Ambari dashboard
> 1) DN disk i/o utilization
> 2) DN network i/o utilization
> 3) Namenode read operations
> 4) Namenode write operations
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[
https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325215#comment-14325215
]
Akira AJISAKA commented on HDFS-7773:
-
Hi [~anu], thank you for the patch. Would you document the new metrics to
{{Metrics.md}}?
> Additional metrics in HDFS to be accessed via jmx.
> --
>
> Key: HDFS-7773
> URL: https://issues.apache.org/jira/browse/HDFS-7773
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode, namenode
>Reporter: Anu Engineer
>Assignee: Anu Engineer
> Attachments: hdfs-7773.001.patch
>
>
> We would like to have the following metrics added to DataNode and name node
> this to improve Ambari dashboard
> 1) DN disk i/o utilization
> 2) DN network i/o utilization
> 3) Namenode read operations
> 4) Namenode write operations
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326498#comment-14326498 ] Anu Engineer commented on HDFS-7773: addressed comments from [~ajisakaa] and [~cnauroth] > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[
https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326580#comment-14326580
]
Hadoop QA commented on HDFS-7773:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12699531/hdfs-7773.002.patch
against trunk revision 2aa9979.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 2 new
or modified test files.
{color:red}-1 javac{color}. The applied patch generated 1155 javac
compiler warnings (more than the trunk's current 1151 warnings).
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-common-project/hadoop-common:
org.apache.hadoop.ipc.TestRPCWaitForProxy
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/9612//testReport/
Javac warnings:
https://builds.apache.org/job/PreCommit-HDFS-Build/9612//artifact/patchprocess/diffJavacWarnings.txt
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9612//console
This message is automatically generated.
> Additional metrics in HDFS to be accessed via jmx.
> --
>
> Key: HDFS-7773
> URL: https://issues.apache.org/jira/browse/HDFS-7773
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode, namenode
>Reporter: Anu Engineer
>Assignee: Anu Engineer
> Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch
>
>
> We would like to have the following metrics added to DataNode and name node
> this to improve Ambari dashboard
> 1) DN disk i/o utilization
> 2) DN network i/o utilization
> 3) Namenode read operations
> 4) Namenode write operations
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[
https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326658#comment-14326658
]
Chris Nauroth commented on HDFS-7773:
-
This looks good, Anu. I have just one more small nitpick. There are 2 lines
in {{TestNameNodeMetrics}} that exceed 80 characters. +1 after that's
addressed.
I cannot repro the test failure. Let's see what happens on the next Jenkins
run.
> Additional metrics in HDFS to be accessed via jmx.
> --
>
> Key: HDFS-7773
> URL: https://issues.apache.org/jira/browse/HDFS-7773
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode, namenode
>Reporter: Anu Engineer
>Assignee: Anu Engineer
> Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch
>
>
> We would like to have the following metrics added to DataNode and name node
> this to improve Ambari dashboard
> 1) DN disk i/o utilization
> 2) DN network i/o utilization
> 3) Namenode read operations
> 4) Namenode write operations
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326735#comment-14326735 ] Anu Engineer commented on HDFS-7773: fixed > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[
https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326936#comment-14326936
]
Hadoop QA commented on HDFS-7773:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12699567/hdfs-7773.003.patch
against trunk revision 9a3e292.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 2 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs:
org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer
org.apache.hadoop.hdfs.tools.TestDFSHAAdminMiniCluster
org.apache.hadoop.hdfs.web.TestWebHDFS
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/9615//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9615//console
This message is automatically generated.
> Additional metrics in HDFS to be accessed via jmx.
> --
>
> Key: HDFS-7773
> URL: https://issues.apache.org/jira/browse/HDFS-7773
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode, namenode
>Reporter: Anu Engineer
>Assignee: Anu Engineer
> Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch,
> hdfs-7773.003.patch
>
>
> We would like to have the following metrics added to DataNode and name node
> this to improve Ambari dashboard
> 1) DN disk i/o utilization
> 2) DN network i/o utilization
> 3) Namenode read operations
> 4) Namenode write operations
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[
https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14327959#comment-14327959
]
Chris Nauroth commented on HDFS-7773:
-
The failure of {{TestDFSHAAdminMiniCluster}} is unrelated, and it's tracked
separately in HDFS-7813.
The other failures appear to be the flaky Jenkins behavior we've seen lately,
resulting in {{NoClassDefFoundError}}. They don't repro locally for me.
Anu, this is all ready to commit to trunk, but I just remembered we'll need a
separate patch file for branch-2. The only difference is that instead of
modifying Metrics.md, you'll need to make the equivalent changes in
Metrics.apt.vm. The documentation only just recently converted to markdown.
That conversion was only done on trunk, hence the need for a separate patch.
Thanks!
> Additional metrics in HDFS to be accessed via jmx.
> --
>
> Key: HDFS-7773
> URL: https://issues.apache.org/jira/browse/HDFS-7773
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode, namenode
>Reporter: Anu Engineer
>Assignee: Anu Engineer
> Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch,
> hdfs-7773.003.patch
>
>
> We would like to have the following metrics added to DataNode and name node
> this to improve Ambari dashboard
> 1) DN disk i/o utilization
> 2) DN network i/o utilization
> 3) Namenode read operations
> 4) Namenode write operations
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329536#comment-14329536 ] Hudson commented on HDFS-7773: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7166 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/7166/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14330148#comment-14330148 ] Hudson commented on HDFS-7773: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #111 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/111/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14330178#comment-14330178 ] Hudson commented on HDFS-7773: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #845 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/845/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14330286#comment-14330286 ] Hudson commented on HDFS-7773: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2043 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2043/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14330307#comment-14330307 ] Hudson commented on HDFS-7773: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #102 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/102/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14332193#comment-14332193 ] Hudson commented on HDFS-7773: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #112 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/112/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14332221#comment-14332221 ] Hudson commented on HDFS-7773: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2062 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2062/]) HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. (cnauroth: rev 02e7dec79d2d4f2b801435343219d8fb53ec931f) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/metrics/TestNameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java > Additional metrics in HDFS to be accessed via jmx. > -- > > Key: HDFS-7773 > URL: https://issues.apache.org/jira/browse/HDFS-7773 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode, namenode >Reporter: Anu Engineer >Assignee: Anu Engineer > Fix For: 2.7.0 > > Attachments: hdfs-7773.001.patch, hdfs-7773.002.patch, > hdfs-7773.003.patch, hdfs-7773.branch-2.001.patch > > > We would like to have the following metrics added to DataNode and name node > this to improve Ambari dashboard > 1) DN disk i/o utilization > 2) DN network i/o utilization > 3) Namenode read operations > 4) Namenode write operations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
