[jira] [Commented] (YARN-2157) Document YARN metrics
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14218017#comment-14218017 ] Hudson commented on YARN-2157: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #10 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/10/]) YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA (jianhe: rev 90a968d6757511b6d89538516db0e699129d854c) * hadoop-yarn-project/CHANGES.txt * hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm > Document YARN metrics > - > > Key: YARN-2157 > URL: https://issues.apache.org/jira/browse/YARN-2157 > Project: Hadoop YARN > Issue Type: Improvement > Components: documentation >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA > Fix For: 2.7.0 > > Attachments: YARN-2157.2.patch, YARN-2157.3.patch, YARN-2157.patch > > > YARN-side of HADOOP-6350. Add YARN metrics to Metrics document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2157) Document YARN metrics
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217998#comment-14217998 ] Hudson commented on YARN-2157: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1962 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1962/]) YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA (jianhe: rev 90a968d6757511b6d89538516db0e699129d854c) * hadoop-yarn-project/CHANGES.txt * hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm > Document YARN metrics > - > > Key: YARN-2157 > URL: https://issues.apache.org/jira/browse/YARN-2157 > Project: Hadoop YARN > Issue Type: Improvement > Components: documentation >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA > Fix For: 2.7.0 > > Attachments: YARN-2157.2.patch, YARN-2157.3.patch, YARN-2157.patch > > > YARN-side of HADOOP-6350. Add YARN metrics to Metrics document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2157) Document YARN metrics
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217949#comment-14217949 ] Hudson commented on YARN-2157: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1938 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1938/]) YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA (jianhe: rev 90a968d6757511b6d89538516db0e699129d854c) * hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm * hadoop-yarn-project/CHANGES.txt > Document YARN metrics > - > > Key: YARN-2157 > URL: https://issues.apache.org/jira/browse/YARN-2157 > Project: Hadoop YARN > Issue Type: Improvement > Components: documentation >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA > Fix For: 2.7.0 > > Attachments: YARN-2157.2.patch, YARN-2157.3.patch, YARN-2157.patch > > > YARN-side of HADOOP-6350. Add YARN metrics to Metrics document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2157) Document YARN metrics
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217931#comment-14217931 ] Hudson commented on YARN-2157: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #10 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/10/]) YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA (jianhe: rev 90a968d6757511b6d89538516db0e699129d854c) * hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm * hadoop-yarn-project/CHANGES.txt > Document YARN metrics > - > > Key: YARN-2157 > URL: https://issues.apache.org/jira/browse/YARN-2157 > Project: Hadoop YARN > Issue Type: Improvement > Components: documentation >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA > Fix For: 2.7.0 > > Attachments: YARN-2157.2.patch, YARN-2157.3.patch, YARN-2157.patch > > > YARN-side of HADOOP-6350. Add YARN metrics to Metrics document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2157) Document YARN metrics
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217723#comment-14217723 ] Hudson commented on YARN-2157: -- FAILURE: Integrated in Hadoop-Yarn-trunk #748 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/748/]) YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA (jianhe: rev 90a968d6757511b6d89538516db0e699129d854c) * hadoop-yarn-project/CHANGES.txt * hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm > Document YARN metrics > - > > Key: YARN-2157 > URL: https://issues.apache.org/jira/browse/YARN-2157 > Project: Hadoop YARN > Issue Type: Improvement > Components: documentation >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA > Fix For: 2.7.0 > > Attachments: YARN-2157.2.patch, YARN-2157.3.patch, YARN-2157.patch > > > YARN-side of HADOOP-6350. Add YARN metrics to Metrics document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2157) Document YARN metrics
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217713#comment-14217713 ] Hudson commented on YARN-2157: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #10 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/10/]) YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA (jianhe: rev 90a968d6757511b6d89538516db0e699129d854c) * hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm * hadoop-yarn-project/CHANGES.txt > Document YARN metrics > - > > Key: YARN-2157 > URL: https://issues.apache.org/jira/browse/YARN-2157 > Project: Hadoop YARN > Issue Type: Improvement > Components: documentation >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA > Fix For: 2.7.0 > > Attachments: YARN-2157.2.patch, YARN-2157.3.patch, YARN-2157.patch > > > YARN-side of HADOOP-6350. Add YARN metrics to Metrics document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2157) Document YARN metrics
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217268#comment-14217268 ] Akira AJISAKA commented on YARN-2157: - Thank you, [~jianhe]! > Document YARN metrics > - > > Key: YARN-2157 > URL: https://issues.apache.org/jira/browse/YARN-2157 > Project: Hadoop YARN > Issue Type: Improvement > Components: documentation >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA > Fix For: 2.7.0 > > Attachments: YARN-2157.2.patch, YARN-2157.3.patch, YARN-2157.patch > > > YARN-side of HADOOP-6350. Add YARN metrics to Metrics document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2157) Document YARN metrics
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217122#comment-14217122 ] Hudson commented on YARN-2157: -- FAILURE: Integrated in Hadoop-trunk-Commit #6570 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/6570/]) YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA (jianhe: rev 90a968d6757511b6d89538516db0e699129d854c) * hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm * hadoop-yarn-project/CHANGES.txt > Document YARN metrics > - > > Key: YARN-2157 > URL: https://issues.apache.org/jira/browse/YARN-2157 > Project: Hadoop YARN > Issue Type: Improvement > Components: documentation >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA > Fix For: 2.7.0 > > Attachments: YARN-2157.2.patch, YARN-2157.3.patch, YARN-2157.patch > > > YARN-side of HADOOP-6350. Add YARN metrics to Metrics document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2157) Document YARN metrics
[
https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217084#comment-14217084
]
Hadoop QA commented on YARN-2157:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12682280/YARN-2157.3.patch
against trunk revision fbf81fb.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+0 tests included{color}. The patch appears to be a
documentation patch that doesn't require tests.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/5872//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5872//console
This message is automatically generated.
> Document YARN metrics
> -
>
> Key: YARN-2157
> URL: https://issues.apache.org/jira/browse/YARN-2157
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: documentation
>Reporter: Akira AJISAKA
>Assignee: Akira AJISAKA
> Attachments: YARN-2157.2.patch, YARN-2157.3.patch, YARN-2157.patch
>
>
> YARN-side of HADOOP-6350. Add YARN metrics to Metrics document.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2157) Document YARN metrics
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217006#comment-14217006 ] Jian He commented on YARN-2157: --- thanks [~ajisakaa], sorry for the late feedback. looks good to me. just made some very minor edits myself. pending jenkins. > Document YARN metrics > - > > Key: YARN-2157 > URL: https://issues.apache.org/jira/browse/YARN-2157 > Project: Hadoop YARN > Issue Type: Improvement > Components: documentation >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA > Attachments: YARN-2157.2.patch, YARN-2157.3.patch, YARN-2157.patch > > > YARN-side of HADOOP-6350. Add YARN metrics to Metrics document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2157) Document YARN metrics
[
https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033358#comment-14033358
]
Hadoop QA commented on YARN-2157:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12650712/YARN-2157.2.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+0 tests included{color}. The patch appears to be a
documentation patch that doesn't require tests.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/4007//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/4007//console
This message is automatically generated.
> Document YARN metrics
> -
>
> Key: YARN-2157
> URL: https://issues.apache.org/jira/browse/YARN-2157
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: documentation
>Reporter: Akira AJISAKA
>Assignee: Akira AJISAKA
> Attachments: YARN-2157.2.patch, YARN-2157.patch
>
>
> YARN-side of HADOOP-6350. Add YARN metrics to Metrics document.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-2157) Document YARN metrics
[
https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033165#comment-14033165
]
Jian He commented on YARN-2157:
---
Thanks for the patch! Some suggestions on the patch:
ClusterMetrics shows the metrics of the YARN cluster? such as…
{code}
ClusterMetrics shows the statistics of NodeManagers from the
+ ResourceManager's perspective
{code}
Do you mean the queue name? if so, we can use queue name.
{code}
queue identifier
{code}
Can you clarify more about what this format means?
{code}
<<>>
{code}
Can you please clarify the definition of pending applications? i.e. an
application that has not yet been assigned any containers.
Total number of applications killed -> Total number of killed applications,
similarly for “Total number of applications failed”
can you clarify the meaning of PendingMB, PendingVCores, PendingContainers
also? i.e. the pending resource requests that are not yet fulfilled by the
scheduler.
allocatedContainers can be put before allocatedGB for consistency.
{code}
+*-+--+
+|<<>> | Current allocated memory in GB
+*-+--+
+|<<>> | Current number of allocated containers
+*-+--+
{code}
> Document YARN metrics
> -
>
> Key: YARN-2157
> URL: https://issues.apache.org/jira/browse/YARN-2157
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: documentation
>Reporter: Akira AJISAKA
>Assignee: Akira AJISAKA
> Attachments: YARN-2157.patch
>
>
> YARN-side of HADOOP-6350. Add YARN metrics to Metrics document.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-2157) Document YARN metrics
[
https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030958#comment-14030958
]
Hadoop QA commented on YARN-2157:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12650339/YARN-2157.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+0 tests included{color}. The patch appears to be a
documentation patch that doesn't require tests.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/3982//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3982//console
This message is automatically generated.
> Document YARN metrics
> -
>
> Key: YARN-2157
> URL: https://issues.apache.org/jira/browse/YARN-2157
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: documentation
>Reporter: Akira AJISAKA
>Assignee: Akira AJISAKA
> Attachments: YARN-2157.patch
>
>
> YARN-side of HADOOP-6350. Add YARN metrics to Metrics document.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-2157) Document YARN metrics
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030943#comment-14030943 ] Jian He commented on YARN-2157: --- [~ajisakaa], Thanks for working on this ! this will be useful. > Document YARN metrics > - > > Key: YARN-2157 > URL: https://issues.apache.org/jira/browse/YARN-2157 > Project: Hadoop YARN > Issue Type: Improvement > Components: documentation >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA > Attachments: YARN-2157.patch > > > YARN-side of HADOOP-6350. Add YARN metrics to Metrics document. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-2157) Document YARN metrics
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14029996#comment-14029996 ] Akira AJISAKA commented on YARN-2157: - I'll attach a patch to add YARN metrics to the document after HADOOP-6350 will be committed. > Document YARN metrics > - > > Key: YARN-2157 > URL: https://issues.apache.org/jira/browse/YARN-2157 > Project: Hadoop YARN > Issue Type: Improvement > Components: documentation >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA > > YARN-side of HADOOP-6350. -- This message was sent by Atlassian JIRA (v6.2#6252)
