[ https://issues.apache.org/jira/browse/HDFS-15874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304664#comment-17304664 ]
Hadoop QA commented on HDFS-15874: ---------------------------------- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Logfile || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 58s{color} | | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || || | {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m 2s{color} | | {color:green} No case conflicting files found. {color} | | {color:blue}0{color} | {color:blue} codespell {color} | {color:blue} 0m 2s{color} | | {color:blue} codespell was not available. {color} | | {color:blue}0{color} | {color:blue} shelldocs {color} | {color:blue} 0m 2s{color} | | {color:blue} Shelldocs was not available. {color} | | {color:blue}0{color} | {color:blue} markdownlint {color} | {color:blue} 0m 1s{color} | | {color:blue} markdownlint was not available. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | | {color:green} The patch does not contain any @author tags. {color} | | {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s{color} | | {color:green} The patch appears to include 51 new or modified test files. {color} | || || || || {color:brown} trunk Compile Tests {color} || || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 14m 1s{color} | | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 22m 32s{color} | | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 22m 30s{color} | | {color:green} trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 19m 16s{color} | | {color:green} trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 4m 27s{color} | | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 25m 58s{color} | | {color:green} trunk passed {color} | | {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 1m 13s{color} | [/branch-javadoc-root-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04.txt|https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2744/4/artifact/out/branch-javadoc-root-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04.txt] | {color:red} root in trunk failed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 8m 51s{color} | | {color:green} trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 {color} | | {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 76m 51s{color} | | {color:blue} Both FindBugs and SpotBugs are enabled, using SpotBugs. {color} | | {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m 25s{color} | | {color:blue} branch/hadoop-project no spotbugs output file (spotbugsXml.xml) {color} | | {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m 21s{color} | | {color:blue} branch/hadoop-hdfs-project/hadoop-hdfs-native-client no spotbugs output file (spotbugsXml.xml) {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 62m 11s{color} | | {color:green} branch has no errors when building and testing our client artifacts. {color} | || || || || {color:brown} Patch Compile Tests {color} || || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 32s{color} | | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 39m 16s{color} | | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 26m 37s{color} | | {color:green} the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 {color} | | {color:red}-1{color} | {color:red} cc {color} | {color:red} 26m 37s{color} | [/results-compile-cc-root-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04.txt|https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2744/4/artifact/out/results-compile-cc-root-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04.txt] | {color:red} root-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 generated 38 new + 374 unchanged - 38 fixed = 412 total (was 412) {color} | | {color:green}+1{color} | {color:green} golang {color} | {color:green} 26m 37s{color} | | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 26m 37s{color} | | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 24m 40s{color} | | {color:green} the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 {color} | | {color:red}-1{color} | {color:red} cc {color} | {color:red} 24m 40s{color} | [/results-compile-cc-root-jdkPrivateBuild-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08.txt|https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2744/4/artifact/out/results-compile-cc-root-jdkPrivateBuild-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08.txt] | {color:red} root-jdkPrivateBuild-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 generated 45 new + 367 unchanged - 45 fixed = 412 total (was 412) {color} | | {color:green}+1{color} | {color:green} golang {color} | {color:green} 24m 40s{color} | | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 24m 40s{color} | | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} blanks {color} | {color:red} 0m 0s{color} | [/blanks-eol.txt|https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2744/4/artifact/out/blanks-eol.txt] | {color:red} The patch has 79 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply {color} | | {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange} 5m 16s{color} | [/results-checkstyle-root.txt|https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2744/4/artifact/out/results-checkstyle-root.txt] | {color:orange} root: The patch generated 40 new + 3468 unchanged - 6 fixed = 3508 total (was 3474) {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 27m 42s{color} | | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} shellcheck {color} | {color:green} 0m 8s{color} | | {color:green} No new issues. {color} | | {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m 9s{color} | | {color:green} The patch has no ill-formed XML file. {color} | | {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 9m 39s{color} | [/results-javadoc-javadoc-root-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04.txt|https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2744/4/artifact/out/results-javadoc-javadoc-root-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04.txt] | {color:red} root-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 generated 1785 new + 99 unchanged - 1 fixed = 1884 total (was 100) {color} | | {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 10m 14s{color} | [/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08.txt|https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2744/4/artifact/out/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08.txt] | {color:red} root-jdkPrivateBuild-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 generated 1 new + 6656 unchanged - 1 fixed = 6657 total (was 6657) {color} | | {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m 21s{color} | | {color:blue} hadoop-project has no data from spotbugs {color} | | {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m 21s{color} | | {color:blue} hadoop-hdfs-project/hadoop-hdfs-native-client has no data from spotbugs {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 50m 21s{color} | | {color:green} patch has no errors when building and testing our client artifacts. {color} | || || || || {color:brown} Other Tests {color} || || | {color:red}-1{color} | {color:red} unit {color} | {color:red}708m 58s{color} | [/patch-unit-root.txt|https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2744/4/artifact/out/patch-unit-root.txt] | {color:red} root in the patch passed. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 1m 21s{color} | | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black}1149m 22s{color} | | {color:black}{color} | \\ \\ || Reason || Tests || | Failed junit tests | hadoop.yarn.server.resourcemanager.reservation.TestCapacityOverTimePolicy | | | hadoop.yarn.server.router.clientrm.TestFederationClientInterceptor | | | hadoop.security.TestRaceWhenRelogin | | | hadoop.yarn.sls.appmaster.TestAMSimulator | | | hadoop.tools.dynamometer.TestDynamometerInfra | \\ \\ || Subsystem || Report/Notes || | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2744/4/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/2744 | | JIRA Issue | HDFS-15874 | | Optional Tests | dupname asflicense codespell shellcheck shelldocs mvnsite unit compile javac javadoc mvninstall shadedclient spotbugs checkstyle markdownlint xml cc golang | | uname | Linux 15889d3df7dd 4.15.0-136-generic #140-Ubuntu SMP Thu Jan 28 05:20:47 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/bin/hadoop.sh | | git revision | trunk / 326b41fd2c2bb3fb72770110d48002f0d15cea56 | | Default Java | Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 | | Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 | | Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2744/4/testReport/ | | Max. process+thread count | 2605 (vs. ulimit of 5500) | | modules | C: hadoop-project hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-native-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-hdfs-project/hadoop-hdfs-rbf hadoop-tools/hadoop-aws hadoop-tools/hadoop-kafka hadoop-tools/hadoop-azure . U: . | | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2744/4/console | | versions | git=2.25.1 maven=3.6.3 shellcheck=0.7.0 spotbugs=4.2.2 | | Powered by | Apache Yetus 0.13.0 https://yetus.apache.org | This message was automatically generated. > Extend TopMetrics to support callerContext aggregation. > ------------------------------------------------------- > > Key: HDFS-15874 > URL: https://issues.apache.org/jira/browse/HDFS-15874 > Project: Hadoop HDFS > Issue Type: Improvement > Reporter: Qi Zhu > Assignee: Qi Zhu > Priority: Major > Labels: pull-request-available > Attachments: image-2021-03-05-12-01-16-852.png > > Time Spent: 40m > Remaining Estimate: 0h > > Now top metrics for namenode op is only supported aggregation for user, the > top user op is useful. > But actually, the most useful is the callerContext aggregation, we can use > this to aggregate the running apps in yarn or the scheduling jobs by extend > the callerContext in such as (oozie or airflow), so that we can get the real > time top pressure to namenode. > cc [~weichiu] [~hexiaoqiao] [~ayushtkn] [~shv] [~ferhui] -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org