Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/ [Jan 8, 2018 9:20:17 PM] (billie) YARN-7704. Document improvement for registry dns. Contributed by Jian He [Jan 8, 2018 10:25:39 PM] (weiy) HDFS-12945. Switch to ClientProtocol instead of NamenodeProtocols in [Jan 8, 2018 11:34:00 PM] (manojpec) HDFS-12985. NameNode crashes during restart after an OpenForWrite file [Jan 9, 2018 12:19:02 AM] (rchiang) YARN-4227. Ignore expired containers from removed nodes in [Jan 9, 2018 1:51:09 AM] (inigoiri) HDFS-12808. Add LOG.isDebugEnabled() guard for LOG.debug(...). -1 overall The following subsystems voted -1: asflicense findbugs unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: FindBugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api org.apache.hadoop.yarn.api.records.Resource.getResources() may expose internal representation by returning Resource.resources At Resource.java:by returning Resource.resources At Resource.java:[line 234] Failed junit tests : hadoop.security.TestRaceWhenRelogin hadoop.hdfs.TestReadStripedFileWithMissingBlocks hadoop.hdfs.TestErasureCodingMultipleRacks hadoop.hdfs.qjournal.server.TestJournalNodeSync hadoop.hdfs.server.namenode.TestFSImage hadoop.yarn.server.nodemanager.webapp.TestContainerLogsPage hadoop.yarn.server.resourcemanager.TestResourceTrackerService hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.client.api.impl.TestAMRMClientOnRMRestart hadoop.mapreduce.v2.app.rm.TestRMContainerAllocator hadoop.mapreduce.v2.TestUberAM hadoop.yarn.sls.nodemanager.TestNMSimulator cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-compile-javac-root.txt [280K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-checkstyle-root.txt [17M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/whitespace-eol.txt [9.2M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/whitespace-tabs.txt [292K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api-warnings.html [8.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-javadoc-javadoc-root.txt [760K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt [156K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [256K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [44K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [76K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt [20K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-app.txt [108K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [84K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-tools_hadoop-sls.txt [12K] asflicense: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifac
Apache Hadoop 3.0.1 Release plan
Hi, All We have released Apache Hadoop 3.0.0 in December [1]. To further improve the quality of release, we plan to cut branch-3.0.1 branch tomorrow for the preparation of Apache Hadoop 3.0.1 release. The focus of 3.0.1 will be fixing blockers (3), critical bugs (1) and bug fixes [2]. No new features and improvement should be included. We plan to cut branch-3.0.1 tomorrow (Jan 10th) and vote for RC on Feb 1st, targeting for Feb 9th release. Please feel free to share your insights. [1] https://www.mail-archive.com/general@hadoop.apache.org/msg07757.html [2] https://issues.apache.org/jira/issues/?filter=12342842 Best, -- Lei (Eddy) Xu Software Engineer, Cloudera - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Re: Apache Hadoop 3.0.1 Release plan
Hi Eddy, thanks for taking this on, Historically we've waited for the first RC to cut the release branch since it keeps things simpler for committers. Also, could you check the permissions on your JIRA filter? It shows as private for me. Best, Andrew On Tue, Jan 9, 2018 at 11:17 AM, Lei Xu wrote: > Hi, All > > We have released Apache Hadoop 3.0.0 in December [1]. To further > improve the quality of release, we plan to cut branch-3.0.1 branch > tomorrow for the preparation of Apache Hadoop 3.0.1 release. The focus > of 3.0.1 will be fixing blockers (3), critical bugs (1) and bug fixes > [2]. No new features and improvement should be included. > > We plan to cut branch-3.0.1 tomorrow (Jan 10th) and vote for RC on Feb > 1st, targeting for Feb 9th release. > > Please feel free to share your insights. > > [1] https://www.mail-archive.com/general@hadoop.apache.org/msg07757.html > [2] https://issues.apache.org/jira/issues/?filter=12342842 > > Best, > -- > Lei (Eddy) Xu > Software Engineer, Cloudera > > - > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > >
Re: Apache Hadoop 3.0.1 Release plan
Is it necessary to cut the branch so far ahead of the release? branch-3.0 is already a maintenance line for 3.0.x releases. Is there a known feature/improvement planned to go into branch-3.0 that is not desirable for the 3.0.1 release? I have found in the past that branching so early leads to many useful fixes being unnecessarily postponed to future releases because committers forget to pick to the new, relatively long-lived patch branch. This becomes especially true if blockers end up dragging out the ultimate release date, which has historically been quite common. My preference would be to cut this branch as close to the RC as possible. Jason On Tue, Jan 9, 2018 at 1:17 PM, Lei Xu wrote: > Hi, All > > We have released Apache Hadoop 3.0.0 in December [1]. To further > improve the quality of release, we plan to cut branch-3.0.1 branch > tomorrow for the preparation of Apache Hadoop 3.0.1 release. The focus > of 3.0.1 will be fixing blockers (3), critical bugs (1) and bug fixes > [2]. No new features and improvement should be included. > > We plan to cut branch-3.0.1 tomorrow (Jan 10th) and vote for RC on Feb > 1st, targeting for Feb 9th release. > > Please feel free to share your insights. > > [1] https://www.mail-archive.com/general@hadoop.apache.org/msg07757.html > [2] https://issues.apache.org/jira/issues/?filter=12342842 > > Best, > -- > Lei (Eddy) Xu > Software Engineer, Cloudera > > - > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org > >
Re: Apache Hadoop 3.0.1 Release plan
Hi, Andrew and Jason Thanks for the feedback! I will follow the pattern and cut the branch on Feb 1st and start the RC vote around Feb 5th then. Best On Tue, Jan 9, 2018 at 11:35 AM, Jason Lowe wrote: > Is it necessary to cut the branch so far ahead of the release? branch-3.0 > is already a maintenance line for 3.0.x releases. Is there a known > feature/improvement planned to go into branch-3.0 that is not desirable for > the 3.0.1 release? > > I have found in the past that branching so early leads to many useful fixes > being unnecessarily postponed to future releases because committers forget > to pick to the new, relatively long-lived patch branch. This becomes > especially true if blockers end up dragging out the ultimate release date, > which has historically been quite common. My preference would be to cut > this branch as close to the RC as possible. > > Jason > > > On Tue, Jan 9, 2018 at 1:17 PM, Lei Xu wrote: >> >> Hi, All >> >> We have released Apache Hadoop 3.0.0 in December [1]. To further >> improve the quality of release, we plan to cut branch-3.0.1 branch >> tomorrow for the preparation of Apache Hadoop 3.0.1 release. The focus >> of 3.0.1 will be fixing blockers (3), critical bugs (1) and bug fixes >> [2]. No new features and improvement should be included. >> >> We plan to cut branch-3.0.1 tomorrow (Jan 10th) and vote for RC on Feb >> 1st, targeting for Feb 9th release. >> >> Please feel free to share your insights. >> >> [1] https://www.mail-archive.com/general@hadoop.apache.org/msg07757.html >> [2] https://issues.apache.org/jira/issues/?filter=12342842 >> >> Best, >> -- >> Lei (Eddy) Xu >> Software Engineer, Cloudera >> >> - >> To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org >> For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org >> > -- Lei (Eddy) Xu Software Engineer, Cloudera - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Re: Apache Hadoop 3.0.1 Release plan
Hi, Andrew and Jason Thanks for the feedback! I will follow the pattern and cut the branch on Feb 1st and start the RC vote around Feb 5th then. Best On Tue, Jan 9, 2018 at 11:35 AM, Jason Lowe wrote: > Is it necessary to cut the branch so far ahead of the release? branch-3.0 > is already a maintenance line for 3.0.x releases. Is there a known > feature/improvement planned to go into branch-3.0 that is not desirable for > the 3.0.1 release? > > I have found in the past that branching so early leads to many useful fixes > being unnecessarily postponed to future releases because committers forget > to pick to the new, relatively long-lived patch branch. This becomes > especially true if blockers end up dragging out the ultimate release date, > which has historically been quite common. My preference would be to cut > this branch as close to the RC as possible. > > Jason > > > On Tue, Jan 9, 2018 at 1:17 PM, Lei Xu wrote: >> >> Hi, All >> >> We have released Apache Hadoop 3.0.0 in December [1]. To further >> improve the quality of release, we plan to cut branch-3.0.1 branch >> tomorrow for the preparation of Apache Hadoop 3.0.1 release. The focus >> of 3.0.1 will be fixing blockers (3), critical bugs (1) and bug fixes >> [2]. No new features and improvement should be included. >> >> We plan to cut branch-3.0.1 tomorrow (Jan 10th) and vote for RC on Feb >> 1st, targeting for Feb 9th release. >> >> Please feel free to share your insights. >> >> [1] https://www.mail-archive.com/general@hadoop.apache.org/msg07757.html >> [2] https://issues.apache.org/jira/issues/?filter=12342842 >> >> Best, >> -- >> Lei (Eddy) Xu >> Software Engineer, Cloudera >> >> - >> To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org >> For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org >> > -- Lei (Eddy) Xu Software Engineer, Cloudera - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/ [Jan 9, 2018 11:09:33 AM] (sunilg) YARN-7718. DistributedShell failed to specify resource other than [Jan 9, 2018 12:27:01 PM] (bibinchundatt) YARN-7508. NPE in FiCaSchedulerApp when debug log enabled in [Jan 9, 2018 3:52:59 PM] (jlowe) YARN-7663. RMAppImpl:Invalid event: START at KILLED. Contributed by -1 overall The following subsystems voted -1: asflicense findbugs unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: FindBugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api org.apache.hadoop.yarn.api.records.Resource.getResources() may expose internal representation by returning Resource.resources At Resource.java:by returning Resource.resources At Resource.java:[line 234] Failed junit tests : hadoop.hdfs.TestErasureCodingPoliciesWithRandomECPolicy hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.hdfs.TestReadStripedFileWithMissingBlocks hadoop.hdfs.TestLeaseRecovery2 hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070 hadoop.hdfs.TestReconstructStripedFile hadoop.hdfs.TestDFSStripedOutputStreamWithFailure000 hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage hadoop.hdfs.TestBlockStoragePolicy hadoop.hdfs.TestErasureCodingMultipleRacks hadoop.hdfs.TestDFSInotifyEventInputStream hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting hadoop.hdfs.qjournal.server.TestJournalNodeSync hadoop.hdfs.TestDecommission hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-compile-javac-root.txt [280K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-checkstyle-root.txt [17M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/whitespace-eol.txt [9.2M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/whitespace-tabs.txt [292K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api-warnings.html [8.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-javadoc-javadoc-root.txt [760K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [556K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-common.txt [72K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-web-proxy.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop