Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/747/ [Jan 10, 2022 10:28:20 AM] (noreply) HDFS-16417. StaticRouterRpcFairnessPolicyController init (#3871) -1 overall The following subsystems voted -1: blanks pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml Failed junit tests : hadoop.yarn.csi.client.TestCsiClient cc: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/747/artifact/out/results-compile-cc-root.txt [96K] javac: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/747/artifact/out/results-compile-javac-root.txt [348K] blanks: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/747/artifact/out/blanks-eol.txt [13M] https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/747/artifact/out/blanks-tabs.txt [2.0M] checkstyle: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/747/artifact/out/results-checkstyle-root.txt [14M] pathlen: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/747/artifact/out/results-pathlen.txt [16K] pylint: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/747/artifact/out/results-pylint.txt [20K] shellcheck: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/747/artifact/out/results-shellcheck.txt [28K] xml: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/747/artifact/out/xml.txt [24K] javadoc: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/747/artifact/out/results-javadoc-javadoc-root.txt [408K] unit: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/747/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-csi.txt [20K] Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Sorry, I was looking for some CVE’s fixes.will make it progress on this… On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang wrote: > Is this still making progress? > > On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula > wrote: > > > Hi Akira, > > > > Thanks for your email!! > > > > I am evaluating the CVE’s which needs to go for this release.. > > > > Will update soon!! > > > > > > On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka > wrote: > > > > > Hi Brahma, > > > > > > What is the release process going on? Is there any blocker for the RC? > > > > > > -Akira > > > > > > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He > wrote: > > > > > > > Hi Brahma, > > > > > > > > The feature 'BPServiceActor processes commands from NameNode > > > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3. > > > While > > > > cherry-picking there is only minor conflict, So I checked in > directly. > > > BTW, > > > > run some unit tests and build pseudo cluster to verify, it seems to > > work > > > > fine. > > > > FYI. > > > > > > > > Regards, > > > > - He Xiaoqiao > > > > > > > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula < > > bra...@apache.org > > > > > > > > wrote: > > > > > > > >> Please go ahead. Let me know any help required on review. > > > >> > > > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He > > > wrote: > > > >> > > > >>> Hi Brahma, > > > >>> > > > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have > > > >>> resolved the conflict and verified them locally. > > > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113. > > > >>> I would like to hear some more response that if we have enough time > > to > > > >>> wait for it to be ready. > > > >>> Thanks. > > > >>> > > > >>> Best Regards, > > > >>> - He Xiaoqiao > > > >>> > > > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He > > > wrote: > > > >>> > > > Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. > FYI. > > > > > > On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula < > > > bra...@apache.org> > > > wrote: > > > > > > > Hi All, > > > > > > > > Waiting for the following jira to commit to hadoop-3.2.3 , mostly > > > this > > > > can > > > > be done by this week,then I will try to create the RC next if > there > > > is > > > > no > > > > objection. > > > > > > > > https://issues.apache.org/jira/browse/HDFS-15160 > > > > > > > > > > > > > > > > On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula < > > > > bra...@apache.org> > > > > wrote: > > > > > > > > > @Akira Ajisaka and @Masatake Iwasaki > > > > > > > > > > Looks all are build related issues when you try with bigtop. We > > can > > > > > discuss and prioritize this.. Will connect with you guys. > > > > > > > > > > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki < > > > > > iwasak...@oss.nttdata.co.jp> wrote: > > > > > > > > > >> >> - > > > > >> > > > > > > > > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff > > > > >> > > > > > >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14. > > > > >> > we do not see the issue usually since branch-3.2 uses > > > > zooekeper-3.4.13, > > > > >> > while it would be harmless to add the exclusion even for > > > > >> zooekeeper-3.4.13. > > > > >> > > > > >> I filed HADOOP-17849 for this. > > > > >> > > > > >> On 2021/08/16 12:02, Masatake Iwasaki wrote: > > > > >> > Thanks for bringing this up, Akira. Let me explain some > > > > background. > > > > >> > > > > > >> > > > > > >> >> - > > > > >> > > > > > > > > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff > > > > >> > > > > > >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14. > > > > >> > we do not see the issue usually since branch-3.2 uses > > > > zooekeper-3.4.13, > > > > >> > while it would be harmless to add the exclusion even for > > > > >> zooekeeper-3.4.13. > > > > >> > > > > > >> > > > > > >> >> - > > > > >> > > > > > > > > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff > > > > >> >> - > > > > >> > > > > > > > > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff > > > > >> >> - > > > > >> > > > > > > > > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff > > > > >> > > > > > >> > These are relevant to directory structure used by Bigtop > > > package. > > > > >> > If the fix does not break the tarball dist, > > > > >> > it would be nice to have these on Hadoop too. > > > > >> > > > > > >> >
Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/241/ [Jan 9, 2022 8:41:10 AM] (noreply) HDFS-16404. Fix typo for CachingGetSpaceUsed (#3844). Contributed by tomscut. [Jan 9, 2022 6:01:47 PM] (noreply) HADOOP-14334. S3 SSEC tests to downgrade when running against a mandatory encryption object store (#3870) [Jan 10, 2022 10:28:20 AM] (noreply) HDFS-16417. StaticRouterRpcFairnessPolicyController init (#3871) [Error replacing 'FILE' - Workspace is not accessible] - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Is this still making progress? On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula wrote: > Hi Akira, > > Thanks for your email!! > > I am evaluating the CVE’s which needs to go for this release.. > > Will update soon!! > > > On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka wrote: > > > Hi Brahma, > > > > What is the release process going on? Is there any blocker for the RC? > > > > -Akira > > > > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He wrote: > > > > > Hi Brahma, > > > > > > The feature 'BPServiceActor processes commands from NameNode > > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3. > > While > > > cherry-picking there is only minor conflict, So I checked in directly. > > BTW, > > > run some unit tests and build pseudo cluster to verify, it seems to > work > > > fine. > > > FYI. > > > > > > Regards, > > > - He Xiaoqiao > > > > > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula < > bra...@apache.org > > > > > > wrote: > > > > > >> Please go ahead. Let me know any help required on review. > > >> > > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He > > wrote: > > >> > > >>> Hi Brahma, > > >>> > > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have > > >>> resolved the conflict and verified them locally. > > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113. > > >>> I would like to hear some more response that if we have enough time > to > > >>> wait for it to be ready. > > >>> Thanks. > > >>> > > >>> Best Regards, > > >>> - He Xiaoqiao > > >>> > > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He > > wrote: > > >>> > > Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI. > > > > On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula < > > bra...@apache.org> > > wrote: > > > > > Hi All, > > > > > > Waiting for the following jira to commit to hadoop-3.2.3 , mostly > > this > > > can > > > be done by this week,then I will try to create the RC next if there > > is > > > no > > > objection. > > > > > > https://issues.apache.org/jira/browse/HDFS-15160 > > > > > > > > > > > > On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula < > > > bra...@apache.org> > > > wrote: > > > > > > > @Akira Ajisaka and @Masatake Iwasaki > > > > > > > > Looks all are build related issues when you try with bigtop. We > can > > > > discuss and prioritize this.. Will connect with you guys. > > > > > > > > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki < > > > > iwasak...@oss.nttdata.co.jp> wrote: > > > > > > > >> >> - > > > >> > > > > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff > > > >> > > > > >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14. > > > >> > we do not see the issue usually since branch-3.2 uses > > > zooekeper-3.4.13, > > > >> > while it would be harmless to add the exclusion even for > > > >> zooekeeper-3.4.13. > > > >> > > > >> I filed HADOOP-17849 for this. > > > >> > > > >> On 2021/08/16 12:02, Masatake Iwasaki wrote: > > > >> > Thanks for bringing this up, Akira. Let me explain some > > > background. > > > >> > > > > >> > > > > >> >> - > > > >> > > > > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff > > > >> > > > > >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14. > > > >> > we do not see the issue usually since branch-3.2 uses > > > zooekeper-3.4.13, > > > >> > while it would be harmless to add the exclusion even for > > > >> zooekeeper-3.4.13. > > > >> > > > > >> > > > > >> >> - > > > >> > > > > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff > > > >> >> - > > > >> > > > > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff > > > >> >> - > > > >> > > > > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff > > > >> > > > > >> > These are relevant to directory structure used by Bigtop > > package. > > > >> > If the fix does not break the tarball dist, > > > >> > it would be nice to have these on Hadoop too. > > > >> > > > > >> > > > > >> >> - > > > >> > > > > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff > > > >> > > > > >> > This is for aarch64 and ppe64le lacking required phantomjs. > > > >> > It is only acceptable for Bigtop not running tests of YARN-UI2 > > on > > > >> packaging. > > > >> > Hadoop needs the phantomjs for testing YARN-UI2. > > > >> > > > >
Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/ [Jan 10, 2022 5:16:08 PM] (Akira Ajisaka) HDFS-16410. Insecure Xml parsing in OfflineEditsXmlLoader (#3854) -1 overall The following subsystems voted -1: asflicense hadolint mvnsite pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.io.compress.snappy.TestSnappyCompressorDecompressor hadoop.fs.TestFileUtil hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat hadoop.hdfs.server.federation.router.TestRouterQuota hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver hadoop.hdfs.server.federation.resolver.order.TestLocalResolver hadoop.yarn.server.resourcemanager.TestClientRMService hadoop.yarn.server.resourcemanager.monitor.invariants.TestMetricsInvariantChecker hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter hadoop.mapreduce.lib.input.TestLineRecordReader hadoop.mapred.TestLineRecordReader hadoop.mapred.TestMROpportunisticMaps hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers hadoop.mapred.TestJobCleanup hadoop.streaming.TestRawBytesStreaming hadoop.streaming.TestStreamXmlRecordReader hadoop.tools.TestDistCpViewFs hadoop.yarn.sls.TestSLSRunner hadoop.resourceestimator.solver.impl.TestLpSolver hadoop.resourceestimator.service.TestResourceEstimatorService cc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/diff-compile-javac-root.txt [476K] checkstyle: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/diff-checkstyle-root.txt [14M] hadolint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/diff-patch-hadolint.txt [4.0K] mvnsite: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/patch-mvnsite-root.txt [556K] pathlen: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/pathlen.txt [12K] pylint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/diff-patch-pylint.txt [20K] shellcheck: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/diff-patch-shellcheck.txt [72K] whitespace: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/whitespace-eol.txt [12M] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/patch-javadoc-root.txt [40K] unit: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt [224K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [428K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt [12K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt [36K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt [20K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [120K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt [104K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/539/ar
