Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
I'm going to cut RC0 on behalf of Brahma on this weekend. There looks no blocker/critical issues on JIRA. https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release branch-3.2.3 was cut and version was set by Brahma. https://github.com/apache/hadoop/tree/branch-3.2.3 I found some TODOs to cut RC from branch-3.2.3. * Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running create-release script. https://issues.apache.org/jira/browse/HADOOP-17718 * Checking git commit / Jira fixVersion discrepancies by script added by HADOOP-18125. https://issues.apache.org/jira/browse/HADOOP-18125 While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3 without this. We can release 3.2.4 right after 3.2.3 just for reload4j migration if we need. https://issues.apache.org/jira/browse/HADOOP-18088 Thanks, Masatake Iwasaki On 2022/03/10 12:23, Xiaoqiao He wrote:
Thanks Masatake for reaching out. Not sure if Brahma has bandwidth to push this release forward. If there is no more bandwidth, I think we should involve other volunteers to make it happen. Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help. Thanks again. Regards - He Xiaoqiao On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <iwasak...@oss.nttdata.co.jp <mailto:iwasak...@oss.nttdata.co.jp>> wrote: Hi Brahma, I would like to use 3.2.3 for next minor release of Bigtop. https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605> Let me know if there is any blocker I can help. Thanks, Masatake Iwasaki On 2022/01/12 4:41, Brahma Reddy Battula wrote: > Sorry, I was looking for some CVE’s fixes.will make it progress on this… > > > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <weic...@apache.org <mailto:weic...@apache.org>> wrote: > >> Is this still making progress? >> >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <bra...@apache.org <mailto:bra...@apache.org>> >> wrote: >> >>> Hi Akira, >>> >>> Thanks for your email!! >>> >>> I am evaluating the CVE’s which needs to go for this release.. >>> >>> Will update soon!! >>> >>> >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aajis...@apache.org <mailto:aajis...@apache.org>> >> wrote: >>> >>>> Hi Brahma, >>>> >>>> What is the release process going on? Is there any blocker for the RC? >>>> >>>> -Akira >>>> >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq.he2...@gmail.com <mailto:xq.he2...@gmail.com>> >> wrote: >>>> >>>>> Hi Brahma, >>>>> >>>>> The feature 'BPServiceActor processes commands from NameNode >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3. >>>> While >>>>> cherry-picking there is only minor conflict, So I checked in >> directly. >>>> BTW, >>>>> run some unit tests and build pseudo cluster to verify, it seems to >>> work >>>>> fine. >>>>> FYI. >>>>> >>>>> Regards, >>>>> - He Xiaoqiao >>>>> >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula < >>> bra...@apache.org <mailto:bra...@apache.org> >>>>> >>>>> wrote: >>>>> >>>>>> Please go ahead. Let me know any help required on review. >>>>>> >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq.he2...@gmail.com <mailto:xq.he2...@gmail.com>> >>>> wrote: >>>>>> >>>>>>> Hi Brahma, >>>>>>> >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have >>>>>>> resolved the conflict and verified them locally. >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113. >>>>>>> I would like to hear some more response that if we have enough time >>> to >>>>>>> wait for it to be ready. >>>>>>> Thanks. >>>>>>> >>>>>>> Best Regards, >>>>>>> - He Xiaoqiao >>>>>>> >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq.he2...@gmail.com <mailto:xq.he2...@gmail.com>> >>>> wrote: >>>>>>> >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. >> FYI. >>>>>>>> >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula < >>>> bra...@apache.org <mailto:bra...@apache.org>> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Hi All, >>>>>>>>> >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly >>>> this >>>>>>>>> can >>>>>>>>> be done by this week,then I will try to create the RC next if >> there >>>> is >>>>>>>>> no >>>>>>>>> objection. >>>>>>>>> >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula < >>>>>>>>> bra...@apache.org <mailto:bra...@apache.org>> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> @Akira Ajisaka <aajis...@apache.org <mailto:aajis...@apache.org>> and @Masatake Iwasaki >>>>>>>>>> <iwasak...@oss.nttdata.co.jp <mailto:iwasak...@oss.nttdata.co.jp>> >>>>>>>>>> Looks all are build related issues when you try with bigtop. We >>> can >>>>>>>>>> discuss and prioritize this.. Will connect with you guys. >>>>>>>>>> >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki < >>>>>>>>>> iwasak...@oss.nttdata.co.jp <mailto:iwasak...@oss.nttdata.co.jp>> wrote: >>>>>>>>>> >>>>>>>>>>>>> - >>>>>>>>>>> >>>>>>>>> >>>> >>> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> >>>>>>>>>>>> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14. >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses >>>>>>>>> zooekeper-3.4.13, >>>>>>>>>>>> while it would be harmless to add the exclusion even for >>>>>>>>>>> zooekeeper-3.4.13. >>>>>>>>>>> >>>>>>>>>>> I filed HADOOP-17849 for this. >>>>>>>>>>> >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote: >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some >>>>>>>>> background. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>>> - >>>>>>>>>>> >>>>>>>>> >>>> >>> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> >>>>>>>>>>>> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14. >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses >>>>>>>>> zooekeper-3.4.13, >>>>>>>>>>>> while it would be harmless to add the exclusion even for >>>>>>>>>>> zooekeeper-3.4.13. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>>> - >>>>>>>>>>> >>>>>>>>> >>>> >>> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff> >>>>>>>>>>>>> - >>>>>>>>>>> >>>>>>>>> >>>> >>> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff> >>>>>>>>>>>>> - >>>>>>>>>>> >>>>>>>>> >>>> >>> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff> >>>>>>>>>>>> >>>>>>>>>>>> These are relevant to directory structure used by Bigtop >>>> package. >>>>>>>>>>>> If the fix does not break the tarball dist, >>>>>>>>>>>> it would be nice to have these on Hadoop too. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>>> - >>>>>>>>>>> >>>>>>>>> >>>> >>> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff> >>>>>>>>>>>> >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs. >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of >> YARN-UI2 >>>> on >>>>>>>>>>> packaging. >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote: >>>>>>>>>>>>> Thanks, I'll check them out. >>>>>>>>>>>>> >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka < >>>>>>>>> aajis...@apache.org <mailto:aajis...@apache.org>> >>>>>>>>>>> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3. >>>>>>>>>>>>>> >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop >>>>>>>>> 3.2.2. >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>> >>> >> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop> >>>>>>>>>>>>>> >>>>>>>>>>>>>> In these patches, how about backporting the following >> issues >>>> to >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3? >>>>>>>>>>>>>> - HADOOP-14922 >>>>>>>>>>>>>> - HADOOP-15939 >>>>>>>>>>>>>> - HADOOP-17569 >>>>>>>>>>>>>> >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA >>> issue >>>>>>>>> ID. >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those. >>>>>>>>>>>>>> - >>>>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>> >>> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> >>>>>>>>>>>>>> - >>>>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>> >>> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff> >>>>>>>>>>>>>> - >>>>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>> >>> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff> >>>>>>>>>>>>>> - >>>>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>> >>> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff> >>>>>>>>>>>>>> - >>>>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>> >>> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff> >>>>>>>>>>>>>> >>>>>>>>>>>>>> Thanks and regards, >>>>>>>>>>>>>> Akira >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He < >>>>>>>>> hexiaoq...@apache.org <mailto:hexiaoq...@apache.org>> >>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3 >>>>>>>>> release >>>>>>>>>>> happen. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> I would like to validate the HBase project (both the >> latest >>>>>>>>> release >>>>>>>>>>> and >>>>>>>>>>>>>>> trunk branch). >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch >> with >>>>>>>>> Chao >>>>>>>>>>>>>> already). >>>>>>>>>>>>>>> once RC is out. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Thanks and Regards, >>>>>>>>>>>>>>> - He Xiaoqiao >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula < >>>>>>>>>>> bra...@apache.org <mailto:bra...@apache.org>> >>>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hi All, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please >>>> commit >>>>>>>>> to >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects >> and >>>>>>>>>>> companies' >>>>>>>>>>>>>>>> voices,let's know how this can go. * >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> - Planning to check with downstream projects like >>>>>>>>> Spark,HBase >>>>>>>>>>> and >>>>>>>>>>>>>> Hive >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT >> on >>>> this >>>>>>>>>>> branch) >>>>>>>>>>>>>>>> - Collecting info from Companies who are already >>>> deployed >>>>>>>>> and >>>>>>>>>>> using >>>>>>>>>>>>>> the >>>>>>>>>>>>>>>> branch-3.2 >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so >> that >>>>>>>>> features >>>>>>>>>>>>>> released >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know >>>>>>>>> anybody from >>>>>>>>>>>>>> these >>>>>>>>>>>>>>>> communities who can help on this. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions >>> are >>>>>>>>>>> welcome. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> --Brahma Reddy Battula >>>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>> >>> --------------------------------------------------------------------- >>>>>>>>>>>> To unsubscribe, e-mail: >>>> common-dev-unsubscr...@hadoop.apache.org <mailto:common-dev-unsubscr...@hadoop.apache.org> >>>>>>>>>>>> For additional commands, e-mail: >>>>>>>>> common-dev-h...@hadoop.apache.org <mailto:common-dev-h...@hadoop.apache.org> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> --Brahma Reddy Battula >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> --Brahma Reddy Battula >>>>>>>>> >>>>>>>> >>>>>> >>>>>> -- >>>>>> >>>>>> >>>>>> >>>>>> --Brahma Reddy Battula >>>>>> >>>>> >>>> >>> -- >>> >>> >>> >>> --Brahma Reddy Battula >>> >> --------------------------------------------------------------------- To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org <mailto:common-dev-unsubscr...@hadoop.apache.org> For additional commands, e-mail: common-dev-h...@hadoop.apache.org <mailto:common-dev-h...@hadoop.apache.org>
--------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org