Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Hi folks, Thanks for your try and vote for RC4. I just prepare RC5 following the comment/ack and call another release vote[1]. To Masatake Iwasaki, > The step #4 of "Branching" section in HowToRelease is relevant instruction. > https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease > |

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Thanks Sunil, it makes sense to me. Will backport and prepare another RC shortly. - He Xiaoqiao On Wed, Dec 23, 2020 at 10:59 PM Sunil Govindan wrote: > Hi Xiaoqiao > This is not an issue. You are missing the CORS config in YARN. I have > updated those configurations in the jira. > I feel that

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Hi Xiaoqiao This is not an issue. You are missing the CORS config in YARN. I have updated those configurations in the jira. I feel that we can call a new RC as YARN-10540 is backported already. Thanks Sunil On Wed, Dec 23, 2020 at 3:54 PM Xiaoqiao He wrote: > Thanks Jim, Eric and Sunil, > > I t

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Thanks Jim, Eric and Sunil, I tried to backport YARN-10540 to branch-3.2.2 at local and check yarn ui2, there is still one link that does not work correctly, But I am not sure if it is expected. Detailed information is attached at YARN-10540. If someone could confirm or update, please let me know.

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

We should target 3.4.0, 3.3.1 3.2.3 (or 3.2.2) I updated and set 3.3.0 released in YARN. Time to clean up some of the old releases. I'll do that. On Mon, Dec 21, 2020 at 4:04 PM Eric Badger wrote: > I've committed https://issues.apache.org/jira/browse/YARN-10540. Xiaoqiao, > feel free to cherr

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

I've committed https://issues.apache.org/jira/browse/YARN-10540. Xiaoqiao, feel free to cherry-pick this into the 3.2.2 release branch if you think it is relevant. Also, can someone tell me which releases we should be targeting? Currently these versions are all Unreleased on JIRA: 3.4.1, 3.4.0 3.3

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

I put up a patch for https://issues.apache.org/jira/browse/YARN-10540. Thanks for bringing it to my attention. Jim On Mon, Dec 21, 2020 at 10:36 AM Sunil Govindan wrote: > I had some offline talks with a few folks. > This issue is happening only in Mac, hence ideally it does not cause much > of

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

I had some offline talks with a few folks. This issue is happening only in Mac, hence ideally it does not cause much of a problem in the supported OS. I will wait for feedback here to see whether we need another RC by fixing this. And will continue the discussion in the jira. Thanks Sunil On Sat

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Thanks, Xiaoqiao. All files are looking good. However, while I did the tests to verify the RC, I ran into a serious NPE in YARN. I raised YARN-10540 to analyze this further. I think this issue due to YARN-10450

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Thanks Sunil, md5 files have been removed from RC4. Please have a look. Thanks & Regards. - He Xiaoqiao On Sat, Dec 19, 2020 at 7:22 PM Sunil Govindan wrote: > Hi Xiaoqiao, > > Please remove the md5 files from your shared RC4 repo. Thanks, @Akira > Ajisaka for sharing this input. > > Thanks >

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Hi Xiaoqiao, Please remove the md5 files from your shared RC4 repo. Thanks, @Akira Ajisaka for sharing this input. Thanks Sunil On Sat, Dec 19, 2020 at 10:21 AM Sunil Govindan wrote: > Reference: > https://www.apache.org/dev/release-distribution.html#sigs-and-sums > Also, we had a Jira to tra

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Reference: https://www.apache.org/dev/release-distribution.html#sigs-and-sums Also, we had a Jira to track this HADOOP-15930 . Thanks Sunil On Sat, Dec 19, 2020 at 10:16 AM Sunil Govindan wrote: > Hi Xiaoqiao and Wei-chiu > > I am a bit confus

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Hi Xiaoqiao and Wei-chiu I am a bit confused after seeing both *.sha512 and *.md5 files in the RC directory. Are we releasing both now? Thanks Sunil On Wed, Dec 9, 2020 at 10:32 PM Xiaoqiao He wrote: > Hi folks, > > The release candidate (RC4) for Hadoop-3.2.2 is available now. > There are 10

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

+1 (non-binding) - Build from source - checksums and signatures - Setup a pseudo cluster and run shell test Thanks Xiaoqiao He 于2020年12月10日周四 上午1:01写道： > Hi folks, > > The release candidate (RC4) for Hadoop-3.2.2 is available now. > There are 10 commits[1] differences between RC4 and RC3[2]. >

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

+1 (binding) - Built from source - Brought up cluster - Tested streaming and sleep jobs -Eric Payne On Wednesday, December 9, 2020, 11:01:38 AM CST, Xiaoqiao He wrote: Hi folks, The release candidate (RC4) for Hadoop-3.2.2 is available now. There are 10 commits[1] differences between RC4 a

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

+1 (non-binding) as well - did a full CI run from Spark side with the RC and it looks good - verified checksums and signatures - started a docker-based single node cluster and tested with basic HDFS commands - verified NN webui and it looks good On Wed, Dec 16, 2020 at 3:54 PM Wei-Chiu Chuang

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Forgot to mention I am +1 (binding) too based on the fact there are no blocker issues and RC3 and RC4 diff. On Mon, Dec 14, 2020 at 1:42 PM Wei-Chiu Chuang wrote: > Diff between RC3 and RC4: > > MAPREDUCE-7284. TestCombineFileInputFormat#testMissingBlocks fails (#2136) > HDFS-13404. Addendum: R

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

+1(binding) * checked hadoop-3.2.2-src.tar.gz * verified signature and checksums. * built on CentOS 8 and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`. * launched 3-node docker cluster with NN-HA and RM-HA enabled. * ran example MR jobs. * checked hadoop-3.2.2-site.tar.gz * v

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

+1 (binding) - Verified checksums and signatures - Built from source with CentOS 7.9 - Setup a pseudo cluster and ran some MapReduce jobs - Checked the Web UIs. Thanks, Akira On Tue, Dec 15, 2020 at 6:43 AM Wei-Chiu Chuang wrote: > > Diff between RC3 and RC4: > > MAPREDUCE-7284. TestCombineFil

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Diff between RC3 and RC4: MAPREDUCE-7284. TestCombineFileInputFormat#testMissingBlocks fails (#2136) HDFS-13404. Addendum: RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fail. Contributed by Takanobu Asanuma. HADOOP-16080. hadoop-aws does not work with hadoop-client-api (#2510)

[VOTE] Release Apache Hadoop 3.2.2 - RC4

Hi folks, The release candidate (RC4) for Hadoop-3.2.2 is available now. There are 10 commits[1] differences between RC4 and RC3[2]. The RC4 is available at: http://people.apache.org/~hexiaoqiao/hadoop-3.2.2-RC4 The RC4 tag in github is here: https://github.com/apache/hadoop/tree/release-3.2.2-RC