Re: Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

+1 (binding) * Successfully built from source with `mvn clean install` * Verified signatures and checksums Thanks Steve and Mukund for driving this release. Hope the release goes smoothly. Shilun Fan. On Fri, Aug 23, 2024 at 11:41 PM Shilun Fan wrote: +1 (Binding) > > * Built from source > *

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

+1 (Binding) * Built from source * Verified Signature(Signed by Mukund) * Verified Checksums * No diff b/w the git tag & src tar * Verified the NOTICE & LICENSE files * Skimmed over the contents of the site jar * Built Hadoop trunk with 1.3.0 version * Checked the hadoop test results here [1], not

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

+1 (binding). Thanks Steve and Mukund for driving this release. Best Regards - He Xiaoqiao On Wed, Aug 21, 2024 at 11:51 PM Mukund Madhav Thakur wrote: > +1 ( binding) > > On Tue, Aug 20, 2024 at 9:16 AM Steve Loughran > > wrote: > > > Mukund and I have built a release candidate (RC1) for Had

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

de-protobuf) on > project hadoop-shaded-protobuf_3_25: Error creating shaded jar: duplicate > entry: META-INF/LICENSE.txt -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > [ERROR] Re-run Maven using the -X switch to

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

--- > > mvn install package -DskipTests > > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-shade-plugin:3.1.1:shade (shade-protobuf) on > project hadoop-shaded-protobuf_3_25: Error creating shaded jar: duplicate > entry: META

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

project hadoop-shaded-protobuf_3_25: Error creating shaded jar: duplicate entry: META-INF/LICENSE.txt -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For m

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

+1 ( binding) On Tue, Aug 20, 2024 at 9:16 AM Steve Loughran wrote: > Mukund and I have built a release candidate (RC1) for Hadoop-Thirdparty > 1.3.0. > > The RC is available at: > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.3.0-RC1/ > > The git tag is release-1.3.0-RC1, co

Re: Need help with gpg signing while creating 3.4.1 release using MacOS M3

And it works when I run the command manually inside the docker container. On Thu, Aug 1, 2024 at 1:52 PM Mukund Madhav Thakur wrote: > yes it was not backported to the trunk branch. > > After skipping the sign step, the build fails in yarn-ui with this error. > I have tried a few times by now b

Re: Need help with gpg signing while creating 3.4.1 release using MacOS M3

yes it was not backported to the trunk branch. After skipping the sign step, the build fails in yarn-ui with this error. I have tried a few times by now but it always fails so it's not intermittent. There was some python failure as well before this which I fixed by setting the PYTHON env variable

Re: [DISCUSS] what needs to be done to switch to java17

> One thing I know is that it is necessary to upgrade JUnit 4 to JUnit 5 Do you know any specific reason or docs mentioning that? Just curious as to why we need to migrate to JUnit 5 for JDK-17, Looking here [1], it seems like it supports JDK-21 as well and even [2] mentions like it does support

Re: [DISCUSS] what needs to be done to switch to java17

Thanks, everyone, for starting this discussion. This sounds like a good plan to start with. As I was working on the JUnit 4 to 5 upgrade, I paused for a while as I got occupied with other stuff. But I would be happy to complete it as part of the Java switch process. On Tue, Jul 30, 2024 at 4:21 AM

Re: [DISCUSS] what needs to be done to switch to java17

Thank you very much for initiating this discussion! I am also very much looking forward to JDK 17. I have observed that using --add-opens= is quite common in other Apache projects. One thing I know is that it is necessary to upgrade JUnit 4 to JUnit 5. There are some JIRA issues currently being wor

Re: [DISCUSS] what needs to be done to switch to java17

Depends on what we mean by switching to JDK-17, Compile time support or Runtime support, We don't have compile time support for JDK-11 too, it is just runtime, We have a daily build as well for JDK-11, which has now some genuine failures now, need to check [1], as of now the version is hardcoded he

Re: [DISCUSS] what needs to be done to switch to java17

I think this is worth considering. I think it would require a minor release like 3.5.0 as opposed to considering it for future 3.4.x patch releases. I tend to build locally with Java 11, by default and I haven't hit major issues building Hadoop. There may be some gotcha somewhere but it is likely t

Re: [DISCUSS] pruning surplus branches/tags from the main hadoop repo

On Thu, 30 May 2024 at 03:47, Xiaoqiao He wrote: > Strong +1. One concerns, how we define 'unnecessary branches', which > mean how to distinguish the branches someone accidentally created, I try > to traverse some of them but didn't get one obvious rule. Thanks. > If we take a snapshot into an

Re: [DISCUSS] pruning surplus branches/tags from the main hadoop repo

Strong +1. One concerns, how we define 'unnecessary branches', which mean how to distinguish the branches someone accidentally created, I try to traverse some of them but didn't get one obvious rule. Thanks. Best Regards, - He Xiaoqiao On Wed, May 29, 2024 at 10:11 PM Ayush Saxena wrote: > +1

Re: [DISCUSS] pruning surplus branches/tags from the main hadoop repo

+1 for the proposal, the first thing might be to just drop the unnecessary branches which are either from dependabot or someone accidentally created a branch in the main repo rather than in their fork, there are many, I don't think we need them in the archived repo either Regarding (3) If you mean

Re: [ANNOUNCE] New Hadoop Committer - Haiyang Hu

Thanks! Looking forward to participating more in the Apache Hadoop community! Yuanbo Liu 于2024年4月22日周一 15:26写道： > Congratulations > > On Mon, Apr 22, 2024 at 12:14 PM Ayush Saxena wrote: > >> Congratulations Haiyang!!! >> >> -Ayush >> >> > On 22 Apr 2024, at 9:41 AM, Xiaoqiao He wrote: >> > >

Re: [ANNOUNCE] New Hadoop Committer - Haiyang Hu

Congratulations On Mon, Apr 22, 2024 at 12:14 PM Ayush Saxena wrote: > Congratulations Haiyang!!! > > -Ayush > > > On 22 Apr 2024, at 9:41 AM, Xiaoqiao He wrote: > > > > I am pleased to announce that Haiyang Hu has been elected as > > a committer on the Apache Hadoop project. We appreciate all

Re: [ANNOUNCE] New Hadoop Committer - Haiyang Hu

Congratulations Haiyang!!! -Ayush > On 22 Apr 2024, at 9:41 AM, Xiaoqiao He wrote: > > I am pleased to announce that Haiyang Hu has been elected as > a committer on the Apache Hadoop project. We appreciate all of > Haiyang's work, and look forward to her/his continued contributions. > > Congr

Re: [ANNOUNCE] Apache Hadoop 3.4.0 release

Xiaoqiao He and Shilun Fan Awesome! Thanks for leading the effort to release the Hadoop 3.4.0 ! Bests, Sammi On Tue, 19 Mar 2024 at 21:12, slfan1989 wrote: > On behalf of the Apache Hadoop Project Management Committee, We are > pleased to announce the release of Apache Hadoop 3.4.0. > > This

Re: ContainerId starts with 1 ?

Dear Hadoop/Yarn community, I still beg your help for the question above. Additionally, I might have other questions. The target is to get the driver container id of a Spark app, from Yarn Aggregation Log. I would like to call LogAggregationIndexedFileController#readAggregatedLogsMeta()

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

4日(木) 15:19 Xiaoqiao He : >> >>> Thanks Ayush for highlighting this information. Absolutely true, we >>> should >>> count RM's vote when explicit +1 here. >>> >>> Best Regards, >>> - He Xiaoqiao >>> >>> On Thu, Mar 14

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

we should >> count RM's vote when explicit +1 here. >> >> Best Regards, >> - He Xiaoqiao >> >> On Thu, Mar 14, 2024 at 3:55 AM Ayush Saxena wrote: >> >> > > Counter should be with yourself vote, where the current summary >> > is 5 +1

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

> > > > Counter should be with yourself vote, where the current summary > > is 5 +1 binding and 1 +1 non-binding. Let's re-count when deadline. > > > > Just on the process: The release manager needs to "explicitly" vote like > > any other before co

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

g and 1 +1 non-binding. Let's re-count when deadline. > > Just on the process: The release manager needs to "explicitly" vote like > any other before counting their own vote, there has been a lot of > discussions around that at multiple places & the official apache

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

> Counter should be with yourself vote, where the current summary is 5 +1 binding and 1 +1 non-binding. Let's re-count when deadline. Just on the process: The release manager needs to "explicitly" vote like any other before counting their own vote, there has been a lot of discu

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

+1 I tested with Apache ORC repo. Thank you for the new release. Dongjoon. On 2024/03/11 20:28:22 Steve Loughran wrote: > +1 binding > > (sorry, this had ended in the yarn-dev folder, otherwise I'd have seen it > earlier. been testing it this afternoon: > > pulled the latest version of > http

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

unter should be with yourself vote, where the current summary > is 5 +1 binding and 1 +1 non-binding. Let's re-count when deadline. > Thanks again. > > Best Regards, > - He Xiaoqiao > > On Tue, Mar 12, 2024 at 9:00 AM slfan1989 wrote: > > > As of now, we have collecte

Re: [DISCUSS] Support/Fate of HBase v1 in Hadoop

Thanx Everyone. I think we have an agreement around dropping the Hbase v1 support. I have created a ticket: https://issues.apache.org/jira/browse/HADOOP-19107 FYI. The HBase v2 build is broken now. I tried " mvn clean install -DskipTests -Dhbase.profile=2.0" & it didn't work (It worked couple of

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

Hi Shilun, Counter should be with yourself vote, where the current summary is 5 +1 binding and 1 +1 non-binding. Let's re-count when deadline. Thanks again. Best Regards, - He Xiaoqiao On Tue, Mar 12, 2024 at 9:00 AM slfan1989 wrote: > As of now, we have collected 5 affirmative votes

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

As of now, we have collected 5 affirmative votes, with 4 votes binding and 1 vote non-binding. Thank you very much for voting and verifying! This voting will continue until March 15th, this Friday. Best Regards, Shilun Fan. On Tue, Mar 12, 2024 at 4:29 AM Steve Loughran wrote: > +1 binding >

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

+1 binding (sorry, this had ended in the yarn-dev folder, otherwise I'd have seen it earlier. been testing it this afternoon: pulled the latest version of https://github.com/apache/hadoop-release-support (note, this module is commit-then-review; whoever is working on/validating a release can comm

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

+1 (binding) Thanks for driving the release, Shilun Fan. - Verified checksums and signatures. - Build the source on macOS and Java 8. - Ran AWS and Azure tests ( some known failures, created Jira's HADOOP-19106 it is a test side issue only mostly related to test configs, also as Ah

Re: [DISCUSS] Support/Fate of HBase v1 in Hadoop

+1 for cutting hbase 1; it only reduces dependency pain (no more protobuf 2.5!) Created the JIRA on that a few days back https://issues.apache.org/jira/browse/YARN-11658 On Tue, 5 Mar 2024 at 12:08, Bryan Beaudreault wrote: > Hbase v1 is EOL for a while now, so option 2 probably makes sense. W

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

+1 (binding) [x] Verified signature and checksum. [x] LICENSE files exist and NOTICE is included. [x] Rat check is ok. mvn clean apache-rat:check [x] Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. [x] Setup pseudo cluster with HDFS and YARN

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

+1 (non-binding) Thanks for driving the release, Shilun. * Verified sha512 checksum and signature was correct for source tarball * Built source code on Amazon-Linux 2 and OpenJDK 8 in Amazon EC2 * Verified S3A (hadoop-tools/hadoop-aws) unit tests passing * Ran S3A (hadoop-tools/hadoop-aws) inte

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

+1 (binding) Thanks for the great work, Shilun Fan. + verified checksums and signatures of src and site tarballs. + built from source tarball with native profile enabled on Rocky Linux 8 and Ubuntu 22.04 (x86_64). + deployed pseudo cluster with and without kerberos enabled. + ran some exampl

Re: [DISCUSS] Support/Fate of HBase v1 in Hadoop

+1 on supporting only HBase v2. Masatake Iwasaki On 2024/03/06 13:18, slfan1989 wrote: +1 Option2 I also agree with the idea of upgrading hbase 2.2 to 2.5. Shilun Fan. Hbase v1 is EOL for a while now, so option 2 probably makes sense. While you are at it you should probably update the hbase

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

Just gave a quick try, Hive master didn't compile. I gave up post that... [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project hive-common: Compilation failure [ERROR] /Users/ayushsaxena/code/hive/common/src/java/org/apache/hadoop/

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

cc @Chao Sun @zhang...@apache.org @Ayush Saxena Would you mind helping to check the upstream systems(Spark, HBase, Hive) dependency with the new hadoop release version if necessary? Thanks. Best Regards, - He Xiaoqiao On Thu, Mar 7, 2024 at 10:23 AM Xiaoqiao He wrote: > Shilun, Thanks for

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

Shilun, Thanks for your great work. I am checking but not finished yet. Will confirm once done. Best Regards, - He Xiaoqiao On Thu, Mar 7, 2024 at 7:23 AM slfan1989 wrote: > @Xiaoqiao He @Ayush Saxena > @Steve > Loughran @Mukund Madhav Thakur > @Takanobu > Asanuma @Masatake Iwasaki > > Ca

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

@Xiaoqiao He @Ayush Saxena @Steve Loughran @Mukund Madhav Thakur @Takanobu Asanuma @Masatake Iwasaki Can you help review and vote for hadoop-3.4.0-RC3? Thank you very much! Best Regards, Shilun Fan. On Tue, Mar 5, 2024 at 6:07 AM slfan1989 wrote: > Hi folks, > > Xiaoqiao He and I have pu

Re: [DISCUSS] Support/Fate of HBase v1 in Hadoop

+1 Option2 I also agree with the idea of upgrading hbase 2.2 to 2.5. Shilun Fan. > Hbase v1 is EOL for a while now, so option 2 probably makes sense. While > you are at it you should probably update the hbase2 version, because 2.2.x > is also very old and EOL. 2.5.x is the currently maintained r

Re: [DISCUSS] Support/Fate of HBase v1 in Hadoop

Hbase v1 is EOL for a while now, so option 2 probably makes sense. While you are at it you should probably update the hbase2 version, because 2.2.x is also very old and EOL. 2.5.x is the currently maintained release for hbase2, with 2.5.7 being the latest. We’re soon going to release 2.6.0 as well.

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC2)

I am preparing hadoop-3.4.0-RC3 as we have already released 3 RC versions before, and I hope hadoop-3.4.0-RC3 will receive the approval of the members. Compared to hadoop-3.4.0-RC2, my plan is to backport 2 PRs from branch-3.4 to branch-3.4.0: HADOOP-18088: Replacing log4j 1.x with reload4j. HADO

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC2)

Thank you very much for Steve's detailed test report and issue description! I appreciate your time spent helping with validation. I am currently trying to use hadoop-release-support to prepare hadoop-3.4.0-RC3. After completing the hadoop-3.4.0 version, I will document some of the issues encount

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC2)

I have been testing this all week, and a -1 until some very minor changes go in. 1. build the arm64 binaries with the same jar artifacts as the x86 one 2. include ad8b6541117b HADOOP-18088. Replace log4j 1.x with reload4j. 3. include 80b4bb68159c HADOOP-19084. Prune hadoop-common transit

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC2)

@Ayush Saxena @Takanobu Asanuma @Xiaoqiao He @inigo...@apache.org @Masatake Iwasaki @Akira Ajisaka Could you please assist with the Hadoop-3.4.0-RC2 vote? Best Regards, Shilun Fan. On Fri, Feb 16, 2024 at 7:27 AM slfan1989 wrote: > Thank you for helping review hadoop-3.4.0-RC2. > > Compar

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC2)

Thank you for helping review hadoop-3.4.0-RC2. Compared to RC1, we have made two improvements: 1. Merged some patches from the branch-3.4 branch to branch-3.4.0. 2. Upgrade the version of hadoop-thirdparty to 1.2.0. Best Regards, Shilun Fan. On Fri, Feb 16, 2024 at 4:41 AM Mukund Madhav Thakur

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC2)

Thanks, Shilun for putting this together. Tried the below things and everything worked for me. validated checksum and gpg signature. compiled from source. Ran AWS integration tests. untar the binaries and able to access objects in S3 via hadoop fs commands. compiled gcs-connector successfully usi

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC2)

Thank you for explaining this part! hadoop-3.4.0-RC2 used the validate-hadoop-client-artifacts tool to generate the ARM tar package, which should meet expectations. We also look forward to other members helping to verify. Best Regards, Shilun Fan. On Fri, Feb 16, 2024 at 12:22 AM Steve Loughran

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC2)

On Mon, 12 Feb 2024 at 15:32, slfan1989 wrote: > > > Note, because the arm64 binaries are built separately on a different > platform and JVM, their jar files may not match those of the x86 > release -and therefore the maven artifacts. I don't think this is > an issue (the ASF actually releases so

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC1)

We will backport all the PRs from the branch-3.4 branch to branch-3.4.0, and use this to release hadoop-3.4.0-RC2. It should include the s3a checksum and region stuff. Best Regards, Shilun Fan. On Mon, Feb 12, 2024 at 7:10 PM Steve Loughran wrote: > so it'll have the s3a checksum and region stu

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC1)

so it'll have the s3a checksum and region stuff? that'd be wonderful! I've been assuming i'd have to push out a 3.4.1 release for that alone. On Sat, 10 Feb 2024 at 23:36, slfan1989 wrote: > We will end the voting for hadoop-3.4.0-RC1 and will open the voting for > hadoop-3.4.0-RC2 in 1-2 days.

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC1)

We will end the voting for hadoop-3.4.0-RC1 and will open the voting for hadoop-3.4.0-RC2 in 1-2 days. * hadoop-3.4.0-RC2 will contain all commits in branch-3.4, and newly submitted(in branch-3.4) commits will be cherry-picked to branch-3.4.0. * hadoop-3.4.0-RC2 will use hadoop-thirdparty-1.2.0.

Re: JDK17 support for Hadoop

Thank you all for your interest in this topic! In my opinion, upgrading is very beneficial. Based on the roadmap for Spark 4.0, we can see that JDK8/JDK11 is no longer the default version. Therefore, I believe it is important for us to fully support JDK11/JDK17/JDK21 in Hadoop. >From the informat

Re: JDK17 support for Hadoop

Thanks, Bilwa, for bringing up the issue of JDK17 support for Hadoop. It's true that we need to have pipelines for JDK17 builds, and it's good to see that some Jira’s are already in progress to support it. We may need to check with the infrastructure team as well. Does anyone else have any thou

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

We have completed the release of hadoop-thirdparty-1.2.0 according to the release process of how to release. We will start preparing for hadoop-3.4.0-RC2 voting. Looking forward to everything going smoothly! Best Regards, Shilun Fan. On Wed, Feb 7, 2024 at 10:24 AM slfan1989 wrote: > +1 > > Th

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

+1 Thank you very much for voting! @Ayush Saxena @Takanobu Asanuma @Xiaoqiao He We have collected 4 PMC votes for hadoop-thirdparty-1.2.0-RC1, and we will release hadoop-thirdparty-1.2.0. Best Regards, Shilun Fan. On Wed, Feb 7, 2024 at 4:24 AM Ayush Saxena wrote: > +1 (Binding) > > * Bui

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

+1 (Binding) * Built from source * Verified Checksums * Verified Signatures * Verified no diff b/w the git tag & src tar * Verified LICENSE & NOTICE files * Compiled hadoop trunk with 1.2.0-RC1* Thanx Shilun Fan & Xiaoqiao He for driving the release. Good Luck!!! * You need to change that protob

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

+1 (binding). * Verified signatures and checksums * Reviewed the documents * Successfully built from source with `mvn clean install` * Successfully compiled Hadoop trunk and branch-3.4 with `mvn clean install -DskipTests` using the thirdparty 1.2.0-RC1 * There are not any diffs between tag and src

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

cc @PJ Fanning @Ayush Saxena @Steve Loughran @Takanobu Asanuma @Shuyan Zhang @inigo...@apache.org On Mon, Feb 5, 2024 at 11:30 AM Xiaoqiao He wrote: > +1(binding). > > I checked the following items: > - [X] Download links are valid. > - [X] Checksums and PGP signatures are valid. > - [X] L

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

+1(binding). I checked the following items: - [X] Download links are valid. - [X] Checksums and PGP signatures are valid. - [X] LICENSE and NOTICE files are correct for the repository. - [X] Source code artifacts have correct names matching the current release. - [X] All files have license headers

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

Thank you all very much for helping with the review and vote! I will conclude the voting for Hadoop-thirdparty-1.2.0-RC0 and open the voting for Hadoop-thirdparty-1.2.0-RC1. Thank you for the feedback on the code diff, Ayush. I have already submitted the changes to the Dockerfile and create-relea

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

+1 (non-binding) - Verified hashes - LICENSE and NOTICE are included. - Rat check is ok. `mvn clean apache-rat:check` - `mvn clean install` works well slfan1989 于2024年2月2日周五 11:11写道： > Thank you very much for the review! I will avoid the diff. > > Best Regards, > Shilun Fan. > > On Fri, Feb 2,

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

Thank you very much for the review! I will avoid the diff. Best Regards, Shilun Fan. On Fri, Feb 2, 2024 at 9:59 AM Takanobu Asanuma wrote: > It also looks good to me, except for the diff. > > * Verified signatures and hashes > * Reviewed the documents > * Successfully built from source with `m

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

It also looks good to me, except for the diff. * Verified signatures and hashes * Reviewed the documents * Successfully built from source with `mvn clean install` * Successfully compiled Hadoop trunk and branch-3.4 using the Hadoop thirdparty 1.2.0 Anyway, since hadoop-thirdparty-1.1.1 has some h

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

Thank you for helping to review Hadoop-Thirdparty-1.2.0-RC0 and providing feedback! I followed the "how to release" documentation and tried to package it using create-release and Dockerfile, but I couldn't successfully package it directly. Some modifications are required before compilation. I shou

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

There is some diff b/w the git tag & the src tar, the Dockerfile & the create-release are different, Why? Files hadoop-thirdparty/dev-support/bin/create-release and hadoop-thirdparty-1.2.0-src/dev-support/bin/create-release differ Files hadoop-thirdparty/dev-support/docker/Dockerfile and hadoop-t

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

Gentle ping. @Ayush Saxena @Steve Loughran @inigo...@apache.org @Masatake Iwasaki and some other folks. On Wed, Jan 31, 2024 at 10:17 AM slfan1989 wrote: > Thank you for the review and vote! Looking forward to other forks helping > with voting and verification. > > Best Regards, > Shilun Fan

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

Thank you for the review and vote! Looking forward to other forks helping with voting and verification. Best Regards, Shilun Fan. On Tue, Jan 30, 2024 at 6:20 PM Xiaoqiao He wrote: > Thanks Shilun for driving it and making it happen. > > +1(binding). > > [x] Checksums and PGP signatures are val

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

Thanks Shilun for driving it and making it happen. +1(binding). [x] Checksums and PGP signatures are valid. [x] LICENSE files exist. [x] NOTICE is included. [x] Rat check is ok. `mvn clean apache-rat:check` [x] Built from source works well: `mvn clean install` [x] Built Hadoop trunk with updated

Re: [INFO] Hadoop-3.4 Release Update

Thanks for driving this, I will be ready to release hadoop-3.4.0-RC1 in 1-2 days. Best Regards, Shilun Fan. On Thu, Jan 25, 2024 at 10:22 AM Xiaoqiao He wrote: > Hi all, the branch-3.4.0 codebase has been frozen. Hadoop-3.4.0-RC1 will > be ready for a while. > Thanks. > > Best Regards, > - He X

Re: [INFO] Hadoop-3.4 Release Update

Hi all, the branch-3.4.0 codebase has been frozen. Hadoop-3.4.0-RC1 will be ready for a while. Thanks. Best Regards, - He Xiaoqiao On Tue, Jan 23, 2024 at 7:58 AM slfan1989 wrote: > branch-3.4/branch-3.4.0 was created from the trunk branch, including the > changes from branch-3.3. > > Best Reg

Re: [INFO] Hadoop-3.4 Release Update

branch-3.4/branch-3.4.0 was created from the trunk branch, including the changes from branch-3.3. Best Regards, Shilun Fan. On Tue, Jan 23, 2024 at 12:58 AM Brahma Reddy Battula wrote: > Thanks for driving this. > > One query: > Does all the jiras from 3.3 are part of the 3.4? > > > > > On Mon,

Re: [INFO] Hadoop-3.4 Release Update

Thanks for driving this. One query: Does all the jiras from 3.3 are part of the 3.4? On Mon, 22 Jan 2024 at 11:50 AM, slfan1989 wrote: > Thank you very much for specifying the frozen time for the > Branch-3.4.0. @Xiaoqiao > He > > If there is a need to backport any PRs to branch-3.4/branch

Re: [INFO] Hadoop-3.4 Release Update

Thank you very much for specifying the frozen time for the Branch-3.4.0. @Xiaoqiao He If there is a need to backport any PRs to branch-3.4/branch-3.4.0, please feel free to contact me. Best Regards, Shilun Fan. On Mon, Jan 22, 2024 at 1:58 PM Xiaoqiao He wrote: > Hi All, > > Branch-3.4.0 wil

Re: [INFO] Hadoop-3.4 Release Update

Hi All, Branch-3.4.0 will be frozen this Thursday (UTC 00:00 Jan 25, 2024). If there is any blocker/critical PR please backport to branch-3.4 and branch-3.4.0 or sync to me or hadoop-3.4.0 RM Shilun Fan. If any reported issues are not ready in time please wait for the next release. Thanks all.

Re: [INFO] Hadoop-3.4 Release Update

Thank you for the feedback! I apologize for updating partial information in the Hadoop module. Today, I will complete the rollback of the modified JIRA and add back the 3.4.0 version. Best On Mon, Jan 22, 2024 at 10:38 AM Xiaoqiao He wrote: > Thanks all for your input. Connected to Shilun off

Re: [INFO] Hadoop-3.4 Release Update

Thanks all for your input. Connected to Shilun offline yesterday, and he will update or recover the fix version tag before 3.4.0-RC1. Best Regards, - He Xiaoqiao On Mon, Jan 22, 2024 at 9:53 AM Masatake Iwasaki wrote: > > As I mentioned in my comment on HADOOP-18045, I think 3.4.0 should still

Re: [INFO] Hadoop-3.4 Release Update

> As I mentioned in my comment on HADOOP-18045, I think 3.4.0 should still be > included in the Fix versions, > even if it was already released in 3.3.x. If I understand correctly, this > is usually our practice. +1. We can not assume 3.4.x contains all fixes of 3.3.y since we are maintaining both

Re: [INFO] Hadoop-3.4 Release Update

Hi Shilun, Thank you for leading the 3.4.0 release. > 2. In JIRA issues where other release versions have been released, remove > the 3.4.0 entry from the fix version. As I mentioned in my comment on HADOOP-18045, I think 3.4.0 should still be included in the Fix versions, even if it was already

Re: [INFO] Hadoop-3.4 Release Update

Hi All, I am currently preparing to release hadoop-3.4.0-RC1 and need to perform some operations on the JIRA issues related to HADOOP, HDFS, YARN, and MAPREDUCE. Specifically, the tasks include: 1. For JIRA issues with target version set to 3.4.0 and marked as non-blocker, update the target versi

Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

Hi Shilun, Thanks for your great work! Compare branch-3.4 and branch-3.4.0, I found that commit [1] is only checked in branch-3.4.0 but not branch-3.4. Please double check if we need to backport branch-3.4. Moreover, before 3.4.0 release we should cherry-pick from trunk to branch-3.4 first if ne

Re: Fw:Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

Thank you very much for the response! The content is very comprehensive and valuable. I will prepare hadoop-3.4.0-RC1 according to the instructions provided by you, and after RC1 is packaged, I will use validate-hadoop-client-artifacts for validation. Best Regards, Shilun Fan. On Tue, Jan 16, 2

Re: Fw:Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

-1 I'm afraid, just due to staging/packaging issues. This took me a few goes to get right myself, so nothing unusual. Note I used my validator project which is set to retrieve binaries, check signatures, run maven builds against staged artifacts *and clean up any local copies first*and more. Thi

Re: [DISCUSS] Release Hadoop 3.4.0

13 08:08:36 Subject: Re: Re: [DISCUSS] Release Hadoop 3.4.0 To: , , < ste...@cloudera.com> Cc: , Ayush Saxena , < hexiaoq...@apache.org> Thank you for reporting this issue and helping resolve it！ I will try to release hadoop-thirdparty 1.2.0-RC0 version first. Best Regards, Shil

Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

Thank you for reporting this issue and I will follow up on HDFS-17129. I acknowledge that I haven't checked for those marked as critical/blocker in RC0. I intend to complete this check before the release of RC1. Thank you again for your valuable suggestions! Best Regards Shilun Fan. Ayush Saxen

Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

We should consider including https://issues.apache.org/jira/browse/HDFS-17129 Which looks like inducing some misorder between IBR & FBR which can potentially lead to strange issues, if that can’t be merged, should revert the one which causes that. I think we should check for any ticket which has

Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

Thank you very much for your help in verifying this version! We will use version 3.5.0 for fix jira in the future. Best Regards, Shilun Fan. > wonderful! I'll be testing over the weekend > Meanwhile, new changes I'm putting in to trunk are tagged as fixed in 3.5.0 > -correct? > steve > On

Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

wonderful! I'll be testing over the weekend Meanwhile, new changes I'm putting in to trunk are tagged as fixed in 3.5.0 -correct? steve On Thu, 11 Jan 2024 at 05:15, slfan1989 wrote: > Hello all, > > We plan to release hadoop 3.4.0 based on hadoop trunk, which is the first > hadoop 3.4.0-RC v

Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

Thanks for driving this release, Shilun Fan. The top page of site documentation (in hadoop-3.4.0-RC0-site.tar.gz) looks the same as 3.3.5. While the index.md.vm is updated in branch-3.4.0[1], it seems not to be reflected. release-3.4.0-RC0 tag should be pushed to make checking easier. In ad

Re: Re: [DISCUSS] Release Hadoop 3.4.0

Thanx @slfan1989 for volunteering. Please remove this [1] from the new branches-3.4 & 3.4.0 when you create them as part of preparing for the release, else it would be putting up trunk labels for backport PRs to those branches as well. There are some tickets marked as Critical/Blocker for 3.4.0 [2

Re: Re: [DISCUSS] Release Hadoop 3.4.0

Hey all, I plan to create a new branch of branch-3.4.0 this weekend and change the version of the trunk branch to 3.5.0-SNAPSHOT. If all goes well, I will release hadoop-3.4.0-RC0 early next week. hadoop-3.4.0 contains many changes, we may release multiple RC versions. Best Regards, Shilun Fan.

Re: Re: [DISCUSS] Release Hadoop 3.4.0

Hey all, We are planning to release Hadoop 3.4.0 base on trunk. I made some preparations and changed the target version of JIRA for non-blockers in HADOOP, HDFS, YARN, and MAPREDUCE from 3.4.0 to 3.5.0. If we want to create a new JIRA, the target version can directly select version 3.5.0. If you

Re: [DISCUSS] Release Hadoop 3.4.0

+1 from me. It will include the new AWS V2 SDK upgrade as well. On Wed, Jan 3, 2024 at 6:35 AM Xiaoqiao He wrote: > > > > I think the release discussion can be in public ML? > > Good idea. cc common-dev/hdfs-dev/yarn-dev/mapreduce-dev ML. > > Best Regards, > - He Xiaoqiao > > On Tue, Jan 2, 202

Re: [DISCUSS] Release Hadoop 3.4.0

> > I think the release discussion can be in public ML? Good idea. cc common-dev/hdfs-dev/yarn-dev/mapreduce-dev ML. Best Regards, - He Xiaoqiao On Tue, Jan 2, 2024 at 6:18 AM Ayush Saxena wrote: > +1 from me as well. > > We should definitely attempt to upgrade the thirdparty version for > 3.

Re: [VOTE] Hadoop 3.2.x EOL

Hi All, JIRA/WIKI/Website has been updated. Release line 3.2 is EOL now. Thanks all. Best Regards, - He Xiaoqiao On Tue, Dec 19, 2023 at 11:58 AM Xiaoqiao He wrote: > This vote passed with 10 +1. I'll update the JIRA, WIKI and website for a > while. > > Thanks all for your participation. > > B

Re: [VOTE] Hadoop 3.2.x EOL

This vote passed with 10 +1. I'll update the JIRA, WIKI and website for a while. Thanks all for your participation. Best Regards, - He Xiaoqiao On Thu, Dec 7, 2023 at 6:14 AM Iñigo Goiri wrote: > +1 > > On Wed, Dec 6, 2023 at 9:03 AM Chao Sun wrote: > >> +1 >> >> On Wed, Dec 6, 2023 at 8:39 

  1   2   3   4   5   6   7   8   9   10   >