Great, Thanks Shilun and Ahmar. On Fri, Sep 26, 2025 at 5:26 AM slfan1989 <[email protected]> wrote:
> Hi Ahmar, > > The files have been moved from the dev directory to the release directory. > Please have a look when convenient. > > Best regards, > Shilun Fan. > > > On Wed, Sep 24, 2025 at 6:12 PM Suhail, Ahmar <[email protected] > > > wrote: > > > I’ve uploaded it to the staging repo her: > > https://dist.apache.org/repos/dist/dev/hadoop/3.4.2-RC3/ > > But I don’t have permissions to upload to the release repo, so a PMC > > member will have to do that. > > > > @Xiaoqiao He<mailto:[email protected]>/@slfan1989<mailto: > > [email protected]> could you please move the hadoop-3.4.2.tar > > artifacts to > > https://dist.apache.org/repos/dist/release/hadoop/common/hadoop-3.4.2/ ? > > > > Thanks, > > Ahmar > > > > From: Xiaoqiao He <[email protected]> > > Date: Wednesday, 24 September 2025 at 03:34 > > To: Steve Loughran <[email protected]> > > Cc: "Suhail, Ahmar" <[email protected]>, slfan1989 < > > [email protected]>, "Suhail, Ahmar" <[email protected]>, " > > [email protected]" <[email protected]>, Ayush Saxena <[email protected]>, > > Chris Nauroth <[email protected]>, Hadoop Common < > > [email protected]>, yarn-dev <[email protected]>, > > mapreduce-dev <[email protected]>, Hdfs-dev < > > [email protected]>, "<[email protected]>" < > > [email protected]> > > Subject: RE: [EXTERNAL] Missing full tarball for Hadoop 3.4.2 > > > > > > CAUTION: This email originated from outside of the organization. Do not > > click links or open attachments unless you can confirm the sender and > know > > the content is safe. > > > > Hi @Ahmar Suhail<mailto:[email protected]> what about trying to upload > the > > full tarbar again? Infra team has changed the quota now. > > Thus we could close this 3.4.2 release. Thanks. > > > > Best Regards, > > - He Xiaoqiao > > > > On Fri, Sep 19, 2025 at 9:11 PM Steve Loughran <[email protected] > > <mailto:[email protected]>> wrote: > > > > I have a WiP PR to pull all the object store artifacts into > > share/common/lib; once we have the basic build working I"m going to > extend > > the dist profile with an aws-sdk profile that includes the AWS SDK. > > > > > > 1. our public builds will skip the bundle > > 2. s3a, abfs gs and other connectors will be on the classpath! > > 3. for s3a, you'll need to add any version of the bundle.jar to > > common/lib > > we wouldn't have a full/lean tar up online, just a single distro without > > the bundle.jar file and a doc saying "download from X and drop into Y. We > > tested using > > version Z, later versions may nor may not work. " > > > > please review > > https://github.com/apache/hadoop/pull/7980 > > > > > > > > On Fri, 19 Sept 2025 at 13:10, Suhail, Ahmar <[email protected] > <mailto: > > [email protected]>> wrote: > > Thanks Shilun, > > > > I agree, For 3.4.2, we can move these projects to use the lean-tar. > > > > Separately, working with Steve to update the packaging so the full tar > > excludes the AWS bundle by default, so from the next release onwards, we > > will just have the full tars, and will no longer need the lean-tar. > > > > So two options for now: > > > > > > * We add a new hadoop-3.4.2.tar.gz, which is just a copy of > > hadoop-3.4.2-lean.tar.gz. (I would prefer not to do this as this requires > > some manual changes to the release directory) > > * We update Hive and Ozone to use the hadoop-3.4.2-lean.tar.gz for > > now. And from the next release, can go back to using hadoop-3.4.2.tar.gz. > > > > What do others think? > > > > From: slfan1989 <[email protected]<mailto:[email protected]>> > > Date: Friday, 19 September 2025 at 04:20 > > To: "Suhail, Ahmar" <[email protected]<mailto:[email protected]>> > > Cc: "Suhail, Ahmar" <[email protected]>, "[email protected] > > <mailto:[email protected]>" <[email protected]<mailto:[email protected]>>, > > Ayush Saxena <[email protected]<mailto:[email protected]>>, Xiaoqiao > He > > <[email protected]<mailto:[email protected]>>, Steve Loughran < > > [email protected]<mailto:[email protected]>>, Chris Nauroth < > > [email protected]<mailto:[email protected]>>, Hadoop Common < > > [email protected]<mailto:[email protected]>>, > > yarn-dev <[email protected]<mailto:[email protected] > >>, > > mapreduce-dev <[email protected]<mailto: > > [email protected]>>, Hdfs-dev <[email protected] > > <mailto:[email protected]>>, "<[email protected] > <mailto: > > [email protected]>>" <[email protected]<mailto: > > [email protected]>> > > Subject: RE: [EXTERNAL] Missing full tarball for Hadoop 3.4.2 > > > > > > CAUTION: This email originated from outside of the organization. Do not > > click links or open attachments unless you can confirm the sender and > know > > the content is safe. > > > > Thank you for your feedback. I think we do need to make a collective > > decision regarding the uploaded packages. At present, the absence of the > > full tar package prevents Ozone and Hive from using the latest Hadoop > 3.4.2 > > release. From my perspective, using the minimal package as a substitute > > for the full package could be a reasonable option. > > > > Best regards, > > Shilun Fan. > > > > On Wed, Sep 10, 2025 at 5:56 PM Suhail, Ahmar <[email protected] > > <mailto:[email protected]>> wrote: > > Hey all, > > > > Heard back from Infra: > > > > "The 1GB increase in INFRA-25423 was temporary. Your project needs to > > reduce the size of these binaries. In the previous temporary space > > increase, your project stated they would be removing extraneous > > dependencies/SDKs. We cannot keep increasing this allocation forever. > What > > is your plan for reducing the object size? Packages of this size are > > difficult for users to download, and increase our bandwidth costs." > > > > So they're not too keen on increasing our limit. What do we want to do? > We > > could rename the lean tars to hadoop-3.4.2.tar.gz, the consequence is > that > > anyone downloading and trying to use S3A will hit errors, which might be > ok > > as our release notes say the release no longer includes the SDK. > > > > > > On 01/09/2025, 09:40, "Suhail, Ahmar" <[email protected] > <mailto: > > [email protected]<mailto:[email protected]>>LID> wrote: > > > > > > CAUTION: This email originated from outside of the organization. Do not > > click links or open attachments unless you can confirm the sender and > know > > the content is safe. > > > > > > > > > > > > > > Thanks Shilun, > > > > > > I’ve cut: https://issues.apache.org/jira/browse/INFRA-27182 < > > https://issues.apache.org/jira/browse/INFRA-27182>. > > > > > > Will upload the full tarball once this is resolved. > > > > > > From: slfan1989 <[email protected]<mailto:[email protected]> > > <mailto:[email protected]<mailto:[email protected]>>> > > Date: Saturday, 30 August 2025 at 09:29 > > To: "[email protected]<mailto:[email protected]> <mailto:[email protected] > > <mailto:[email protected]>>" <[email protected]<mailto:[email protected]> > > <mailto:[email protected]<mailto:[email protected]>>> > > Cc: Ayush Saxena <[email protected]<mailto:[email protected]> <mailto: > > [email protected]<mailto:[email protected]>>>, Xiaoqiao He < > > [email protected]<mailto:[email protected]> <mailto: > > [email protected]<mailto:[email protected]>>>, Steve Loughran < > > [email protected]<mailto:[email protected]> <mailto: > > [email protected]<mailto:[email protected]>>>, Chris Nauroth < > > [email protected]<mailto:[email protected]> <mailto: > > [email protected]<mailto:[email protected]>>>, Hadoop Common < > > [email protected]<mailto:[email protected]> > <mailto: > > [email protected]<mailto:[email protected]>>>, > > yarn-dev <[email protected]<mailto:[email protected]> > > <mailto:[email protected]<mailto:[email protected]>>>, > > mapreduce-dev <[email protected]<mailto: > > [email protected]> <mailto:[email protected] > > <mailto:[email protected]>>>, Hdfs-dev < > > [email protected]<mailto:[email protected]> <mailto: > > [email protected]<mailto:[email protected]>>>, "< > > [email protected]<mailto:[email protected]> <mailto: > > [email protected]<mailto:[email protected]>>>" < > > [email protected]<mailto:[email protected]> <mailto: > > [email protected]<mailto:[email protected]>>> > > Subject: [EXTERNAL] Missing full tarball for Hadoop 3.4.2 > > > > > > > > > > CAUTION: This email originated from outside of the organization. Do not > > click links or open attachments unless you can confirm the sender and > know > > the content is safe. > > > > > > Hi all, > > > > > > First of all, thanks to everyone for the efforts that led to the > > successful release of Hadoop 3.4.2. > > > > > > While trying to use the new dependency in the Hive project, Ayush noticed > > that the full Hadoop 3.4.2 tarball was not uploaded. > > > > > > We can find the reference discussion here: > > https://github.com/apache/hive/pull/6049 < > > https://github.com/apache/hive/pull/6049> > > > > > > After discussing with Ahmar, we plan to report this issue to INFRA, since > > they previously helped us by temporarily extending the storage quota for > > the release directory. > > > > > > Here is the JIRA I have submitted: > > https://issues.apache.org/jira/projects/INFRA/issues/INFRA-25423 < > > https://issues.apache.org/jira/projects/INFRA/issues/INFRA-25423> > > > > > > Best regards, > > Shilun Fan. > > > > >
