With 5 binding +1 votes and 0 negative votes, the hadoop-thirdparty release
vote was successful
I'm going to complete the release today, after which mukund can do another
RC of the 3.4.1 release
Thanks to everyone who tested it!
-steve
utions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn -rf :hadoop-shaded-protobuf_3_25
&
Mukund and I have built a release candidate (RC1) for Hadoop-Thirdparty
1.3.0.
The RC is available at:
https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.3.0-RC1/
The git tag is release-1.3.0-RC1, commit
0fd62903b071b5186f31b7030ce42e1c00f6bb6a
The maven artifacts are staged at
ht
A lot of projects are moving off java8. making java17 the new baseline
what do we need to there that is blocker rather than just "nice"'?
ozone-0.3.0-alpha-RC1' (was cdad29240e52)
>> Deleted tag 'ozone-0.4.0-alpha-RC0' (was 07fd26ef6d8c)
>> Deleted tag 'ozone-0.4.0-alpha-RC1' (was c4f9a20bbe55)
>> Deleted tag 'ozone-0.4.0-alpha-RC2' (was 6860c595ed19)
>> Deleted tag 'ozone-0.4.
I'm waiting for a git update of trunk to complete, not having done it since
last week. The 1.8 GB download is taking a long time over a VPN.
Updating files: 100% (8518/8518), done.
Switched to branch 'trunk'
Your branch is up to date with 'apache/trunk'.
remote: Enumerating objects: 4142992, done.
[
https://issues.apache.org/jira/browse/MAPREDUCE-7474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7474.
---
Fix Version/s: 3.3.9
3.5.0
3.4.1
Steve Loughran created MAPREDUCE-7474:
-
Summary: [ABFS] Improve commit resilience and performance in
Manifest Committer
Key: MAPREDUCE-7474
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7474
[
https://issues.apache.org/jira/browse/MAPREDUCE-7470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7470.
---
Resolution: Duplicate
> multi-thread mapreduce commit
who is reviewing MR patches these days?
On Fri, 2 Feb 2024 at 01:46, wangzhongwei (Jira) wrote:
> wangzhongwei created MAPREDUCE-7472:
> ---
>
> Summary: decode value of hive.query.string for the job
> Confguration which was encoded by hive
>
d 5 affirmative votes, with 4 votes binding
> and
> > 1 vote non-binding.
> >
> > Thank you very much for voting and verifying!
> >
> > This voting will continue until March 15th, this Friday.
> >
> > Best Regards,
> > Shilun Fan.
> >
> &
+1 binding
(sorry, this had ended in the yarn-dev folder, otherwise I'd have seen it
earlier. been testing it this afternoon:
pulled the latest version of
https://github.com/apache/hadoop-release-support
(note, this module is commit-then-review; whoever is working on/validating
a release can comm
+1 for cutting hbase 1; it only reduces dependency pain (no more protobuf
2.5!)
Created the JIRA on that a few days back
https://issues.apache.org/jira/browse/YARN-11658
On Tue, 5 Mar 2024 at 12:08, Bryan Beaudreault
wrote:
> Hbase v1 is EOL for a while now, so option 2 probably makes sense. W
e ARM tar package, which should meet expectations.
>>
>> We also look forward to other members helping to verify.
>>
>> Best Regards,
>> Shilun Fan.
>>
>> On Fri, Feb 16, 2024 at 12:22 AM Steve Loughran
>> wrote:
>>
>> >
>> &
On Mon, 12 Feb 2024 at 15:32, slfan1989 wrote:
>
>
> Note, because the arm64 binaries are built separately on a different
> platform and JVM, their jar files may not match those of the x86
> release -and therefore the maven artifacts. I don't think this is
> an issue (the ASF actually releases so
so it'll have the s3a checksum and region stuff? that'd be wonderful! I've
been assuming i'd have to push out a 3.4.1 release for that alone.
On Sat, 10 Feb 2024 at 23:36, slfan1989 wrote:
> We will end the voting for hadoop-3.4.0-RC1 and will open the voting for
> hadoop-3.4.0-RC2 in 1-2 days.
-1 I'm afraid, just due to staging/packaging issues.
This took me a few goes to get right myself, so nothing unusual.
Note I used my validator project which is set to retrieve binaries, check
signatures, run maven builds against staged artifacts *and clean up any
local copies first*and more.
Thi
wonderful! I'll be testing over the weekend
Meanwhile, new changes I'm putting in to trunk are tagged as fixed in 3.5.0
-correct?
steve
On Thu, 11 Jan 2024 at 05:15, slfan1989 wrote:
> Hello all,
>
> We plan to release hadoop 3.4.0 based on hadoop trunk, which is the first
> hadoop 3.4.0-RC v
+1
On Wed, 6 Dec 2023 at 04:09, Xiaoqiao He wrote:
> Dear Hadoop devs,
>
> Given the feedback from the discussion thread [1], I'd like to start
> an official thread for the community to vote on release line 3.2 EOL.
>
> It will include,
> a. An official announcement informs no further regular Ha
+1 for making 3.3 and 3.4 the maintained lines
3.2.x we should say -as it is true- that the age of the dependencies is
such that it is transitively insecure. To fix those, people must upgrade.
For 2.10.x, we should think about whether to cherrypick our own CVEs there,
but not actually do any new
[
https://issues.apache.org/jira/browse/MAPREDUCE-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7451.
---
Resolution: Won't Fix
The class TrackerDistributedCacheManager only exis
Steve Loughran created MAPREDUCE-7452:
-
Summary: ManifestCommitter to support / as a destination
Key: MAPREDUCE-7452
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7452
Project: Hadoop Map
could be good.
why not set it up for the third-party module first to see how well it works?
On Tue, 18 Jul 2023 at 21:05, Ayush Saxena wrote:
> Something we can explore as well!!
>
> -Ayush
>
> Begin forwarded message:
>
> > From: Volkan Yazıcı
> > Date: 19 July 2023 at 1:24:49 AM IST
> > To:
[
https://issues.apache.org/jira/browse/MAPREDUCE-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7432.
---
Fix Version/s: 3.4.0
3.3.9
Release Note: By default, the
1. we should patch gcs, to ignore those new keys.
2. i may be able to validate RC1 this weekend
On Fri, 16 Jun 2023 at 03:20, Wei-Chiu Chuang
wrote:
> Overall so far so good.
>
> hadoop-api-shim:
> built, tested successfully.
>
> cloudstore:
> built successfully.
>
> Spark:
> built successfull
Which branch is -3.3.6 off? 3.3.5 or 3.3?
I'm travelling for the next few days and unlikely to be able to test this;
will do my best
On Wed, 14 Jun 2023 at 07:27, Wei-Chiu Chuang wrote:
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is built off branch-3.3.6
[
https://issues.apache.org/jira/browse/MAPREDUCE-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7435.
---
Fix Version/s: 3.4.0
3.3.9
Resolution: Fixed
Wei-Chiu has suggested a minimal "things in 3.3.5 which were very broken,
api change for ozone and any critical jar updates"
so much lower risk/easier to qualify and ship.
I need to get https://issues.apache.org/jira/browse/HADOOP-18724 in here;
maybe look at a refresh of the "classic" jars (slf4
[
https://issues.apache.org/jira/browse/MAPREDUCE-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7437.
---
Fix Version/s: 3.4.0
3.3.9
Resolution: Fixed
Steve Loughran created MAPREDUCE-7437:
-
Summary: spotbugs complaining about .Fetcher's update of a
nonatomic static counter
Key: MAPREDUCE-7437
URL: https://issues.apache.org/jira/browse/MAPREDUCE
disable it. Will do it
> tomorrow, if nobody objects. In case the one who configured it wants
> to do it early, feel free to do so.
>
> We already have one for branch-3.3 which runs weekly which most
> probably most of us don't follow :)
>
> -Ayush
>
> On Wed, 22 Mar 2
ongoing major dependency upgrades (log4j 1 to 2, jersey 1
> to 2 and junit 4 to 5) are blockers for java 11 compile + test stability.
>
>
> On Tue, Mar 28, 2023 at 4:55 AM Steve Loughran >
> wrote:
>
> > Now that hadoop 3.3.5 is out, i want to propose something new
>
Now that hadoop 3.3.5 is out, i want to propose something new
we switch branch-3.3 and trunk to being java11 only
1. java 11 has been out for years
2. oracle java 8 is no longer available under "premier support"; you
can't really get upgrades
https://www.oracle.com/java/technologies
Steve Loughran created MAPREDUCE-7435:
-
Summary: ManifestCommitter OOM on azure job
Key: MAPREDUCE-7435
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7435
Project: Hadoop Map/Reduce
On behalf of the Apache Hadoop Project Management Committee, I am
pleased to announce the release of Apache Hadoop 3.3.5.
This is a release of Apache Hadoop 3.3 line.
Key changes include
* A big update of dependencies to try and keep those reports of
transitive CVEs under control -both genuin
ok, here's my summary, even though most of the binding voters forgot to
declare they were on the PMC.
+1 binding
Steve Loughran
Chris Nauroth
Masatake Iwasaki
Ayush Saxena
Xiaoqiao He
+1 non-binding
Viraj Jasani
0 or -1 votes: none.
Accordingly: the release is good!
I will send the f
with scale profile looks good
>
>
> On Wed, Mar 15, 2023 at 12:48 PM Steve Loughran
>
> wrote:
>
> > Apache Hadoop 3.3.5
> >
> > Mukund and I have put together a release candidate (RC3) for Hadoop
> 3.3.5.
> >
> > What we would like is for anyon
ypto.so
ISA-L: false libhadoop was built without ISA-L support
PMDK:false The native code was built without PMDK support.
---
On Wed, 15 Mar 2023 at 19:47, Steve Loughran wrote:
>
> Apache Hadoop 3.3.5
>
> Mukund and I have put together a release candidate (RC3) for Hadoop 3.3.5.
>
Apache Hadoop 3.3.5
Mukund and I have put together a release candidate (RC3) for Hadoop 3.3.5.
What we would like is for anyone who can to verify the tarballs, especially
anyone who can try the arm64 binaries as we want to include them too.
The RC is available at:
https://dist.apache.org/repos/d
does not exist (#5400) [ZanderXu <
> zande...@apache.org
> >]
> * 44bf8aadedf 2023-03-03 HDFS-16832. [SBN READ] Follow-on to HDFS-16732.
> Fix NPE when check the block location of empty directory (#5099)
> [zhengchenyu ]
> * 72f8c2a4888 (tag: release-3.3.5-RC2) 2023-02-25 HADOOP-18641
imeout).
>
>
> On Sat, Mar 4, 2023 at 4:29 AM Steve Loughran >
> wrote:
>
> > On Sat, 4 Mar 2023 at 01:47, Erik Krogen wrote:
> >
> > > Thanks Steve. I see now that the branch cut was way back in October so
> I
> > > definitely understand your
>> - mvn clean install -DskipTests
>> >> * Built tar from source (1.8.0_341): ok
>> >> - mvn clean package -Pdist -DskipTests -Dtar
>> -Dmaven.javadoc.skip=true
>> >>
>> >> * Built images using the tarball, installed and started all o
> * Ran Hbase (latest 2.5) tests against Hdfs, ran RowCounter Mapreduce job
>> * Hdfs CRUD tests
>> * MapReduce wordcount job
>>
>> * Ran S3A tests with scale profile against us-west-2:
>> mvn clean verify -Dparallel-tests -DtestsThreadCount=8 -Dscale
>>
>> I
like to see about merging to branch-3.3.5 as well.
>
> Thanks for the consideration and sorry for not bringing this up in RC1 or
> earlier.
>
> On Mon, Feb 27, 2023 at 9:59 AM Steve Loughran >
> wrote:
>
> > Mukund and I have put together a release candidate (RC2)
Mukund and I have put together a release candidate (RC2) for Hadoop 3.3.5.
We need anyone who can to verify the source and binary artifacts,
including those JARs staged on maven, the site documentation and the arm64
tar file.
The RC is available at:
https://dist.apache.org/repos/dist/dev/hadoop/h
without that file being up to
date, but at least all the transitive stuff is correctly licensed. And i
think we need to change the PR template to mention transitive updates in
the license bit too
if this goes in, I will do the rebuild on monday UK time
On Thu, 23 Feb 2023 at 11:18, Steve Loughran
over time. Going to
revert HADOOP-18590. Publish SBOM artifacts (#5281)
On Thu, 23 Feb 2023 at 10:29, Steve Loughran wrote:
> ok, let me cancel, update those jiras and kick off again. that will save
> anyone else having to do their homework
>
> On Thu, 23 Feb 2023 at 08:56, Tak
03
> > - HDFS-16310
> > - HADOOP-18014
> >
> > I corrected all the wrong fix versions just now. I'm not sure we should
> > revote it since it only affects the changelog.
> >
> > - Takanobu
> >
> > 2023年2月21日(火) 22:43 Steve Loughran :
> >
>
The answer is here just cross posting:
>> https://github.com/apache/hadoop/pull/5226#issuecomment-1354964948
>>
>> Regarding dropping Java-8 and adapting Java-11, We just have runtime
>> support for Java-11 in hadoop, the compile support ain't there, it is being
>> tra
Apache Hadoop 3.3.5
Mukund and I have put together a release candidate (RC1) for Hadoop 3.3.5.
What we would like is for anyone who can to verify the tarballs, especially
anyone who can try the arm64 binaries as we want to include them too.
The RC is available at:
https://dist.apache.org/repos/d
Steve Loughran created MAPREDUCE-7432:
-
Summary: Make Manifest Committer the default for abfs and gcs
Key: MAPREDUCE-7432
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7432
Project: Hadoop
before I commit this PR does anyone else want to look at it?
https://github.com/apache/hadoop/pull/5255
I don't think it's critical for the 3.3.5 release -as it has clearly been
around for a while
thanks
pulling in a few of the recent changes which seem needed/important, now
wondering about the javadocs.
i will add a new probe for this in our automated release ant bulld so we
can't cut a release without that
https://github.com/steveloughran/validate-hadoop-client-artifacts
On Mon, 2 Jan 2
Mukund and I have put together a release candidate (RC0) for Hadoop 3.3.5.
Given the time of year it's a bit unrealistic to run a 5 day vote and
expect people to be able to test it thoroughly enough to make this the one
we can ship.
What we would like is for anyone who can to verify the tarballs,
[
https://issues.apache.org/jira/browse/MAPREDUCE-7428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7428.
---
Fix Version/s: 3.4.0
Resolution: Fixed
> Fix failures related to Juni
The first "smoke test" RC is about to be up for people to play with, we are
just testing things here and getting that arm build done.
Can I have some content for the index.html page describing what has changed?
hadoop-project/src/site/markdown/index.md.vm
I can (and will) speak highly of stuff I'
[
https://issues.apache.org/jira/browse/MAPREDUCE-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7401.
---
Resolution: Won't Fix
> Optimize liststatus for better performance
[
https://issues.apache.org/jira/browse/MAPREDUCE-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7386.
---
Fix Version/s: 3.4.0
Resolution: Fixed
in trunk, backport once we are
[
https://issues.apache.org/jira/browse/MAPREDUCE-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7411.
---
Fix Version/s: 3.4.0
3.3.5
Resolution: Fixed
merged
tests needed tuning
fixed now HADOOP-18401
>
>
> On Tue, Sep 27, 2022 at 9:35 AM Steve Loughran >
> wrote:
>
> > Mukund has just created the new Hadoop release JIRA,
> > https://issues.apache.org/jira/browse/HADOOP-18470, and is doing the
> first
> > build
Mukund has just created the new Hadoop release JIRA,
https://issues.apache.org/jira/browse/HADOOP-18470, and is doing the first
build/test before pushing it up. This is off branch-3.3, so it will have
more significant changes than the 3.3.3 and 3.3.4 releases, which were just
CVE/integration fixes.
Hi
Mukund Thakur plans to fork off the next branch-3.3. release in 10 days
time. last chance to get changes in.
I'm away next week...try not to break the branch. Any testing you can do
would be appreciated
Steve
[
https://issues.apache.org/jira/browse/MAPREDUCE-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7403.
---
Fix Version/s: 3.4.0
3.3.9
Resolution: Fixed
hadoop
Steve Loughran created MAPREDUCE-7403:
-
Summary: Support spark dynamic partitioning in the Manifest
Committer
Key: MAPREDUCE-7403
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7403
Project
On behalf of the Apache Hadoop Project Management Committee, I am
pleased to announce the release of Apache Hadoop 3.3.4.
---
This is a release of Apache Hadoop 3.3 line.
It contains a small number of security and critical integration fixes since
3.3.3.
Users of Apache Hadoop 3.3.3 should upgrad
top
> of it and all passed. Did some kills, stuff came back.
>
> I didn't spend time on unit tests but one set passed on a local rig here:
>
> [image: image.png]
> Stack
>
> On Fri, Jul 29, 2022 at 11:48 AM Steve Loughran
> wrote:
>
>> I have put together
The vote passed with the following result.
Binding PMC members:
+1 Chris Nauroth
+1 Steve Loughran
+1 Masatake Iwasaki
Non binding votes:
+1 Ashutosh Gupta
Cheng Pan was worried about the new transient kotlin dependency. They are
working on a PR there which we can target for the successor to
local projects
https://github.com/steveloughran/validate-hadoop-client-artifacts
all good as far as my test coverage goes, with these projects validating
the staged dependencies.
now, who else can review
On Fri, 29 Jul 2022 at 19:47, Steve Loughran wrote:
>
>
> I have put together
I have put together a release candidate (RC1) for Hadoop 3.3.4
The RC is available at:
https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.4-RC1/
The git tag is release-3.3.4-RC1, commit a585a73c3e0
The maven artifacts are staged at
https://repository.apache.org/content/repositories/orgapac
u, 21 Jul 2022 at 19:07, Steve Loughran wrote:
>
> I have put together a release candidate (RC0) for Hadoop 3.3.4
>
> The RC is available at:
> https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.4-RC0/
>
> The git tag is release-3.3.4-RC0, commit c679bc76d26
>
> T
I have put together a release candidate (RC0) for Hadoop 3.3.4
The RC is available at:
https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.4-RC0/
The git tag is release-3.3.4-RC0, commit c679bc76d26
The maven artifacts are staged at
https://repository.apache.org/content/repositories/orgapac
could someone look at the PR for this,
https://github.com/apache/hadoop/pull/4026
I think it iis ok to go in without tests, but don't want to break things.
if someone else could also review, that would be great
-- Forwarded message -
From: Zhang Dongsheng (Jira)
Date: Thu, 24 Feb
[
https://issues.apache.org/jira/browse/MAPREDUCE-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7397.
---
Resolution: Cannot Reproduce
> Received status code 501 from server: HT
[
https://issues.apache.org/jira/browse/MAPREDUCE-7391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7391.
---
Fix Version/s: 3.4.0
3.3.9
Resolution: Fixed
n, 20 Jun 2022 at 19:02, Steve Loughran wrote:
> I'm setting things up for a new release
>
> https://issues.apache.org/jira/browse/HADOOP-18305
>
> absolute minimum of fixes. as well as some related to ZK lockdown, i would
> like to include
>
> https://issues.apa
I'm setting things up for a new release
https://issues.apache.org/jira/browse/HADOOP-18305
absolute minimum of fixes. as well as some related to ZK lockdown, i would
like to include
https://issues.apache.org/jira/browse/HADOOP-18303
remove shading exclusion of javax.ws.rs-api from hadoop-client-
I want to start a quick discussion on a plan for hadoop releases this
summer. I am willing to do the release manager work. Mukund and Mehakmeet
have have already volunteered to help even if they don't know that yet.
I've got two goals
1. minor followup to 3.3.3
2. feature release of new stu
+1 binding
I've extended my validator project
https://github.com/steveloughran/validate-hadoop-client-artifacts
it now
* fetches KEYS
* fetches an RC from a remote url
* validates signing
* untars and tries to build source
* untars binary release and tries some native commands
the source build f
On behalf of the Apache Hadoop Project Management Committee, I'm pleased to
announce that Hadoop 3.3.3 has been
released:
https://hadoop.apache.org/release/3.3.3.html
This is the third stable release of the Apache Hadoop 3.3 line.
It contains 23 bug fixes, improvements and enhancements since 3.3
c.
> > > >
> > > > Thanks Steve for your work.
> > > >
> > > > - He Xiaoqiao
> > > >
> > > > On Mon, May 16, 2022 at 4:25 AM Viraj Jasani
> > wrote:
> > > > >
> > > > > +1 (non-bind
[
https://issues.apache.org/jira/browse/MAPREDUCE-7378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7378.
---
Resolution: Won't Fix
> An error occurred while concurrently writing t
I have put together a release candidate (RC1) for Hadoop 3.3.3
The RC is available at:
https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/
The git tag is release-3.3.3-RC1, commit d37586cbda3
The maven artifacts are staged at
https://repository.apache.org/content/repositories/orgapachehadoo
version in staging with the files; still don't know how the
previous delete lacked them, I will do more testing tomorrow before putting
up the next RC. which will be off the same git commit as before, just a
rebuild, repackage and republish.
-Steve
On Tue, 10 May 2022 at 00:18, Steve Lou
staged-releases
>https://repository.apache.org/content/repositories/staging/
>
>
> true
>
>
> true
>
>
>
> to the `` section in your Maven pom.xml file.
>
> On Mon, May 9, 2022 at 8:52 AM Steve
)
> >>>>>>
> >>>>>> * Signature: ok
> >>>>>> * Checksum : passed
> >>>>>> * Rat check (1.8.0_191): passed
> >>>>>>- mvn clean apache-rat:check
> >>>>>> * Built from
gt; - mvn clean install -DskipTests
> > >>>> - mvn -fae --no-transfer-progress -DskipTests
> > -Dmaven.javadoc.skip=true
> > >>>> -Pnative -Drequire.openssl -Drequire.snappy -Drequire.valgrind
> > >>>> -Drequire.zstd -Dreq
I have put together a release candidate (rc0) for Hadoop 3.3.3
The RC is available at:
https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC0/
The git tag is release-3.3.3-RC0, commit d37586cbda3
The maven artifacts are staged at
https://repository.apache.org/content/repositories/orgapachehadoo
could someone competent in the mr codebase review the pr for
https://issues.apache.org/jira/browse/MAPREDUCE-7369
this is to address the problem "MapReduce tasks timing out when spends more
time on MultipleOutputs#close"
with object store close() calls potentially including longer upload/close
o
[
https://issues.apache.org/jira/browse/MAPREDUCE-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7373.
---
Fix Version/s: 3.3.3
(was: 3.4.0
There is now a branch-3.3.3 in the repo; this is forked off 3.3.2, *not*
branch-3.3
branch-3.3 has its hadoop version now set to 3.3.4
I've renamed the release version 3.3.3 in JIRA to 3.3.4, so all
fixed/target/affects references have been automatically updated. text
references in JIRAs and PRs
[
https://issues.apache.org/jira/browse/MAPREDUCE-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reopened MAPREDUCE-7373:
---
> Building MapReduce NativeTask fails on Fedora
vulnerabilities which were never reached in the Hadoop code, but which
audit tools would flag up.
I'd also like to update our shaded protobuf library too
On Mon, 11 Apr 2022 at 14:54, Steve Loughran wrote:
>
> I've just created a new JIRA and assigned to myself: HADOOP-18198.
I've just created a new JIRA and assigned to myself: HADOOP-18198. Release
Hadoop 3.3.3: hadoop-3.3.2 with CVE fixes
https://issues.apache.org/jira/browse/HADOOP-18198
--
Hadoop 3.3.3 is a minor followup release to Hadoop 3.3.2 with
* CVE fixes in Hadoop source
* CVE fixes in d
[
https://issues.apache.org/jira/browse/MAPREDUCE-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved MAPREDUCE-7341.
---
Fix Version/s: 3.3.3
Resolution: Fixed
> Add a task-manifest out
maybe even before moving the catalog away, we could make it optional
On Fri, 28 Jan 2022 at 08:24, Akira Ajisaka wrote:
> Thank you Masatake and Chao!
>
> On Fri, Jan 28, 2022 at 5:11 PM Chao Sun wrote:
>
> > Thanks Masatake and Akira for discovering the issue. I used
> > `dev-support/bin/creat
that error
org.restlet.jee:org.restlet:pom:2.3.0 from/to maven-default-http-blocker (
http://0.0.0.0/): Blocked mirror for repositories: [maven-restlet
implies maven is not downloading http artifacts, and it had decided that
the reslet artifacts were coming off an http repo, even though its in mav
fix is in t disable auditing, which is now the default
https://issues.apache.org/jira/browse/HADOOP-18094
everything is OK for apps which retain the same fs instances for the life
of the app, but not for Hive...
will do a better fix ASAP where in exchange for loss of auditing after a GC
event, on
`now some bad news
https://issues.apache.org/jira/browse/HADOOP-18091
S3A auditing leaks memory through ThreadLocal references
surfaces in processes with long lived threads creating and destroying many
s3a FS instances.
working on a fix right now
On Fri, 21 Jan 2022 at 21:02, Eric Payne
wrote:
*+1 binding.*
reviewed binaries, source, artifacts in the staging maven repository in
downstream builds. all good.
*## test run*
checked out the asf github repo at commit 6da346a358c into a location
already set up with aws and azure test credentials
ran the hadoop-aws tests with -Dparallel-test
On Thu, 20 Jan 2022 at 17:15, Andrew Purtell
wrote:
> Just to clarify: I think you want to upgrade to Log4J2 (or switch to
> LogBack) as a strategy for new releases, but you have the option in
> maintenance releases to use Reload4J to maintain Appender API and
> operational compatibility, and use
1 - 100 of 405 matches
Mail list logo
