+1
On Wed, Dec 6, 2023 at 8:39 AM Akira Ajisaka wrote:
>
> +1
>
>
>
> On Wed, Dec 6, 2023 at 1:10 PM Xiaoqiao He wrote:
>
> > Dear Hadoop devs,
> >
> > Given the feedback from the discussion thread [1], I'd like to start
> > an official thread for the community to vote on release line 3.2 EOL.
Hmm I'm looking at HADOOP-11867 related stuff but couldn't find it
mentioned anywhere in change log or release notes. Are they actually
up-to-date?
On Mon, Jan 2, 2023 at 7:48 AM Masatake Iwasaki
wrote:
>
> >- building HBase 2.4.13 and Hive 3.1.3 against 3.3.5 failed due to
> > dependency
I'm still trying to get a successful run from Spark side here:
https://github.com/apache/spark/pull/37281. The last CI run failed,
but most likely due to some issue not related to Hadoop.
On Thu, Aug 4, 2022 at 10:27 AM Steve Loughran
wrote:
>
> The vote passed with the following result.
>
>
+1
- Compiled from source
- Verified checksums & signatures
- Launched a pseudo HDFS cluster and ran some simple commands
- Ran full Spark tests with the RC
Thanks Steve!
Chao
On Mon, May 16, 2022 at 2:19 AM Ayush Saxena wrote:
>
> +1,
> * Built from source.
> * Successful native build on
t; > >
> > > On Sat, May 7, 2022 at 10:52 AM Ayush Saxena wrote:
> > >
> > >> Hmm, I see the artifacts ideally should have got overwritten by the new
> > >> RC, but they didn’t. The reason seems like the staging path shared
> > doesn’t
> &g
?
>
> On Sat, 7 May 2022 at 06:18, Chao Sun wrote:
>>
>> Seems there are some issues with the shaded client as I was not able
>> to compile Apache Spark with the RC
>> (https://github.com/apache/spark/pull/36474). Looks like it's compiled
>> with the `-Dskip
Seems there are some issues with the shaded client as I was not able
to compile Apache Spark with the RC
(https://github.com/apache/spark/pull/36474). Looks like it's compiled
with the `-DskipShade` option and the hadoop-client-api JAR doesn't
contain any class:
➜ hadoop-client-api jar tf
Thanks all! I really appreciate all the help I received while working
on Hadoop, and looking forward to contributing more to this project!
A small correction: my given name is actually Chao. I made a mistake
when adding my full name to the apache account :).
Best,
Chao
On Tue, Mar 8, 2022 at
t; - He Xiaoqiao
>
> [1] https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
>
> On Sun, Mar 6, 2022 at 10:14 AM Chao Sun wrote:
>
>> Ah I forgot to do `hugo` before committing the changes. Sorry. It should
>> be
>> good now.
>>
>> Chao
>&
Ah I forgot to do `hugo` before committing the changes. Sorry. It should be
good now.
Chao
On Sat, Mar 5, 2022 at 9:28 AM Chao Sun wrote:
> Hmm interesting. I followed the steps in that second link you posted,
> and the results looked good when I ran `hugo serve` locally: I c
cement
> about release 3.3.2. If we missed any steps to publish following
> guidelines[2]? Thanks.
>
> Best Regards,
> - He Xiaoqiao
>
> [1] https://hadoop.apache.org/
> [2] https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
>
>
> On Fri, Mar 4, 2022 at 1:23
Hi All,
It gives me great pleasure to announce that the Apache Hadoop community has
voted to release Apache Hadoop 3.3.2.
This is the second stable release of Apache Hadoop 3.3 line. It contains
284 bug fixes, improvements and enhancements since 3.3.1.
Users are encouraged to read the overview
the
> contents.
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/02/22 14:17, Chao Sun wrote:
> > Hi all,
> >
> > Here's Hadoop 3.3.2 release candidate #5:
> >
> > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC5
> > The
Hi all, I just started another voting thread for RC5. Please evaluate and
vote there. Thanks!
On Mon, Feb 21, 2022 at 10:46 AM Chao Sun wrote:
> Ah I take it back: the CHANGELOG is part of the hadoop-3.3.2-site.tar.gz
> too. I'll start a new RC with the only change being the CHANGELOG.
Hi all,
Here's Hadoop 3.3.2 release candidate #5:
The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC5
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC5
The Maven artifacts are staged at:
curious if this requires new RC or you would like to update
>>> Changelog
>>> in the existing RC. Either way, once Changelog is updated, and since
>>> other
>>> functional testing looks good anyways, my vote would be +1 (non-binding).
>>>
>>>
>>&
e other
>> functional testing looks good anyways, my vote would be +1 (non-binding).
>>
>>
>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun wrote:
>>
>> > Thanks again Viraj!
>> >
>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-1772
7728
>
> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> present.
>
> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
> 3.3.2:
> HADOOP-17936
> HADOOP-18066
>
>
>
> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun wro
P-17290
> HADOOP-17819
> YARN-9551
>
>
>
> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani wrote:
>
> > Thanks Chao. Yes contents are now present, I will start the testing.
> >
> >
> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun wrote:
> >
> >>
gt; On Sat, Feb 12, 2022 at 3:12 AM Chao Sun wrote:
>
>> Hi all,
>>
>> Sorry for the delay! was waiting for a few fixes that people have
>> requested
>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>
>> The RC is available at:
Hi all,
Sorry for the delay! was waiting for a few fixes that people have requested
to backport. I've just put together Hadoop 3.3.2 RC4 below:
The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
The RC tag is at:
and regards,
> > Akira
> >
> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
> iwasak...@oss.nttdata.co.jp <mailto:iwasak...@oss.nttdata.co.jp>> wrote:
> >
> > Thanks for putting this up, Chao Sun.
> >
> > I got following error on building t
Hi all,
I've put together Hadoop 3.3.2 RC3 below:
The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
The Maven artifacts are staged at:
estlet:jar:2.3.0: Could not transfer artifact
> > > org.restlet.jee:org.restlet:pom:2.3.0 from/to
> maven-default-http-blocker
> > (
> > > http://0.0.0.0/): Blocked mirror for repositories: [maven-restlet (
> > > http://maven.restlet.org, default, rele
Thanks for the update Steve!
Mukund: could you please share the command to get the error above? I tried
a few approaches but couldn't reproduce it :(
Thanks again!
Best,
Chao
On Mon, Jan 24, 2022 at 7:16 AM Steve Loughran wrote:
>
> fix is in t disable auditing, which is now the default
>
luster w/ NN, 1 DN, RM, AHS, JHS, and
> 3
> > NMs
> >
> > - Validated inter- and intra-queue preemption
> >
> > - Validated exclusive node labels
> >
> > Thanks a lot Chao for your diligence and hard work on this release.
> >
> > Eric
> >
>
t; > >
> > > all happy
> > >
> > >
> > >
> > > *## binary*
> > > downloaded KEYS and imported, so adding your key to my list (also
> signed
> > > this and updated th
Hi all,
I've put together Hadoop 3.3.2 RC2 below:
The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC2/
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC2
The Maven artifacts are staged at:
ow how long
that will take to stabilize.
Sounds good.
Hope everyone had a good holiday break! I'll address the above issues and
create RC1 soon.
Thanks,
Chao
On Thu, Dec 30, 2021 at 6:00 AM Steve Loughran
wrote:
> On Tue, 14 Dec 2021 at 22:56, Chao Sun wrote:
>
> > Thanks all
> I'll do my best to test this; I'm a bit broken right now.
>
> I think we should mention in a release notes that is the version of a
> log4j included in this and all previous releases is not vulnerable. But
> provide a list plus links to any that have been fixed
>
> On Fri, 10 D
Hi all,
Sorry for the long delay. I've prepared RC0 for Hadoop 3.3.2 below:
The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC0/
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC0
The Maven artifacts are staged at:
Hi, I just created a release branch branch-3.3.2 and updated the version of
branch-3.3 to 3.3.3-SNAPSHOT. Will try to get the RC1 ready soon.
On Thu, Oct 28, 2021 at 9:58 AM Chao Sun wrote:
> Hi, sorry for the delay! I plan to start the release process within a few
> days.
>
> On
Hi, sorry for the delay! I plan to start the release process within a few
days.
On Thu, Oct 28, 2021 at 3:25 AM Hui Fei wrote:
> Thank you, Chao!
> Do you need any help? I can assist you.
>
> Chao Sun 于2021年9月8日周三 上午1:06写道：
>
>> Hi all,
>>
>> It has been almost
t; On Tue, 7 Sep 2021 at 10:36 PM, Chao Sun wrote:
>
>> Hi all,
>>
>> It has been almost 3 months since the 3.3.1 release and branch-3.3 has
>> accumulated quite a few commits (118 atm). In particular, Spark community
>> recently found an issue which prevents one fr
Hi all,
It has been almost 3 months since the 3.3.1 release and branch-3.3 has
accumulated quite a few commits (118 atm). In particular, Spark community
recently found an issue which prevents one from using the shaded Hadoop
client together with certain compression codecs such as lz4 and snappy
+1 (non-binding)
- verified signature and checksum
- launched a single docker based cluster and ran some simple HDFS commands
- build Spark master with 3.3.1 RC and : 1) run full Spark test suites and
all success; 2) tested simple Spark commands against a S3 endpoint; 3)
tested Spark on YARN with
Hi Wei-Chiu,
It seems the Maven staging repository is still pointing at RC0:
https://repository.apache.org/content/repositories/staging/org/apache/hadoop/hadoop-client/3.3.1/,
and it's probably because you need to drop the old RCs in Apache Nexus
server. Could you do that? Thanks.
Chao
On Thu,
+1 on extending the vote. It's great to see that the S3 support in 3.3 is
so much better! So far everything looks good from Spark side (
https://github.com/apache/spark/pull/30135) but I plan to test it more in
the next few days.
Best,
Chao
On Thu, Jun 3, 2021 at 9:56 AM Wei-Chiu Chuang
wrote:
+1. I think this will be very helpful.
On Thu, May 20, 2021 at 3:10 PM Sangjin Lee wrote:
> +1 (binding). It's long overdue IMHO.
>
> On Thu, May 20, 2021 at 2:11 PM Gergely Pollak
> wrote:
>
> > I really like this initiative, thank you!
> > +1 for line length increase to 100 characters.
> >
>
+1 (non-binding)
- verified checksums & signatures
- started a single-node cluster in docker and did some simple tests, also
checked NN web-ui
- Did a full test run in Spark using the RC and it looks good
On Thu, Jan 7, 2021 at 3:01 AM 孙立晟 wrote:
> +1 (non-binding)
>
> - Build from source with
mat#testMissingBlocks fails
> (#2136)
> > HDFS-13404. Addendum: RBF:
> > TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fail.
> > Contributed by Takanobu Asanuma.
> > HADOOP-16080. hadoop-aws does not work with hadoop-client-api (#2510).
> > Contributed
Thanks Xiaoqiao. I just committed the fix to branch-3.2 (and will port it
to other branches as well later). Could you cherry-pick it to branch-3.2.2
and start another RC? really appreciate it.
Best,
Chao
On Wed, Dec 2, 2020 at 7:59 PM Xiaoqiao He wrote:
> Thanks Chao Sun for your qu
Thanks Xiaoqiao for the work! Unfortunately we just discovered an issue
(HADOOP-16080) which prevents Spark from consuming this release. I'm
working on a PR for this and wondering if we can include the fix in the
release too.
Thanks again and apologies for the late notice.
Best,
Chao
On Mon,
+1 (non-binding) from me as well:
- download the source and build it on mac successfully
- verified all md5, sha512 as well as signatures, however @Xiaoqiao I was
not able to find your public key in
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS so had to use the
other link.
- started a
Fri, 16 Oct 2020 at 19:59, Chao Sun wrote:
>
>> Thanks for the replies all!
>>
>> > But in the opposite case, it might have problem, because 2.x server may
>> not understand new client calls added in 3.x
>>
>> Yes not expecting this to work. I'm thin
Mon, Oct 12, 2020 at 8:59 PM Wu,Jianliang(vip.com) <
> > jianliang...@vipshop.com> wrote:
> >
> >> In our case, when nn has upgraded to 3.1.3 and dn’s version was still
> >> 2.6, we found hive to call getContentSummary method , the client and
> >> server wa
Hi community,
Does Hadoop 3.x provide wire compatibility between 3.x clients and 2.x
server? There is a blog post from Cloudera [1] mentioning wire
compatibility between 2.x clients and 3.x server, but not the other
direction. Curious if someone knows this. Also it'd be good to know if
someone is
Congrats Xiaoqiao!
On Thu, Jun 11, 2020 at 9:36 AM Ayush Saxena wrote:
> Congratulations He Xiaoqiao!!!
>
> -Ayush
>
> > On 11-Jun-2020, at 9:30 PM, Wei-Chiu Chuang wrote:
> >
> > In bcc: general@
> >
> > It's my pleasure to announce that He Xiaoqiao has been elected as a
> > committer on the
+1 (no-binding)
At Uber we've deployed a subset of features covered in this JIRA in
production at multiple data centers, and it's being running great for a
while now. We are seeing huge benefits in terms of scaling our NameNode
throughput and providing better SLA guarantees for applications such
49 matches
Mail list logo
