[ANNOUNCE] Apache Celeborn 0.4.2 available

[Fu Chen]

Hello all,

Apache Celeborn community is glad to announce the
new release of Apache Celeborn 0.4.2.

Celeborn is dedicated to improving the efficiency and elasticity of
different map-reduce engines and provides an elastic, highly efficient
service for intermediate data including shuffle data, spilled data,
result data, etc.


Download Link: https://celeborn.apache.org/download/

GitHub Release Tag:

- https://github.com/apache/celeborn/releases/tag/v0.4.2

Release Notes:

- https://celeborn.apache.org/community/release_notes/release_note_0.4.2

Home Page: https://celeborn.apache.org/

Celeborn Resources:

- Issue Management: https://issues.apache.org/jira/projects/CELEBORN
- Mailing List: dev@celeborn.apache.org

Regards,
Fu Chen
On behalf of the Apache Celeborn community

[RESULT][VOTE] Release Apache Celeborn v0.4.2 RC1

[Fu Chen]

The vote PASSES with:
(* = binding)
+1:
Cheng Pan *
Fu Chen *
Nicholas Jiang *
Keyong Zhou *

+0: None

-1: None

The voting thread:
https://lists.apache.org/thread/j4crop6zx838ryd5z2hd91dft743vjwh

Thanks to all who helped with the release!

I will be working on publishing the artifacts soon.

Thanks,
Fu Chen

Re: [VOTE] Release Apache Celeborn 0.4.2-rc1

[Fu Chen]

Thanks all, with my own +1, I’m going to close the vote and send the result.

Thanks,
Fu Chen

Keyong Zhou  于2024年7月25日周四 22:48写道：
>
> +1 (binding)
>
> I checked
> - git commit hash is correct.
> - links are valid.
> - signatures are good.
> ```
> gpg --import KEYS
> gpg --verify apache-celeborn-0.4.2-bin.tgz.asc
> gpg --verify apache-celeborn-0.4.2-source.tgz.asc
> ```
> - checksums are good.
> ```
> sha512sum --check apache-celeborn-0.4.2-bin.tgz.sha512
> sha512sum --check apache-celeborn-0.4.2-source.tgz.sha512
> ```
> - LICENSE looks good.
> - NOTICE looks good.
> - build success from source code (macOS).
> ```
> ./build/make-distribution.sh --sbt-enabled --release
> ```
>
> Regards,
> Keyong Zhou
>
>
> Fu Chen  于2024年7月22日周一 18:14写道：
>
> > Hi Celeborn community,
> >
> > This is a call for a vote to release Apache Celeborn 0.4.2-rc1
> >
> >
> > The git tag to be voted upon:
> > https://github.com/apache/celeborn/releases/v0.4.2-rc1
> >
> >
> > The git commit hash:
> > d3639bb3c3d4cb2d224f1d6542e2d20d3047c76e
> >
> > Source and binary artifacts can be found at:
> > https://dist.apache.org/repos/dist/dev/celeborn/v0.4.2-rc1/
> >
> >
> > The staging repo:
> > https://repository.apache.org/content/repositories/orgapacheceleborn-1079
> >
> >
> > Fingerprint of the PGP key release artifacts are signed with:
> > 92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B
> >
> >
> > My public key to verify signatures can be found in:
> > https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS
> >
> >
> > The vote will be open for at least 72 hours or until the necessary
> > number of votes are reached.
> >
> >
> > Please vote accordingly:
> >
> >
> > [ ] +1 approve
> > [ ] +0 no opinion
> > [ ] -1 disapprove (and the reason)
> >
> > Thanks,
> > Fu Chen
> >

[VOTE] Release Apache Celeborn 0.4.2-rc1

[Fu Chen]

Hi Celeborn community,

This is a call for a vote to release Apache Celeborn 0.4.2-rc1


The git tag to be voted upon:
https://github.com/apache/celeborn/releases/v0.4.2-rc1


The git commit hash:
d3639bb3c3d4cb2d224f1d6542e2d20d3047c76e

Source and binary artifacts can be found at:
https://dist.apache.org/repos/dist/dev/celeborn/v0.4.2-rc1/


The staging repo:
https://repository.apache.org/content/repositories/orgapacheceleborn-1079


Fingerprint of the PGP key release artifacts are signed with:
92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B


My public key to verify signatures can be found in:
https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS


The vote will be open for at least 72 hours or until the necessary
number of votes are reached.


Please vote accordingly:


[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove (and the reason)

Thanks,
Fu Chen

Re: [VOTE] Release Apache Celeborn 0.4.2-rc0

[Fu Chen]

Hi Keyong,

Thank you for bringing this to my attention. I updated the version by
running the command:

```
build/mvn versions:set -DgenerateBackupPoms=false -DnewVersion=0.4.2
```

Cancel this vote because of the version issue. I’m going to fix the issue and
prepare the next RC ASAP.

Thanks,
Fu Chen

Keyong Zhou  于2024年7月20日周六 23:17写道：
>
> Hi Fu,
>
> I wonder why change all ${project.version} to 0.4.2 in [1] instead of just
> change
> the definition of  to 0.4.2 like [2] does?
>
> Regards,
> Keyong Zhou
>
> Fu Chen  于2024年7月17日周三 00:23写道：
>
> > Hi Celeborn community,
> >
> > This is a call for a vote to release Apache Celeborn 0.4.2-rc0
> >
> >
> > The git tag to be voted upon:
> > https://github.com/apache/celeborn/releases/v0.4.2-rc0
> >
> >
> > The git commit hash:
> > 2181dd7d17711d529aa618e25a1f558652e480c7
> >
> > Source and binary artifacts can be found at:
> > https://dist.apache.org/repos/dist/dev/celeborn/v0.4.2-rc0/
> >
> >
> > The staging repo:
> > https://repository.apache.org/content/repositories/orgapacheceleborn-1078
> >
> >
> > Fingerprint of the PGP key release artifacts are signed with:
> > 92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B
> >
> >
> > My public key to verify signatures can be found in:
> > https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS
> >
> >
> > The vote will be open for at least 72 hours or until the necessary
> > number of votes are reached.
> >
> >
> > Please vote accordingly:
> >
> >
> > [ ] +1 approve
> > [ ] +0 no opinion
> > [ ] -1 disapprove (and the reason)
> >
> > Thanks,
> > Fu Chen
> >

[VOTE] Release Apache Celeborn 0.4.2-rc0

[Fu Chen]

Hi Celeborn community,

This is a call for a vote to release Apache Celeborn 0.4.2-rc0


The git tag to be voted upon:
https://github.com/apache/celeborn/releases/v0.4.2-rc0


The git commit hash:
2181dd7d17711d529aa618e25a1f558652e480c7

Source and binary artifacts can be found at:
https://dist.apache.org/repos/dist/dev/celeborn/v0.4.2-rc0/


The staging repo:
https://repository.apache.org/content/repositories/orgapacheceleborn-1078


Fingerprint of the PGP key release artifacts are signed with:
92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B


My public key to verify signatures can be found in:
https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS


The vote will be open for at least 72 hours or until the necessary
number of votes are reached.


Please vote accordingly:


[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove (and the reason)

Thanks,
Fu Chen

Re: [VOTE] CIP-9: Celeborn RESTful API Refine

[Fu Chen]

+1

Thanks,
Fu Chen

Cheng Pan  于2024年7月3日周三 17:29写道：
>
> +1, thanks
>
> Thanks,
> Cheng Pan
>
>
> > On Jul 3, 2024, at 02:07, Fei Wang  wrote:
> >
> > Hi all,
> >
> > Thanks for all the feedback about the CIP-9 Celeborn RESTful API Refine [1].
> > The discussion thread is here [2].
> >
> > I'd like to start a vote for it. The vote will be open for at least 72
> > hours unless there is an objection or insufficient votes.
> >
> > [1]
> > https://docs.google.com/document/d/1LV2vV-w3XtlbJj2Vi4J77mt4IYCr40-8A_JncZLsHqs/edit?usp=sharing
> > [2] https://lists.apache.org/thread/mng0pxst0z4gc9gs7mc1frz4pzpk70jb
> >
> > Best Regards,
> > Fei Wang
>

Re: [VOTE] Release Apache Celeborn 0.5.0-rc3

[Fu Chen]

+1

I checked
- download links are valid.
- git commit hash is correct.
- no binary files in the source release.
- build success from source code (JDK 17).
```
./build/make-distribution.sh --sbt-enabled -Pspark-3.5
```

Cheng Pan  于2024年6月24日周一 14:09写道：
>
> +1 (binding)
>
> - All links are valid.
> - LICENSE/NOTICE looks fine.
> - CI result looks great.
> - No known blockers.
>
> Thanks,
> Cheng Pan
>
>
> > On Jun 19, 2024, at 12:45, Ethan Feng  wrote:
> >
> > Hello, Celeborn community,
> >
> > This is a call for a vote to release Apache Celeborn
> > 0.5.0-rc3
> >
> > The git tag to be voted upon:
> > https://github.com/apache/celeborn/releases/tag/v0.5.0-rc3
> >
> > Source and binary artifacts can be found at:
> > https://dist.apache.org/repos/dist/dev/celeborn/v0.5.0-rc3
> >
> > The git commit hash:
> > 048ef207359113247bff05dcc203c70021ccfa10
> >
> > The staging repo:
> > https://repository.apache.org/content/repositories/orgapacheceleborn-1076/
> >
> > The fingerprint of the PGP key release artifacts is signed with:
> > FCF20BB29C7BEFDF58F998F76392F71F37356FA0
> >
> > My public key to verify signatures can be found in:
> > https://dist.apache.org/repos/dist/release/celeborn/KEYS
> >
> > The vote will be open for at least 72 hours or until the necessary
> > number of votes are reached.
> >
> > Please vote accordingly:
> >
> > [ ] +1 approve
> > [ ] +0 no opinion
> > [ ] -1 disapprove (and the reason)
> >
> > Steps to validate the release:
> > https://www.apache.org/info/verification.html
> >
> > * Download links, checksums, and PGP signatures are valid.
> > * Source code distributions have correct names matching the current release.
> > * LICENSE and NOTICE files are correct.
> > * All files have license headers if necessary.
> > * No unlicensed compiled archives bundled in the source archive.
> > * The source tarball matches the git tag.
> > * Build from source is successful.
> >
> > There are additional tests:
> > * Performance test no regression
> > 1 TB TPC-DS, 0.5.0 VS 0.4.1 : 2042(s) VS 2050(s)
> > 1.1 TB pure shuffle, 0.5.0 VS 0.4.1 : 11.8min vs 11.8min
> >
> > * Result correctness test passed
> > 1TB TPC-DS runs concurrently, the results are identical.
> >
> > * Usability test passed
> > Rolling upgrade from version 0.4.1 to 0.5.0 succeed.
> > The metrics system works as expected.
> >
> > * Stability test passed
> > Random worker failures, Celeborn works as expected.
> > Random master failures, Celeborn works as expected.
> > Master meta corrupted, Celeborn works as expected.
> >
> > * Compatibility test passed
> > The Celeborn server version of 0.5.0 works fine with the Celeborn client 
> > 0.4.1.
> >
> > * Grafana dashboard layout checked
> >
> >
> > Regards,
> > Ethan Feng
>

Re: Re: [VOTE] Contrinute Apache Celeborn CLI

[Fu Chen]

+1

Thanks for the proposal!

Thanks,
Fu Chen

Ethan Feng  于2024年6月13日周四 10:59写道：
>
> Hi Aravind,
>
> Thanks for your detailed response and insight into the CLI
> implementation for Celeborn. I appreciate the explanation regarding
> the choice to use Java/Scala for the CLI. I agree that aligning with
> the prevalent use of Java/Scala within the Celeborn community is the
> right approach.
>
> Your proposed use cases for the CLI functionalities are comprehensive
> and interesting. I appreciate your proactive approach in considering
> various cluster management systems and the need for an abstraction
> layer to interface uniformly.
>
> +1 for the current proposal.
>
> Looking forward to the CLI evolution.
>
> regards,
> Ethan
>
> Aravind Patnam  于2024年6月13日周四 05:35写道：
> >
> > Hi Ethan,
> >
> > Thanks for your comments!
> >
> > Regarding using Java/Scala for the CLI, I am fine with this. I had believed
> > that using Python would be an easier/simpler implementation given that many
> > CLI's are implemented in Python, but the points you make are fair. Most of
> > the Celeborn community uses Java/Scala, so this would be more beneficial
> > for the development and evolution of the CLI.
> >
> > Yes, I think the CLI should contain capabilities beyond the HTTP endpoints
> > Celeborn exposes. The Celeborn HTTP endpoints work great for application
> > specific use cases, such as finding the applications or shuffles on a
> > particular worker, however it would not work for situations in which we
> > would need information on the cluster itself. For example, we use K8s and
> > these are use cases internally I can foresee that require communication
> > with an external cluster manager:
> >
> >- Retrieve all pods running masters/workers and their statuses
> >- Manually evict an Celeborn unhealthy pod
> >- SSH into various different Celeborn pods
> >- Manage ACLs of the cluster
> >- Manually restart pods
> >- Wipe Ratis storage if state is messed up
> >- Wipe shuffle directories if state is messed up
> >- Adding/removing new nodes into our node pool
> >- Perform any other manual arbitrary function on a Celeborn pod
> >
> >
> > These are just a few of the use cases I can think of, but I am sure more
> > will arise as more users adopt Celeborn :)
> >
> > Given that users will have various different cluster managers, I think as I
> > mentioned before there should be an abstraction layer present that exposes
> > different operations. Based on the cluster manager the user is using, the
> > user can implement their specific logic. We can have a few default ones
> > included (e.g. Kubernetes).
> >
> > Hope this answers your questions, let me know if you have any more
> > questions!
> >
> > Thanks,
> > Aravind
> >
> > On Tue, Jun 11, 2024 at 11:57 PM Ethan Feng  wrote:
> >
> > > Hi Aravind,
> > >
> > > I hope this message finds you well. I wanted to express my
> > > appreciation for the energy and creativity you've invested in the
> > > Celeborn project; the proposal you submitted is intriguing.
> > >
> > > I apologize for the delayed feedback on your proposal — it took me a
> > > bit longer to get to it than anticipated. After reviewing it, I have a
> > > couple of inquiries that I'd like to discuss in order to gain a
> > > clearer understanding:
> > >
> > > I observed that you're planning to implement the CLI in Python. Could
> > > you elaborate on the choice behind not leveraging the Java stack for
> > > this purpose? The Java ecosystem already includes mature tools such as
> > > "commons-cli" or "Scala CLI," which are capable of facilitating CLI
> > > tool development. Given the prevalent familiarity with the Java stack
> > > within our community, I believe leveraging it could accelerate the
> > > CLI's development and evolution through wider collaboration.
> > >
> > > From email discussions, you've indicated an interest in offering a
> > > generic interface API for Celeborn, which is certainly exciting.
> > > However, I'm concerned that basing a CLI on HTTP API might not fully
> > > align with this vision. Could you provide additional insights into how
> > > you envision the CLI advancing beyond the capabilities of the current
> > > HTTP REST API?
> > >
> > > Based on previous exchanges, the CLI is expected to communicate with
> > > an external cluster manager

Re: [ANNOUNCE] Add Mridul Muralidharan as new committer

[Fu Chen]

Congratulations and thank you to Mridul for the contributions to the community!

Regards,
Fu Chen

Cheng Pan  于2024年4月29日周一 12:10写道：
>
> Congrats Mridul, your expertise in Spark kernel, and the Security area are 
> impressive.
>
> Thanks,
> Cheng Pan
>
>
> > On Apr 29, 2024, at 09:21, Keyong Zhou  wrote:
> >
> > Hi Celeborn Community,
> >
> > The Project Management Committee (PMC) for Apache Celeborn
> > has invited Mridul Muralidharan to become a committer and we are pleased
> > to announce that he has accepted.
> >
> > Being a committer enables easier contribution to the
> > project since there is no need to go via the patch
> > submission process. This should enable better productivity.
> > A PMC member helps manage and guide the direction of the project.
> >
> > Please join me in congratulating Mridul Muralidharan!
> >
> > Regards,
> > Keyong Zhou
>

Re: Re: [ANNOUNCE] Add Chandni Singh as new committer

[Fu Chen]

Congratulations and thank you to Chandni for the contributions to the community!

Regards,
Fu Chen

Nicholas  于2024年3月21日周四 19:20写道：
>
> Congratulations Chandni. Well deserved!
>
>
>
>
> Regards,
> Nicholas Jiang
>
>
>
>
> At 2024-03-21 19:16:25, "Shaoyun Chen"  wrote:
> >Congratulations!
> >
> >Mridul Muralidharan  于2024年3月21日周四 16:54写道：
> >>
> >> Congratulations Chandni ! Great job :-)
> >>
> >> Regards,
> >> Mridul
> >>
> >>
> >> On Thu, Mar 21, 2024 at 3:30 AM Keyong Zhou  wrote:
> >>
> >> > Hi Celeborn Community,
> >> >
> >> > The Podling Project Management Committee (PPMC) for Apache Celeborn
> >> > has invited Chandni Singh to become a committer and we are pleased
> >> > to announce that she has accepted.
> >> >
> >> > Being a committer enables easier contribution to the
> >> > project since there is no need to go via the patch
> >> > submission process. This should enable better productivity.
> >> > A (P)PMC member helps manage and guide the direction of the project.
> >> >
> >> > Please join me in congratulating Chandni Singh!
> >> >
> >> > Thanks,
> >> > Keyong Zhou
> >> >

Re: [VOTE] Graduate Apache Celeborn (incubating) as a TLP - Community

[Fu Chen]

+1

Thanks,
Fu Chen

angers zhu  于2024年3月1日周五 17:03写道：
>
> +1
>
> Thanks
> Angerszh
>
> Cheng Pan  于2024年3月1日周五 16:58写道：
>
> > +1
> >
> > Thanks,
> > Cheng Pan
> >
> >
> > > On Mar 1, 2024, at 16:52, Yu Li  wrote:
> > >
> > > Hi All,
> > >
> > > After a thorough discussion [1], I'd like to call a formal vote to
> > > graduate Apache Celeborn (incubating) as a TLP. Below are some facts
> > > and project highlights carried from [1] as well as the draft
> > > resolution:
> > >
> > > - Currently, our community consists of 19 committers (including
> > > mentors) from more than 10 companies, with 12 serving as PPMC members.
> > > - So far, we have boasted 81 contributors.
> > > - Throughout the incubation period, we've made 6 releases in 16
> > > months, at a stable pace.
> > > - We've had 6 different release managers to date.
> > > - Our software is used in production by 10+ well known entities.
> > > - As yet, we have opened 1,286 issues with 1,176 successfully resolved.
> > > - We have submitted a total of 1,816 PRs, out of which 1,805 have been
> > > merged or closed.
> > > - Through self-assessment [2], we have met all maturity criteria as
> > > outlined in [3].
> > >
> > > We've resolved all branding issues which include Logo, GitHub repo,
> > > document, website, and others [4] [5].
> > >
> > > --
> > > Establish the Apache Celeborn Project
> > >
> > > WHEREAS, the Board of Directors deems it to be in the best interests of
> > > the Foundation and consistent with the Foundation's purpose to establish
> > > a Project Management Committee charged with the creation and maintenance
> > > of open-source software, for distribution at no charge to the public,
> > > related to an intermediate data service for big data computing engines
> > > to boost performance, stability, and flexibility.
> > >
> > > NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee
> > > (PMC), to be known as the "Apache Celeborn Project", be and hereby is
> > > established pursuant to Bylaws of the Foundation; and be it further
> > >
> > > RESOLVED, that the Apache Celeborn Project be and hereby is responsible
> > > for the creation and maintenance of software related to an intermediate
> > > data service for big data computing engines to boost performance,
> > > stability, and flexibility; and be it further
> > >
> > > RESOLVED, that the office of "Vice President, Apache Celeborn" be and
> > > hereby is created, the person holding such office to serve at the
> > > direction of the Board of Directors as the chair of the Apache Celeborn
> > > Project, and to have primary responsibility for management of the
> > > projects within the scope of responsibility of the Apache Celeborn
> > > Project; and be it further
> > >
> > > RESOLVED, that the persons listed immediately below be and hereby are
> > > appointed to serve as the initial members of the Apache Celeborn
> > > Project:
> > >
> > > * Becket Qin
> > > * Cheng Pan 
> > > * Duo Zhang 
> > > * Ethan Feng
> > > * Fu Chen   
> > > * Jiashu Xiong  
> > > * Kerwin Zhang  
> > > * Keyong Zhou   
> > > * Lidong Dai
> > > * Willem Ning Jiang 
> > > * Wu Wei
> > > * Yi Zhu
> > > * Yu Li 
> > >
> > > NOW, THEREFORE, BE IT FURTHER RESOLVED, that Keyong Zhou be appointed to
> > > the office of Vice President, Apache Celeborn, to serve in accordance
> > > with and subject to the direction of the Board of Directors and the
> > > Bylaws of the Foundation until death, resignation, retirement, removal
> > > or disqualification, or until a successor is appointed; and be it
> > > further
> > >
> > > RESOLVED, that the Apache Celeborn Project be and hereby is tasked with
> > > the migration and rationalization of the Apache Incubator Celeborn
> > > podling; and be it further
> > >
> > > RESOLVED, that all responsibilities pertaining to the Apache Incubator
> > > Celeborn podling encumbered upon the Apache Incubator PMC are hereafter
> > > discharged.
> > > --
> > >
> > > Best Regards,
> > > Yu
> > >
> > > [1] https://lists.apache.org/thread/z17rs0mw4nyv0s112dklmv7s3j053mby
> > > [2]
> > https://cwiki.apache.org/confluence/display/CELEBORN/Apache+Maturity+Model+Assessment+for+Celeborn
> > > [3]
> > https://community.apache.org/apache-way/apache-project-maturity-model.html
> > > [4] https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-206
> > > [5] https://whimsy.apache.org/pods/project/celeborn
> >
> >

Re: [DISCUSS] Graduate Celeborn as TLP

[Fu Chen]

+1

Thanks, Yu, for driving this, I look forward to seeing it successfully
reach graduation.

Thanks,
Fu Chen

rexxiong  于2024年2月27日周二 12:10写道：
>
> Hi Yu,
>
> +1, Celeborn is a diverse and active community and IMO it has gradually
> become the infrastructure for big data computing engines, I am glad to see
> celeborn is
> ready for graduation.
>
>
> Thanks,
> Jiashu Xiong
>
> Yu Li  于2024年2月27日周二 12:08写道：
>
> > Thanks for pointing this out, Cheng. I will wait for the fix of these
> > issues before starting the vote.
> >
> > Best Regards,
> > Yu
> >
> > On Tue, 27 Feb 2024 at 11:14, Cheng Pan  wrote:
> > >
> > > Thanks, Yu, for driving this, overall I agree we can graduate and move
> > forward.
> > >
> > > I just found there are minor issues on the Podling Website Checks[1],
> > the PPMC is actively working on this.
> > >
> > > [1] https://whimsy.apache.org/pods/project/celeborn
> > >
> > > Thanks,
> > > Cheng Pan
> > >
> > >
> > > > On Feb 27, 2024, at 10:58, Nicholas Jiang 
> > wrote:
> > > >
> > > > Hi Yu,
> > > >
> > > >
> > > >
> > > >
> > > > +1. Celeborn has active community with much contribution of developers
> > and many company production practice including my company bilibili. It's
> > time to start the graduation procedure. Forward to the graduation of Apache
> > Celeborn.
> > > >
> > > >
> > > >
> > > >
> > > > Regards,
> > > >
> > > > Nicholas Jiang
> > > >
> > > >
> > > > At 2024-02-27 09:40:04, "Yu Li"  wrote:
> > > >> Dear Celeborn Devs,
> > > >>
> > > >> We, the Celeborn community, began our incubation journey on October
> > > >> 18, 2022. Since then, with the continuous efforts of you all, our
> > > >> community has steadily developed and gradually matured, approaching
> > > >> the graduation criteria [1]. Therefore, I'd like to call a discussion
> > > >> to graduate Celeborn as TLP. Below are some statistics I collected,
> > > >> please check it and let me know your thoughts.
> > > >>
> > > >> - Currently, our community consists of 19 committers (including
> > > >> mentors) from more than 10 companies, with 12 serving as PPMC members
> > > >> [2].
> > > >> - So far, we have boasted 81 contributors.
> > > >> - Throughout the incubation period, we've made 6 releases [3] in 16
> > > >> months, at a stable pace.
> > > >> - We've had 6 different release managers to date.
> > > >> - Our software is used in production by 10+ well known entities [4].
> > > >> - As yet, we have opened 1,286 issues with 1,176 successfully
> > resolved [5].
> > > >> - We have submitted a total of 1,816 PRs, out of which 1,805 have been
> > > >> merged or closed [6].
> > > >> - Through self-assessment [7], we have met all maturity criteria as
> > > >> outlined in [1].
> > > >>
> > > >> And below is the drafted graduation resolution, JFYI:
> > > >> --
> > > >> Establish the Apache Celeborn Project
> > > >>
> > > >> WHEREAS, the Board of Directors deems it to be in the best interests
> > of
> > > >> the Foundation and consistent with the Foundation's purpose to
> > establish
> > > >> a Project Management Committee charged with the creation and
> > maintenance
> > > >> of open-source software, for distribution at no charge to the public,
> > > >> related to an intermediate data service for big data computing engines
> > > >> to boost performance, stability, and flexibility.
> > > >>
> > > >> NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee
> > > >> (PMC), to be known as the "Apache Celeborn Project", be and hereby is
> > > >> established pursuant to Bylaws of the Foundation; and be it further
> > > >>
> > > >> RESOLVED, that the Apache Celeborn Project be and hereby is
> > responsible
> > > >> for the creation and maintenance of software related to an
> > intermediate
> > > >> data service for big data computing engines to boost performance,
> > > >> stability, and flexibility

[ANNOUNCE] Apache Celeborn(incubating) 0.4.0 available

[Fu Chen]

Hi all,

Apache Celeborn(Incubating) community is glad to announce the
new release of Apache Celeborn(Incubating) 0.4.0.

Celeborn is dedicated to improving the efficiency and elasticity of
different map-reduce engines and provides an elastic, high-efficient
service for intermediate data including shuffle data, spilled data,
result data, etc.


Download Link: https://celeborn.apache.org/download/

GitHub Release Tag:

-
https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating

Release Notes:

- https://celeborn.apache.org/community/release_notes/release_note_0.4.0


Home Page: https://celeborn.apache.org/

Celeborn Resources:

- Issue Management: https://issues.apache.org/jira/projects/CELEBORN
- Mailing List: dev@celeborn.apache.org

Thanks,
Fu Chen
On behalf of the Apache Celeborn(incubating) community

[RESULT][VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc6

[Fu Chen]

Hello Apache Celeborn PPMC and Community,

The vote closes now as 72 hours have passed. The vote PASSES with
(* = binding)
+1:
- Keyong Zhou *
- Wei Wu *
- Ethan Feng *
- Shaoyun Chen
- Nicholas Jiang

+0: None

-1: None

The vote thread:

https://lists.apache.org/thread/q0xq0rwcosfg1pv4ymr91t00rjh5r8fm


I will now bring the vote to gene...@incubator.apache.org to get
approval by the IPMC.

If this vote passes too, the release is accepted and will be published.

Thanks to all who helped with the release!

Thanks,
On behalf of Apache Celeborn(Incubating) community

[VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc6

[Fu Chen]

Hi Celeborn community,

This is a call for a vote to release Apache Celeborn (Incubating)
0.4.0-incubating-rc6


The git tag to be voted upon:
https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc6


The git commit hash:
20a8576fc696f0208c24ab52e6ae883f5f0567d5
source and binary artifacts can be
found at:
https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.4.0-incubating-rc6


The staging repo:
https://repository.apache.org/content/repositories/orgapacheceleborn-1053


Fingerprint of the PGP key release artifacts are signed with:
92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B


My public key to verify signatures can be found in:
https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS


The vote will be open for at least 72 hours or until the necessary
number of votes are reached.


Please vote accordingly:


[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove (and the reason)


Checklist for release:
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
Steps to validate the release:
https://www.apache.org/info/verification.html


* Download links, checksums and PGP signatures are valid.
* Source code distributions have correct names matching the current release.
* Release files have the word incubating in their name.
* DISCLAIMER, LICENSE and NOTICE files are correct.
* All files have license headers if necessary.
* No unlicensed compiled archives bundled in source archive.
* The source tarball matches the git tag.
* Build from source is successful.

Please be aware that there has been a transition in the Celeborn project's
build tool, shifting from Maven to SBT. The SBT build documentation is
available
at https://celeborn.apache.org/docs/latest/developers/sbt/.

For illustrative purposes:

Packaging the project
```
./build/sbt clean package
```

Creating the distribution
```
./build/make-distribution.sh --sbt-enabled --release
```

Thanks,
Fu Chen

Re: [VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc5

[Fu Chen]

This vote failed because there is one binding -1.

Thanks to all who participated in the voting to help with this release.

Thanks,
Fu Chen

Wei Wu  于2024年1月29日周一 10:00写道：

> -1
>
> I found minor mistakes in the LICENSE file
> of apache-celeborn-0.4.0-incubating-bin.  The reference license files are
> in the directory 'licenses' instead of 'license'.
>
> Thanks,
> Wei Wu
>
> On Thu, Jan 25, 2024 at 11:19 PM Fu Chen  wrote:
>
> > Hi Celeborn community,
> >
> > This is a call for a vote to release Apache Celeborn (Incubating)
> > 0.4.0-incubating-rc5
> >
> >
> > The git tag to be voted upon:
> >
> >
> https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc5
> >
> >
> > The git commit hash:
> > 188ad3a0fceefa081160ebfc8433c29c0aeb253f
> > source and binary artifacts can be
> > found at:
> >
> >
> https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.4.0-incubating-rc5
> >
> >
> > The staging repo:
> >
> https://repository.apache.org/content/repositories/orgapacheceleborn-1052
> >
> >
> > Fingerprint of the PGP key release artifacts are signed with:
> > 92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B
> >
> >
> > My public key to verify signatures can be found in:
> > https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS
> >
> >
> > The vote will be open for at least 72 hours or until the necessary
> > number of votes are reached.
> >
> >
> > Please vote accordingly:
> >
> >
> > [ ] +1 approve
> > [ ] +0 no opinion
> > [ ] -1 disapprove (and the reason)
> >
> >
> > Checklist for release:
> >
> >
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> > Steps to validate the release:
> > https://www.apache.org/info/verification.html
> >
> >
> > * Download links, checksums and PGP signatures are valid.
> > * Source code distributions have correct names matching the current
> > release.
> > * Release files have the word incubating in their name.
> > * DISCLAIMER, LICENSE and NOTICE files are correct.
> > * All files have license headers if necessary.
> > * No unlicensed compiled archives bundled in source archive.
> > * The source tarball matches the git tag.
> > * Build from source is successful.
> >
> > Please be aware that there has been a transition in the Celeborn
> project's
> > build tool, shifting from Maven to SBT. The SBT build documentation is
> > available
> > at https://celeborn.apache.org/docs/latest/developers/sbt/.
> >
> > For illustrative purposes:
> >
> > Packaging the project
> > ```
> > ./build/sbt clean package
> > ```
> >
> > Creating the distribution
> > ```
> > ./build/make-distribution.sh --sbt-enabled --release
> > ```
> >
> > Thanks,
> > Fu Chen
> >
>

[VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc5

[Fu Chen]

Hi Celeborn community,

This is a call for a vote to release Apache Celeborn (Incubating)
0.4.0-incubating-rc5


The git tag to be voted upon:
https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc5


The git commit hash:
188ad3a0fceefa081160ebfc8433c29c0aeb253f
source and binary artifacts can be
found at:
https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.4.0-incubating-rc5


The staging repo:
https://repository.apache.org/content/repositories/orgapacheceleborn-1052


Fingerprint of the PGP key release artifacts are signed with:
92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B


My public key to verify signatures can be found in:
https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS


The vote will be open for at least 72 hours or until the necessary
number of votes are reached.


Please vote accordingly:


[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove (and the reason)


Checklist for release:
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
Steps to validate the release:
https://www.apache.org/info/verification.html


* Download links, checksums and PGP signatures are valid.
* Source code distributions have correct names matching the current release.
* Release files have the word incubating in their name.
* DISCLAIMER, LICENSE and NOTICE files are correct.
* All files have license headers if necessary.
* No unlicensed compiled archives bundled in source archive.
* The source tarball matches the git tag.
* Build from source is successful.

Please be aware that there has been a transition in the Celeborn project's
build tool, shifting from Maven to SBT. The SBT build documentation is
available
at https://celeborn.apache.org/docs/latest/developers/sbt/.

For illustrative purposes:

Packaging the project
```
./build/sbt clean package
```

Creating the distribution
```
./build/make-distribution.sh --sbt-enabled --release
```

Thanks,
Fu Chen

[RESULT][VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc4

[Fu Chen]

Hello Apache Celeborn PPMC and Community,

The vote closes now as 72 hours have passed. The vote PASSES with
(* = binding)
+1:
- Keyong Zhou *
- Wei Wu *
- Pan Cheng *
- Ethan Feng *
- Jiashu Xiong *
- Shaoyun Chen
- Nicholas Jiang
- Yihe Li

+0: None

-1: None

The vote thread:

https://lists.apache.org/thread/w91n2vgwts06gskoc5y19gl49myjm1jq


I will now bring the vote to gene...@incubator.apache.org to get
approval by the IPMC.

If this vote passes too, the release is accepted and will be published.

Thanks to all who helped with the release!

Thanks,
On behalf of Apache Celeborn(Incubating) community

[VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc4

[Fu Chen]

Hi Celeborn community,

This is a call for a vote to release Apache Celeborn (Incubating)
0.4.0-incubating-rc4


The git tag to be voted upon:
https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc4


The git commit hash:
8bc07466dd85a90216820617015e329fb806c7dd source and binary artifacts can be
found at:
https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.4.0-incubating-rc4


The staging repo:
https://repository.apache.org/content/repositories/orgapacheceleborn-1051


Fingerprint of the PGP key release artifacts are signed with:
92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B


My public key to verify signatures can be found in:
https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS


The vote will be open for at least 72 hours or until the necessary
number of votes are reached.


Please vote accordingly:


[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove (and the reason)


Checklist for release:
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
Steps to validate the release:
https://www.apache.org/info/verification.html


* Download links, checksums and PGP signatures are valid.
* Source code distributions have correct names matching the current release.
* Release files have the word incubating in their name.
* DISCLAIMER, LICENSE and NOTICE files are correct.
* All files have license headers if necessary.
* No unlicensed compiled archives bundled in source archive.
* The source tarball matches the git tag.
* Build from source is successful.

Please be aware that there has been a transition in the Celeborn project's
build tool, shifting from Maven to SBT. The SBT build documentation is
available
at https://celeborn.apache.org/docs/latest/developers/sbt/.

For illustrative purposes:

Packaging the project
```
./build/sbt clean package
```

Creating the distribution
```
./build/make-distribution.sh --sbt-enabled --release
```

Thanks,
Fu Chen

Re: [ANNOUNCE] Add Xiaofeng Jiang as new committer

[Fu Chen]

Congratulations and thank you to Xiaofeng for the contributions to the
community!

angers zhu  于2024年1月12日周五 10:16写道：

> Congrats！
>
> Wei Wu  于2024年1月12日周五 09:26写道：
>
> > Congrats!
> >
> > On Thu, Jan 11, 2024 at 7:28 PM Yihe Li  wrote:
> >
> > > Congratulations, Xiaofeng Jiang!
> > >
> > > On 2024/01/11 09:51:34 Shaoyun Chen wrote:
> > > > Congrats!
> > > >
> > > > Keyong Zhou  于2024年1月11日周四 17:03写道：
> > > > >
> > > > > Hi Celeborn Community,
> > > > >
> > > > > The Podling Project Management Committee (PPMC) for Apache Celeborn
> > > > > has invited Xiaofeng Jiang to become a committer and we are pleased
> > > > > to announce that he has accepted.
> > > > >
> > > > > Being a committer enables easier contribution to the
> > > > > project since there is no need to go via the patch
> > > > > submission process. This should enable better productivity.
> > > > > A (P)PMC member helps manage and guide the direction of the
> project.
> > > > >
> > > > > Please join me in congratulating Xiaofeng Jiang!
> > > > >
> > > > > Thanks,
> > > > > Keyong Zhou
> > > >
> > >
> >
>

Re: [VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc3

[Fu Chen]

Cancel this vote of 0.4.0-incubating-rc3 due to a bug that needs fixing,
will prepare the next RC once it gets resolved.

Thanks,
Fu Chen

rexxiong  于2024年1月4日周四 10:13写道：

> +1 (binding)
> I checked
> - Download links are valid.
> - git commit hash is correct
> - Checksums and signatures are valid.
> - No binary files in the source release
> - Files have the word incubating in their name.
> - DISCLAIMER,LICENSE and NOTICE files exist.
> - Successfully built the binary from the source on MacOs with Command:
> ./build/make-distribution.sh -Pspark-3.3
>
> Thanks,
> Jiashu Xiong
>
> Yihe Li  于2024年1月3日周三 16:46写道：
>
> > +1 (non-binding)
> > I checked the following things:
> > - git commit hash is correct.
> > - download links are valid.
> > - release files are in correct location.
> > - release files have the word incubating in their name.
> > - signatures and checksums are good.
> > - DISCLAIMER, LICENSE and NOTICE files exist.
> > - build success from source code(ubuntu 16.04).
> > ```
> > ./build/make-distribution.sh --release
> > ./build/make-distribution.sh -Pspark-3.3
> > ```
> >
> > Thanks,
> > Yihe Li
> >
> > On 2024/01/02 08:00:27 Ethan Feng wrote:
> > > +1(binding)
> > >
> > > I checked:
> > > √ release files in the correct location
> > > √ release files have the word incubating
> > > √ digital signature and hashes correct
> > > √ DISCLAIMER file exist
> > > √ LICENSE and NOTICE files exist and are correct
> > > √ the contents of the release match the tag in VCS
> > > √ can build the release from the source
> > > √ maven artifacts look correct
> > >
> > > Thanks,
> > > Ethan Feng
> > >
> > > Shaoyun Chen  于2024年1月2日周二 12:43写道：
> > > >
> > > > +1 (non-binding)
> > > >
> > > > I checked the following things:
> > > >
> > > > - signatures are good.
> > > > ```
> > > > gpg --import KEYS
> > > > gpg --verify apache-celeborn-0.4.0-incubating-source.tgz.asc
> > > > gpg --verify apache-celeborn-0.4.0-incubating-bin.tgz.asc
> > > > ```
> > > > - checksums are good.
> > > > ```
> > > > sha512sum --check apache-celeborn-0.4.0-incubating-source.tgz.sha512
> > > > sha512sum --check apache-celeborn-0.4.0-incubating-bin.tgz.sha512
> > > > ```
> > > > - build success from source code.
> > > > ```
> > > > ./build/make-distribution.sh --release
> > > > ./build/make-distribution.sh --sbt-enabled --release
> > > > ```
> > > >
> > > > Keyong Zhou  于2024年1月2日周二 10:05写道：
> > > > >
> > > > > +1 (binding)
> > > > >
> > > > > I checked
> > > > > - git commit hash is correct.
> > > > > - links are valid.
> > > > > - "incubating" is in the name.
> > > > > - PGP keys are good.
> > > > > ```
> > > > >
> > > > > gpg --import KEYS
> > > > >
> > > > > gpg --verify apache-celeborn-0.4.0-incubating-source.tgz.asc
> > > > >
> > > > > gpg --verify apache-celeborn-0.4.0-incubating-bin.tgz.asc
> > > > > ```
> > > > > - hashes are correct.
> > > > > ```
> > > > >
> > > > > sha512sum --check
> apache-celeborn-0.4.0-incubating-source.tgz.sha512
> > > > >
> > > > > sha512sum --check apache-celeborn-0.4.0-incubating-bin.tgz.sha512
> > > > > ```
> > > > > - LICENSE looks good.
> > > > > - NOTICE looks good.
> > > > > - DISCLAIMER exists.
> > > > > - build success from source code. ``` ./build/make-distribution.sh
> > > > > --sbt-enabled --release ```
> > > > >
> > > > > Thanks,
> > > > > Keyong Zhou
> > > > >
> > > > > Fu Chen  于2024年1月1日周一 19:42写道：
> > > > >
> > > > > > Hi Celeborn community,
> > > > > >
> > > > > > This is a call for a vote to release Apache Celeborn (Incubating)
> > > > > > 0.4.0-incubating-rc3
> > > > > >
> > > > > >
> > > > > > The git tag to be voted upon:
> > > > > >
> > > > > >
> >
> https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc3
> > &g

[VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc3

[Fu Chen]

Hi Celeborn community,

This is a call for a vote to release Apache Celeborn (Incubating)
0.4.0-incubating-rc3


The git tag to be voted upon:
https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc3


The git commit hash:
5d94bf9dea735650b90fc4959390da2bfc67fc37 source and binary artifacts can be
found at:
https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.4.0-incubating-rc3


The staging repo:
https://repository.apache.org/content/repositories/orgapacheceleborn-1050


Fingerprint of the PGP key release artifacts are signed with:
92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B


My public key to verify signatures can be found in:
https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS


The vote will be open for at least 72 hours or until the necessary
number of votes are reached.


Please vote accordingly:


[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove (and the reason)


Checklist for release:
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
Steps to validate the release:
https://www.apache.org/info/verification.html


* Download links, checksums and PGP signatures are valid.
* Source code distributions have correct names matching the current release.
* Release files have the word incubating in their name.
* DISCLAIMER, LICENSE and NOTICE files are correct.
* All files have license headers if necessary.
* No unlicensed compiled archives bundled in source archive.
* The source tarball matches the git tag.
* Build from source is successful.

Please be aware that there has been a transition in the Celeborn project's
build tool, shifting from Maven to SBT. The SBT build documentation is
available
at https://celeborn.apache.org/docs/latest/developers/sbt/.

For illustrative purposes:

Packaging the project
```
./build/sbt clean package
```

Creating the distribution
```
./build/make-distribution.sh --sbt-enabled --release
```

Thanks,
Fu Chen

Re: [VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc2

[Fu Chen]

Cancel this vote of 0.4.0-incubating-rc2 because of the shaded client
license issue, will prepare the next RC once it gets resolved.

Thanks,
Fu Chen

Fu Chen  于2023年12月30日周六 02:04写道：

> Hi Celeborn community,
>
> This is a call for a vote to release Apache Celeborn (Incubating)
> 0.4.0-incubating-rc2
>
>
> The git tag to be voted upon:
>
> https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc2
>
>
> The git commit hash:
> cc08d4591bac7f8c1d05ea5a2e136cb7cc231ba7 source and binary artifacts can be
> found at:
>
> https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.4.0-incubating-rc2
>
>
> The staging repo:
> https://repository.apache.org/content/repositories/orgapacheceleborn-1049
>
>
> Fingerprint of the PGP key release artifacts are signed with:
> 92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B
>
>
> My public key to verify signatures can be found in:
> https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS
>
>
> The vote will be open for at least 72 hours or until the necessary
> number of votes are reached.
>
>
> Please vote accordingly:
>
>
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove (and the reason)
>
>
> Checklist for release:
>
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> Steps to validate the release:
> https://www.apache.org/info/verification.html
>
>
> * Download links, checksums and PGP signatures are valid.
> * Source code distributions have correct names matching the current
> release.
> * Release files have the word incubating in their name.
> * DISCLAIMER, LICENSE and NOTICE files are correct.
> * All files have license headers if necessary.
> * No unlicensed compiled archives bundled in source archive.
> * The source tarball matches the git tag.
> * Build from source is successful.
>
> Please be aware that there has been a transition in the Celeborn project's
> build tool, shifting from Maven to SBT. The SBT build documentation is
> available
> at https://celeborn.apache.org/docs/latest/developers/sbt/.
>
> For illustrative purposes:
>
> Packaging the project
> ```
> ./build/sbt clean package
> ```
>
> Creating the distribution
> ```
> ./build/make-distribution.sh --sbt-enabled --release
> ```
>
> Thanks,
> Fu Chen
>

[VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc2

[Fu Chen]

Hi Celeborn community,

This is a call for a vote to release Apache Celeborn (Incubating)
0.4.0-incubating-rc2


The git tag to be voted upon:
https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc2


The git commit hash:
cc08d4591bac7f8c1d05ea5a2e136cb7cc231ba7 source and binary artifacts can be
found at:
https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.4.0-incubating-rc2


The staging repo:
https://repository.apache.org/content/repositories/orgapacheceleborn-1049


Fingerprint of the PGP key release artifacts are signed with:
92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B


My public key to verify signatures can be found in:
https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS


The vote will be open for at least 72 hours or until the necessary
number of votes are reached.


Please vote accordingly:


[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove (and the reason)


Checklist for release:
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
Steps to validate the release:
https://www.apache.org/info/verification.html


* Download links, checksums and PGP signatures are valid.
* Source code distributions have correct names matching the current release.
* Release files have the word incubating in their name.
* DISCLAIMER, LICENSE and NOTICE files are correct.
* All files have license headers if necessary.
* No unlicensed compiled archives bundled in source archive.
* The source tarball matches the git tag.
* Build from source is successful.

Please be aware that there has been a transition in the Celeborn project's
build tool, shifting from Maven to SBT. The SBT build documentation is
available
at https://celeborn.apache.org/docs/latest/developers/sbt/.

For illustrative purposes:

Packaging the project
```
./build/sbt clean package
```

Creating the distribution
```
./build/make-distribution.sh --sbt-enabled --release
```

Thanks,
Fu Chen

Re: [VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc1

[Fu Chen]

This vote failed because there is one binding -1.

Thanks to all who participated in the voting to help with this release.

Thanks,
Fu Chen

Cheng Pan  于2023年12月25日周一 23:17写道：

> -1 because of the license issue.
>
> The non-fat jar (e.g. celeborn-worker_2.12-0.4.0-incubating.jar)
> should also ship the NOTICE and LICENSE file, usually under the root
> folder or META-INF.
>
> Thanks,
> Cheng Pan
>
> On Mon, Dec 25, 2023 at 1:10 PM Shaoyun Chen  wrote:
> >
> > +1 (non-binding)
> >
> > I checked the following things:
> >
> > - signatures are good.
> > ```
> > gpg --import KEYS
> > gpg --verify apache-celeborn-0.4.0-incubating-source.tgz.asc
> > gpg --verify apache-celeborn-0.4.0-incubating-bin.tgz.asc
> > ```
> > - checksums are good.
> > ```
> > sha512sum --check apache-celeborn-0.4.0-incubating-source.tgz.sha512
> > sha512sum --check apache-celeborn-0.4.0-incubating-bin.tgz.sha512
> > ```
> > - build success from source code.
> > ```
> > ./build/make-distribution.sh --release
> > ./build/make-distribution.sh --sbt-enabled --release
> > ```
> > time
> > ```
> > ./build/make-distribution.sh --release 1779.60s user 89.17s system
> > 311% cpu 10:00.60 total
> > ```
> > ```
> > ./build/make-distribution.sh --sbt-enabled --release 893.63s user
> > 40.47s system 361% cpu 4:18.59 total
> > ```
> >
> > Yihe Li  于2023年12月25日周一 11:48写道：
> > >
> > > +1 (non-binding)
> > > I checked the following things:
> > > - git commit hash is correct.
> > > - download links are valid.
> > > - release files are in correct location.
> > > - release files have the word incubating in their name.
> > > - signatures and checksums are good.
> > > - DISCLAIMER, LICENSE and NOTICE files exist.
> > > - build success from source code(ubuntu 16.04).
> > > ```
> > > ./build/make-distribution.sh --release
> > > ./build/make-distribution.sh -Pspark-3.3
> > > ```
> > >
> > > Thanks,
> > > Yihe Li
> > >
> > > On 2023/12/25 02:15:00 Ethan Feng wrote:
> > > > +1(binding)
> > > >
> > > > I checked:
> > > > √ release files in the correct location
> > > > √ release files have the word incubating
> > > > √ digital signature and hashes correct
> > > > √ DISCLAIMER file exist
> > > > √ LICENSE and NOTICE files exist and are correct
> > > > √ the contents of the release match the tag in VCS
> > > > √ can build the release from the source
> > > > √ maven artifacts look correct
> > > >
> > > >
> > > > Thanks,
> > > > Ethan Feng
> > > >
> > > > Fu Chen  于2023年12月23日周六 00:05写道：
> > > > >
> > > > > Hi Celeborn community,
> > > > >
> > > > > This is a call for a vote to release Apache Celeborn (Incubating)
> > > > > 0.4.0-incubating-rc1
> > > > >
> > > > >
> > > > > The git tag to be voted upon:
> > > > >
> https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc1
> > > > >
> > > > >
> > > > > The git commit hash:
> > > > > 6efa068c6715e80e4ddee6bc37d6aaf5bf5251fa source and binary
> artifacts can be
> > > > > found at:
> > > > >
> https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.4.0-incubating-rc1
> > > > >
> > > > >
> > > > > The staging repo:
> > > > >
> https://repository.apache.org/content/repositories/orgapacheceleborn-1047
> > > > >
> > > > >
> > > > > Fingerprint of the PGP key release artifacts are signed with:
> > > > > 92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B
> > > > >
> > > > >
> > > > > My public key to verify signatures can be found in:
> > > > > https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS
> > > > >
> > > > >
> > > > > The vote will be open for at least 72 hours or until the necessary
> > > > > number of votes are reached.
> > > > >
> > > > >
> > > > > Please vote accordingly:
> > > > >
> > > > >
> > > > > [ ] +1 approve
> > > > > [ ] +0 no opinion
> > > > > [ ] -1 disapprove (and 

[VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc1

[Fu Chen]

Hi Celeborn community,

This is a call for a vote to release Apache Celeborn (Incubating)
0.4.0-incubating-rc1


The git tag to be voted upon:
https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc1


The git commit hash:
6efa068c6715e80e4ddee6bc37d6aaf5bf5251fa source and binary artifacts can be
found at:
https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.4.0-incubating-rc1


The staging repo:
https://repository.apache.org/content/repositories/orgapacheceleborn-1047


Fingerprint of the PGP key release artifacts are signed with:
92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B


My public key to verify signatures can be found in:
https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS


The vote will be open for at least 72 hours or until the necessary
number of votes are reached.


Please vote accordingly:


[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove (and the reason)


Checklist for release:
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
Steps to validate the release:
https://www.apache.org/info/verification.html


* Download links, checksums and PGP signatures are valid.
* Source code distributions have correct names matching the current release.
* Release files have the word incubating in their name.
* DISCLAIMER, LICENSE and NOTICE files are correct.
* All files have license headers if necessary.
* No unlicensed compiled archives bundled in source archive.
* The source tarball matches the git tag.
* Build from source is successful.

Please be aware that there has been a transition in the Celeborn project's
build tool, shifting from Maven to SBT. The SBT build documentation is
available
at https://celeborn.apache.org/docs/latest/developers/sbt/.

For illustrative purposes:

Packaging the project
```
./build/sbt clean package
```

Creating the distribution
```
./build/make-distribution.sh --sbt-enabled --release
```

Thanks,
Fu Chen

Re: [VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc0

[Fu Chen]

This vote failed because there is one binding -1.

Thanks to all who participated in the voting to help with this release.

Thanks,
Fu Chen

Cheng Pan  于2023年12月22日周五 13:25写道：

> Kindly reminder, this release is packaged via SBT, better to use
> `./build/make-distribution.sh --sbt-enabled —release` for building check.
>
> > On Dec 22, 2023, at 12:48, Ethan Feng  wrote:
> >
> > -1(binding)
> >
> > There is a bug that needs to be fixed.
> >
> > Thanks,
> > Ethan Feng.
> >
> > rexxiong  于2023年12月22日周五 11:35写道：
> >>
> >> +1 (binding)
> >> I checked
> >> - Download links are valid.
> >> - git commit hash is correct
> >> - Checksums and signatures are valid.
> >> - No binary files in the source release
> >> - Files have the word incubating in their name.
> >> - DISCLAIMER,LICENSE and NOTICE files exist.
> >> - Successfully built the binary from the source on MacOs with Command:
> >> ./build/make-distribution.sh -Pspark-3.3
> >>
> >> Thanks,
> >> Jiashu Xiong
> >>
> >> Nicholas Jiang  于2023年12月22日周五 11:05写道：
> >>
> >>> +1 (non-binding)
> >>>
> >>> I checked
> >>> - Download links are valid.
> >>> - Checksums and signatures are valid.
> >>> - Git commit hash is correct
> >>> - No binary files in the source release
> >>> - Files have the word incubating in names.
> >>> - DISCLAIMER,LICENSE and NOTICE files exist.
> >>> - Successfully built the binary from the source via command:
> >>> ./build/make-distribution.sh --release
> >>>
> >>> Regards,
> >>> Nicholas Jiang
> >>>
> >>> On 2023/12/21 13:41:36 Fu Chen wrote:
> >>>> Hi Celeborn community,
> >>>>
> >>>> This is a call for a vote to release Apache Celeborn (Incubating)
> >>>> 0.4.0-incubating-rc0
> >>>>
> >>>>
> >>>> The git tag to be voted upon:
> >>>>
> >>>
> https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc0
> >>>>
> >>>>
> >>>> The git commit hash:
> >>>> de6d8d69af3381ee899ba8d92c5d63b332cbdfbf source and binary artifacts
> can
> >>> be
> >>>> found at:
> >>>>
> >>>
> https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.4.0-incubating-rc0
> >>>>
> >>>>
> >>>> The staging repo:
> >>>>
> >>>
> https://repository.apache.org/content/repositories/orgapacheceleborn-1046
> >>>>
> >>>>
> >>>> Fingerprint of the PGP key release artifacts are signed with:
> >>>> 92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B
> >>>>
> >>>>
> >>>> My public key to verify signatures can be found in:
> >>>> https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS
> >>>>
> >>>>
> >>>> The vote will be open for at least 72 hours or until the necessary
> >>>> number of votes are reached.
> >>>>
> >>>>
> >>>> Please vote accordingly:
> >>>>
> >>>>
> >>>> [ ] +1 approve
> >>>> [ ] +0 no opinion
> >>>> [ ] -1 disapprove (and the reason)
> >>>>
> >>>>
> >>>> Checklist for release:
> >>>>
> >>>
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> >>>> Steps to validate the release:
> >>>> https://www.apache.org/info/verification.html
> >>>>
> >>>>
> >>>> * Download links, checksums and PGP signatures are valid.
> >>>> * Source code distributions have correct names matching the current
> >>> release.
> >>>> * Release files have the word incubating in their name.
> >>>> * DISCLAIMER, LICENSE and NOTICE files are correct.
> >>>> * All files have license headers if necessary.
> >>>> * No unlicensed compiled archives bundled in source archive.
> >>>> * The source tarball matches the git tag.
> >>>> * Build from source is successful.
> >>>>
> >>>> Please be aware that there has been a transition in the Celeborn
> >>> project's
> >>>> build tool, shifting from Maven to SBT. The SBT build documentation is
> >>>> available
> >>>> at https://celeborn.apache.org/docs/latest/developers/sbt/.
> >>>>
> >>>> For illustrative purposes:
> >>>>
> >>>> Packaging the project
> >>>> ```
> >>>> ./build/sbt clean package
> >>>> ```
> >>>>
> >>>> Creating the distribution
> >>>> ```
> >>>> ./build/make-distribution.sh --sbt-enabled --release
> >>>> ```
> >>>>
> >>>> Thanks,
> >>>> Fu Chen
> >>>>
> >>>
>
>

Re: [VOTE] Release Apache Celeborn(Incubating) 0.3.2-incubating-rc1

[Fu Chen]

+1

I checked
- download links are valid.
- git commit hash is correct.
- no binary files in the source release.
- signatures are good.
```
gpg --import KEYS
gpg --verify apache-celeborn-0.3.2-incubating-source.tgz.asc
gpg --verify apache-celeborn-0.3.2-incubating-bin.tgz.asc
```
- checksums are good.
```
sha512sum --check apache-celeborn-0.3.2-incubating-source.tgz.sha512
sha512sum --check apache-celeborn-0.3.2-incubating-bin.tgz.sha512
```
- build success from source code (Pop!_OS 22.04 LTS).
```
./build/mvn clean package -DskipTests -Pspark-3.4
```

Keyong Zhou  于2023年12月21日周四 16:55写道：

> +1 (binding)
>
> I checked
> - git commit hash is correct.
> - links are valid.
> - "incubating" is in the name.
> - PGP keys are good.
> - hashes are correct.
> - LICENSE looks good.
> - NOTICE looks good.
> - DISCLAIMER exists.
> - build success from source code (macOS). ``` ./build/make-distribution.sh
> --release ```
>
> Thanks,
> Keyong Zhou
>
> Nicholas Jiang  于2023年12月21日周四 14:06写道：
>
> > Hi Celeborn community,
> >
> >
> > This is a call for a vote to release Apache Celeborn (Incubating)
> > 0.3.2-incubating-rc1
> >
> >
> > The git tag to be voted upon:
> >
> >
> https://github.com/apache/incubator-celeborn/releases/tag/v0.3.2-incubating-rc1
> >
> >
> > The git commit hash:
> > bce190d8a0a53434ef57ef33e53720f5bf4d14d6 source and binary artifacts can
> be
> > found at:
> >
> >
> https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.3.2-incubating-rc1
> >
> >
> > The staging repo:
> >
> https://repository.apache.org/content/repositories/orgapacheceleborn-1045
> >
> >
> > Fingerprint of the PGP key release artifacts are signed with:
> > D73CADC1DAB63BD3C770BB6D9476842D24B7C885
> >
> >
> > My public key to verify signatures can be found in:
> > https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS
> >
> >
> > The vote will be open for at least 72 hours or until the necessary
> > number of votes are reached.
> >
> >
> > Please vote accordingly:
> >
> >
> > [ ] +1 approve
> > [ ] +0 no opinion
> > [ ] -1 disapprove (and the reason)
> >
> >
> > Checklist for release:
> >
> >
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> > Steps to validate the release:
> > https://www.apache.org/info/verification.html
> >
> >
> > * Download links, checksums and PGP signatures are valid.
> > * Source code distributions have correct names matching the current
> > release.
> > * Release files have the word incubating in their name.
> > * DISCLAIMER, LICENSE and NOTICE files are correct.
> > * All files have license headers if necessary.
> > * No unlicensed compiled archives bundled in source archive.
> > * The source tarball matches the git tag.
> > * Build from source is successful.
> >
> >
> > Regards,
> > Nicholas Jiang
>

[VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc0

[Fu Chen]

Hi Celeborn community,

This is a call for a vote to release Apache Celeborn (Incubating)
0.4.0-incubating-rc0


The git tag to be voted upon:
https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc0


The git commit hash:
de6d8d69af3381ee899ba8d92c5d63b332cbdfbf source and binary artifacts can be
found at:
https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.4.0-incubating-rc0


The staging repo:
https://repository.apache.org/content/repositories/orgapacheceleborn-1046


Fingerprint of the PGP key release artifacts are signed with:
92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B


My public key to verify signatures can be found in:
https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS


The vote will be open for at least 72 hours or until the necessary
number of votes are reached.


Please vote accordingly:


[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove (and the reason)


Checklist for release:
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
Steps to validate the release:
https://www.apache.org/info/verification.html


* Download links, checksums and PGP signatures are valid.
* Source code distributions have correct names matching the current release.
* Release files have the word incubating in their name.
* DISCLAIMER, LICENSE and NOTICE files are correct.
* All files have license headers if necessary.
* No unlicensed compiled archives bundled in source archive.
* The source tarball matches the git tag.
* Build from source is successful.

Please be aware that there has been a transition in the Celeborn project's
build tool, shifting from Maven to SBT. The SBT build documentation is
available
at https://celeborn.apache.org/docs/latest/developers/sbt/.

For illustrative purposes:

Packaging the project
```
./build/sbt clean package
```

Creating the distribution
```
./build/make-distribution.sh --sbt-enabled --release
```

Thanks,
Fu Chen

Re: [VOTE] Release Apache Celeborn(Incubating) 0.3.2-incubating-rc0

[Fu Chen]

+1

I checked
- download links are valid.
- git commit hash is correct.
- no binary files in the source release.
- signatures are good.
```
gpg --import KEYS
gpg --verify apache-celeborn-0.3.2-incubating-source.tgz.asc
gpg --verify apache-celeborn-0.3.2-incubating-bin.tgz.asc
```
- checksums are good.
```
sha512sum --check apache-celeborn-0.3.2-incubating-source.tgz.sha512
sha512sum --check apache-celeborn-0.3.2-incubating-bin.tgz.sha512
```
- build success from source code (Pop!_OS 22.04 LTS).
```
./build/mvn clean package -DskipTests -Pspark-3.4
```

Shaoyun Chen  于2023年12月19日周二 22:45写道：

> +1 (non-binding)
>
> I checked the following things:
>
> - signatures are good.
> ```
> gpg --import KEYS
> gpg --verify apache-celeborn-0.3.2-incubating-source.tgz.asc
> gpg --verify apache-celeborn-0.3.2-incubating-bin.tgz.asc
> ```
> - checksums are good.
> ```
> sha512sum --check apache-celeborn-0.3.2-incubating-source.tgz.sha512
> sha512sum --check apache-celeborn-0.3.2-incubating-bin.tgz.sha512
> ```
> - build success from source code.
> ```
> ./build/make-distribution.sh -Pspark-3.2
> ./build/make-distribution.sh --release
> ```
>
> Yihe Li  于2023年12月19日周二 20:56写道：
> >
> > +1 (non-binding)
> > I checked the following things:
> > - git commit hash is correct.
> > - download links are valid.
> > - release files are in correct location.
> > - release files have the word incubating in their name.
> > - signatures and checksums are good.
> > - DISCLAIMER, LICENSE and NOTICE files exist.
> > - build success from source code(ubuntu 16.04).
> > ```
> > ./build/make-distribution.sh --release
> > ./build/make-distribution.sh --Pspark-3.3
> > ```
> >
> > Thanks,
> > Yihe Li
> >
> > On 2023/12/19 06:37:40 Ethan Feng wrote:
> > > +1(binding)
> > >
> > > I checked:
> > > √ release files in the correct location
> > > √ release files have the word incubating
> > > √ digital signature and hashes correct
> > > √ DISCLAIMER file exist
> > > √ LICENSE and NOTICE files exist and are correct
> > > √ the contents of the release match the tag in VCS
> > > √ can build the release from the source
> > > √ maven artifacts looks correct
> > >
> > > Thanks,
> > > Ethan Feng
> > >
> > > Nicholas Jiang  于2023年12月19日周二 12:32写道：
> > > >
> > > > Hi Celeborn community,
> > > >
> > > >
> > > > This is a call for a vote to release Apache Celeborn (Incubating)
> > > > 0.3.2-incubating-rc0
> > > >
> > > >
> > > > The git tag to be voted upon:
> > > >
> https://github.com/apache/incubator-celeborn/releases/tag/v0.3.2-incubating-rc0
> > > >
> > > >
> > > > The git commit hash:
> > > > d43411b22adf24679c27004a08e813ab278eaaa3 source and binary artifacts
> can be
> > > > found at:
> > > >
> https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.3.2-incubating-rc0
> > > >
> > > >
> > > > The staging repo:
> > > >
> https://repository.apache.org/content/repositories/orgapacheceleborn-1041
> > > >
> > > >
> > > > Fingerprint of the PGP key release artifacts are signed with:
> > > > D73CADC1DAB63BD3C770BB6D9476842D24B7C885
> > > >
> > > >
> > > > My public key to verify signatures can be found in:
> > > > https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS
> > > >
> > > >
> > > > The vote will be open for at least 72 hours or until the necessary
> > > > number of votes are reached.
> > > >
> > > >
> > > > Please vote accordingly:
> > > >
> > > >
> > > > [ ] +1 approve
> > > > [ ] +0 no opinion
> > > > [ ] -1 disapprove (and the reason)
> > > >
> > > >
> > > > Checklist for release:
> > > >
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> > > >
> > > >
> > > > Steps to validate the release:
> > > > https://www.apache.org/info/verification.html
> > > >
> > > >
> > > > * Download links, checksums and PGP signatures are valid.
> > > > * Source code distributions have correct names matching the current
> release.
> > > > * Release files have the word incubating in their name.
> > > > * DISCLAIMER, LICENSE and NOTICE files are correct.
> > > > * All files have license headers if necessary.
> > > > * No unlicensed compiled archives bundled in source archive.
> > > > * The source tarball matches the git tag.
> > > > * Build from source is successful.
> > > >
> > > >
> > > > Regards,
> > > > Nicholas Jiang
> > >
>

Re: [DISCUSS] Time for 0.4.0

[Fu Chen]

Thanks Keyong for the test.

keyong zhou  于2023年12月18日周一 12:23写道：

> Thanks Fu!
>
> I tested with branch-0.4 in the past two days with randomly killing and
> restarting
> workers, results are good.
>
> I'm good with cutting branch-0.4.
>
> Thanks,
> Keyong Zhou
>
> Fu Chen  于2023年12月18日周一 12:19写道：
>
> > NOTICE: branch-0.4 has been created, and the version in master goes
> > 0.5.0-SNAPSHOT now.
> >
> > To committers: don’t forget to cherry-pick the patch to branch-0.4 if you
> > want the patch to be included in 0.4.0.
> >
> > Thanks,
> > Fu Chen
> >
> > Yihe Li  于2023年12月14日周四 14:45写道：
> >
> > > +1, thanks Fu!
> > >
> > > On 2023/12/14 06:25:08 Shaoyun Chen wrote:
> > > > +1, thanks Fu!
> > > >
> > > > Cheng Pan  于2023年12月14日周四 11:17写道：
> > > > >
> > > > > +1, thanks Fu for volunteering.
> > > > >
> > > > > With CELEBORN-989 and CELEBORN-1156, Celeborn is ready for release
> > > using SBT, it would be great to try in 0.4.0.
> > > > >
> > > > > If everything goes well, we can drop the Maven building system in
> the
> > > next version as we planned.
> > > > >
> > > > > Thanks,
> > > > > Cheng Pan
> > > > >
> > > > >
> > > > > > On Dec 14, 2023, at 10:27, keyong zhou 
> > > wrote:
> > > > > >
> > > > > > +1, thanks Fu!
> > > > > >
> > > > > > Fu Chen  于2023年12月14日周四 10:26写道：
> > > > > >
> > > > > >> Hi, Celeborn community,
> > > > > >>
> > > > > >> It has been a while since the 0.3.0 release, and I think it’s
> time
> > > to
> > > > > >> prepare
> > > > > >> for the next feature release 0.4.0. And I’m volunteering to be
> the
> > > release
> > > > > >> manager if no others were applied.
> > > > > >>
> > > > > >> If no objections, I plan to cut branch-0.4 next week.
> > > > > >>
> > > > > >> Thanks,
> > > > > >> Fu Chen
> > > > > >>
> > > > >
> > > >
> > >
> >
>

Re: [DISCUSS] Time for 0.4.0

[Fu Chen]

NOTICE: branch-0.4 has been created, and the version in master goes
0.5.0-SNAPSHOT now.

To committers: don’t forget to cherry-pick the patch to branch-0.4 if you
want the patch to be included in 0.4.0.

Thanks,
Fu Chen

Yihe Li  于2023年12月14日周四 14:45写道：

> +1, thanks Fu!
>
> On 2023/12/14 06:25:08 Shaoyun Chen wrote:
> > +1, thanks Fu!
> >
> > Cheng Pan  于2023年12月14日周四 11:17写道：
> > >
> > > +1, thanks Fu for volunteering.
> > >
> > > With CELEBORN-989 and CELEBORN-1156, Celeborn is ready for release
> using SBT, it would be great to try in 0.4.0.
> > >
> > > If everything goes well, we can drop the Maven building system in the
> next version as we planned.
> > >
> > > Thanks,
> > > Cheng Pan
> > >
> > >
> > > > On Dec 14, 2023, at 10:27, keyong zhou 
> wrote:
> > > >
> > > > +1, thanks Fu!
> > > >
> > > > Fu Chen  于2023年12月14日周四 10:26写道：
> > > >
> > > >> Hi, Celeborn community,
> > > >>
> > > >> It has been a while since the 0.3.0 release, and I think it’s time
> to
> > > >> prepare
> > > >> for the next feature release 0.4.0. And I’m volunteering to be the
> release
> > > >> manager if no others were applied.
> > > >>
> > > >> If no objections, I plan to cut branch-0.4 next week.
> > > >>
> > > >> Thanks,
> > > >> Fu Chen
> > > >>
> > >
> >
>

[DISCUSS] Time for 0.4.0

[Fu Chen]

Hi, Celeborn community,

It has been a while since the 0.3.0 release, and I think it’s time to
prepare
for the next feature release 0.4.0. And I’m volunteering to be the release
manager if no others were applied.

If no objections, I plan to cut branch-0.4 next week.

Thanks,
Fu Chen

Re: [DISCUSS] Time for 0.3.2

[Fu Chen]

+1  thanks Nicholas.

Thanks,
Fu Chen

Keyong Zhou  于2023年12月7日周四 23:09写道：

> +1 on 0.3.2, thanks Nicholas for volunteering!
>
> angers zhu  于2023年12月7日周四 17:00写道：
>
> > +1 on 0.3.2
> >
> > Yihe Li  于2023年12月7日周四 16:41写道：
> >
> > > +1, thanks Nicholas！
> > >
> > > On 2023/12/07 07:43:09 Shaoyun Chen wrote:
> > > > +1  thanks Nicholas.
> > > >
> > > > Mridul Muralidharan  于2023年12月7日周四 15:03写道：
> > > > >
> > > > > +1 on 0.3.2, thanks Nicholas !
> > > > >
> > > > > Regards,
> > > > > Mridul
> > > > >
> > > > >
> > > > > On Thu, Dec 7, 2023 at 12:51 AM Cheng Pan 
> wrote:
> > > > >
> > > > > > +1, thanks for volunteering.
> > > > > >
> > > > > > Feel free to ping me if you encounter permission issues during
> the
> > > release
> > > > > > phase.
> > > > > >
> > > > > > Thanks,
> > > > > > Cheng Pan
> > > > > >
> > > > > >
> > > > > > > On Dec 7, 2023, at 14:31, Nicholas 
> wrote:
> > > > > > >
> > > > > > > Hey, Celeborn community,
> > > > > > >
> > > > > > > It has been a while since the 0.3.1 release, and there are some
> > > critical
> > > > > > fixes land branch-0.3, for example, [CELEBORN-1037] Incorrect
> > output
> > > for
> > > > > > metrics of Prometheus. From my perspective, it’s time to prepare
> > for
> > > > > > releasing 0.3.2.
> > > > > > >
> > > > > > > WDYT? And I’m volunteering to be the release manager if no one
> > has
> > > > > > applied.
> > > > > > >
> > > > > > > Regards,
> > > > > > > Nicholas Jiang
> > > > > >
> > > > > >
> > > > > >
> > > >
> > >
> >
>

Re: [ANNOUNCE] New Committer: Shaoyun Chen

[Fu Chen]

Congratulations and thank you to Shaoyun for the contributions to the
community!

Keyong Zhou  于2023年11月7日周二 19:48写道：

> Congrats to Shaoyun Chen!
>
> Cheng Pan  于2023年11月7日周二 19:12写道：
>
> > Hi Celeborn Community,
> >
> > The Podling Project Management Committee (PPMC) for Apache Celeborn
> > has invited Shaoyun Chen to become a committer and we are pleased
> > to announce that he has accepted.
> >
> > Being a committer enables easier contribution to the
> > project since there is no need to go via the patch
> > submission process. This should enable better productivity.
> > A (P)PMC member helps manage and guide the direction of the project.
> >
> > Please join me in congratulating Shaoyun Chen!
> >
> > Thanks,
> > Cheng Pan
> >
> >
> >
>

Re: [VOTE] Release Apache Celeborn(Incubating) 0.3.1-incubating-rc3

[Fu Chen]

+1

I checked
- download links are valid.
- git commit hash is correct.
- no binary files in the source release.
- signatures are good.
```
gpg --import KEYS
gpg --verify apache-celeborn-0.3.1-incubating-source.tgz.asc
gpg --verify apache-celeborn-0.3.1-incubating-bin.tgz.asc
```
- checksums are good.
```
sha512sum --check apache-celeborn-0.3.1-incubating-source.tgz.sha512
sha512sum --check apache-celeborn-0.3.1-incubating-bin.tgz.sha512
```
- build success from source code (ubuntu 18.04).
```
./build/mvn clean package -DskipTests -Pspark-3.3
```

Shaoyun Chen  于2023年10月1日周日 16:34写道：

> +1 (non-binding)
>
> I checked the following things:
>
> - signatures are good.
> ```
> gpg --import KEYS
> gpg --verify apache-celeborn-0.3.1-incubating-source.tgz.asc
> gpg --verify apache-celeborn-0.3.1-incubating-bin.tgz.asc
> ```
> - checksums are good.
> ```
> sha512sum --check apache-celeborn-0.3.1-incubating-source.tgz.sha512
> sha512sum --check apache-celeborn-0.3.1-incubating-bin.tgz.sha512
> ```
> - build success from source code.
> ```
> ./build/make-distribution.sh -Pspark-3.2
> ```
>
> Cheng Pan  于2023年9月28日周四 21:55写道：
>
>> +CC PJ Fanning and Duo Zhang, since you found license issue in previous
>> RC vote[1]
>>
>> lists.apache.org
>> 
>> [image: favicon.ico]
>> 
>> 
>>
>>
>> On Sep 28, 2023, at 21:52, Cheng Pan  wrote:
>>
>> Hi Celeborn community,
>>
>> This is a call for a vote to release Apache Celeborn (Incubating)
>> 0.3.1-incubating-rc3
>>
>> The git tag to be voted upon:
>>
>> https://github.com/apache/incubator-celeborn/releases/tag/v0.3.1-incubating-rc3
>>
>> The git commit hash:
>> 861788810642ef19769b097b82bee70b92e0ace0
>>
>> The source and binary artifacts can be found at:
>>
>> https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.3.1-incubating-rc3
>>
>> The staging repo:
>> https://repository.apache.org/content/repositories/orgapacheceleborn-1040
>>
>> Fingerprint of the PGP key release artifacts are signed with:
>> 8FC8075E1FDC303276C676EE8001952629BCC75D
>>
>> My public key to verify signatures can be found in:
>> https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS
>>
>> The vote will be open for at least 72 hours or until the necessary
>> number of votes are reached.
>>
>> Please vote accordingly:
>>
>> [ ] +1 approve
>> [ ] +0 no opinion
>> [ ] -1 disapprove (and the reason)
>>
>> Checklist for release:
>>
>> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
>>
>> Steps to validate the release:
>> https://www.apache.org/info/verification.html
>>
>> Instructions for making binary artifacts from source:
>> build/make-distribution.sh --release
>>
>> Thanks,
>> Cheng Pan
>>
>>
>>

Re: [VOTE] Release Apache Celeborn(Incubating) 0.3.1-incubating-rc2

[Fu Chen]

+1

I checked
- download links are valid.
- git commit hash is correct.
- no binary files in the source release.
- signatures are good.
```
gpg --import KEYS
gpg --verify apache-celeborn-0.3.1-incubating-source.tgz.asc
gpg --verify apache-celeborn-0.3.1-incubating-bin.tgz.asc
```
- checksums are good.
```
sha512sum --check apache-celeborn-0.3.1-incubating-source.tgz.sha512
sha512sum --check apache-celeborn-0.3.1-incubating-bin.tgz.sha512
```
- build success from source code (ubuntu 18.04).
```
./build/mvn clean package -DskipTests -Pspark-3.3
```


Shaoyun Chen  于2023年9月12日周二 11:01写道：

> +1 (non-binding)
>
> I checked the following things:
>
> - signatures are good.
> ```
> gpg --import KEYS
> gpg --verify apache-celeborn-0.3.1-incubating-source.tgz.asc
> gpg --verify apache-celeborn-0.3.1-incubating-bin.tgz.asc
> ```
> - checksums are good.
> ```
> sha512sum --check apache-celeborn-0.3.1-incubating-source.tgz.sha512
> sha512sum --check apache-celeborn-0.3.1-incubating-bin.tgz.sha512
> ```
> - build success from source code.
> ```
> ./build/make-distribution.sh -Pspark-3.2
> ```
>
> Keyong Zhou  于2023年9月12日周二 09:57写道：
> >
> > +1 (binding)
> >
> > I checked
> > - git commit hash is correct.
> > - links are valid.
> > - "incubating" is in the name.
> > - PGP keys are good.
> > - hashes are correct.
> > - LICENSE looks good.
> > - NOTICE looks good.
> > - DISCLAIMER exists.
> > - build success from source code (macOS). ```
> ./build/make-distribution.sh
> > --release ```
> >
> > Thanks,
> > Keyong Zhou
> >
> > rexxiong  于2023年9月11日周一 22:08写道：
> >
> > > +1 (binding)
> > > I checked
> > > - Download links are valid.
> > > - git commit hash is correct
> > > - Checksums and signatures are valid.
> > > - No binary files in the source release
> > > - Files have the word incubating in their name.
> > > - DISCLAIMER,LICENSE and NOTICE files exist.
> > > - Successfully built the binary from the source on MacOs with Command:
> > > ./build/make-distribution.sh --release
> > >
> > > Thanks,
> > > Jiashu Xiong
> > >
> > > Cheng Pan  于2023年9月11日周一 16:27写道：
> > >
> > > > Hi Celeborn community,
> > > >
> > > > This is a call for a vote to release Apache Celeborn (Incubating)
> > > > 0.3.1-incubating-rc2
> > > >
> > > > The git tag to be voted upon:
> > > >
> > > >
> > >
> https://github.com/apache/incubator-celeborn/releases/tag/v0.3.1-incubating-rc2
> > > >
> > > > The git commit hash:
> > > > 7ec5596748af49ef9cb429d08550e89d94d5cc74
> > > >
> > > > The source and binary artifacts can be found at:
> > > >
> > > >
> > >
> https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.3.1-incubating-rc2
> > > >
> > > > The staging repo:
> > > >
> > >
> https://repository.apache.org/content/repositories/orgapacheceleborn-1039
> > > >
> > > > Fingerprint of the PGP key release artifacts are signed with:
> > > > 8FC8075E1FDC303276C676EE8001952629BCC75D
> > > >
> > > > My public key to verify signatures can be found in:
> > > > https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS
> > > >
> > > > The vote will be open for at least 72 hours or until the necessary
> > > > number of votes are reached.
> > > >
> > > > Please vote accordingly:
> > > >
> > > > [ ] +1 approve
> > > > [ ] +0 no opinion
> > > > [ ] -1 disapprove (and the reason)
> > > >
> > > > Checklist for release:
> > > >
> > > >
> > >
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> > > >
> > > > Steps to validate the release:
> > > > https://www.apache.org/info/verification.html
> > > >
> > > > Instructions for making binary artifacts from source:
> > > > build/make-distribution.sh --release
> > > >
> > > > Thanks,
> > > > Cheng Pan
> > >
>