Re: [DISCUSS] Time for 0.5.2

[Yu Li]

+1.

Thanks for volunteering as the RM, Nicholas!

Best Regards,
Yu


On Fri, 27 Sept 2024 at 16:47, Ethan Feng  wrote:

> +1.
> I believe that these changes are worthy of a new release.
>
> Thanks,
> Ethan Feng
>
> Nicholas Jiang  于2024年9月23日周一 17:15写道：
> >
> > Hey, Celeborn community,
> >
> >
> > It has been a while since the 0.5.1 release, and there are some critical
> fixes land branch-0.5, for example:
> >
> >
> > [CELEBORN-1496] Differentiate map results with only different
> stageAttemptId[1]
> > [CELEBORN-1506][FOLLOWUP] InFlightRequestTracker should not reset
> totalInflightReqs for cleaning up to avoid negative totalInflightReqs for
> limitZeroInFlight[2]
> >
> >
> > From my perspective, it’s time to prepare for releasing 0.5.2.
> >
> > WDYT? And I’m volunteering to be the release manager if no one has
> applied.
> >
> > [1]
> https://github.com/apache/celeborn/commit/b9382a045b0e1c0d04d470d53237b8dee680e2be
> > [2]
> https://github.com/apache/celeborn/commit/1578f6701105fcc61977b13a4c8d866c093f045f
> >
> > Regards,
> > Nicholas Jiang
>

Re: [ANNOUNCE] New Celeborn PMC Member: Nicholas Jiang

[Yu Li]

Congrats and welcome, Nicholas!

Best Regards,
Yu


On Wed, 24 Jul 2024 at 11:31, Shaoyun Chen  wrote:

> Congratulations!
>
> Yihe Li  于2024年7月24日周三 09:35写道：
> >
> > Congratulations!
> >
> > Regards,
> > Yihe Li
> >
> > On 2024/07/23 18:05:34 Mridul Muralidharan wrote:
> > > Congratulations !
> > >
> > > Regards,
> > > Mridul
> > >
> > >
> > > On Tue, Jul 23, 2024 at 12:37 PM Fei Wang  wrote:
> > >
> > > > Congrats!
> > > >
> > > > Regards,
> > > > Fei Wang
> > > >
> > > > On 2024/07/23 10:19:37 Keyong Zhou wrote:
> > > > > Congrats!
> > > > >
> > > > > Regards,
> > > > > Keyong Zhou
> > > > >
> > > > > angers zhu  于2024年7月23日周二 18:09写道：
> > > > >
> > > > > > Congrats!
> > > > > >
> > > > > >
> > > > > > Thanks
> > > > > > Angerszh
> > > > > >
> > > > > > Cheng Pan  于2024年7月23日周二 18:01写道：
> > > > > >
> > > > > > > Congrats!
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Cheng Pan
> > > > > > >
> > > > > > > On Tue, Jul 23, 2024 at 5:34 PM rexxiong 
> > > > wrote:
> > > > > > > >
> > > > > > > > Hi Celeborn Community,
> > > > > > > >
> > > > > > > > The Project Management Committee (PMC) for Apache Celeborn
> > > > > > > > has invited Nicholas Jiang to become a PMC member and we are
> > > > pleased
> > > > > > > > to announce that he has accepted.
> > > > > > > >
> > > > > > > > A PMC member helps manage and guide the direction of the
> project.
> > > > > > > > We are glad to see his more interactions with the community
> in the
> > > > > > > future.
> > > > > > > >
> > > > > > > > Please join me in congratulating Nicholas!
> > > > > > > >
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Jiashu Xiong
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>

Re: Re: [ANNOUNCE] New Celeborn Committer: Fei Wang

[Yu Li]

Congratulations!

Best Regards,
Yu


On Tue, 23 Jul 2024 at 15:40, Mridul Muralidharan  wrote:

> Congratulations !
>
> Regards,
> Mridul
>
> On Tue, Jul 23, 2024 at 12:54 AM rexxiong  wrote:
>
> > Congratulations!
> >
> > Regards,
> > Jiashu Xiong
> >
> > Nicholas Jiang  于2024年7月23日周二 13:02写道：
> >
> > > Congratulations!Regards,
> > >
> > > Nicholas Jiang
> > >
> > >
> > > 在 2024-07-23 12:21:19，"Yihe Li"  写道：
> > > >Congratulations!
> > > >
> > > >Regards,
> > > >Yihe Li
> > > >
> > > >On 2024/07/23 04:16:20 Keyong Zhou wrote:
> > > >> Congratulations!
> > > >>
> > > >> Regards,
> > > >> Keyong Zhou
> > > >>
> > > >> angers zhu  于2024年7月23日周二 12:07写道：
> > > >>
> > > >> > Congratulations！
> > > >> >
> > > >> > Shaoyun Chen  于2024年7月23日周二 11:15写道：
> > > >> >
> > > >> > > Congratulations!
> > > >> > >
> > > >> > > Cheng Pan  于2024年7月23日周二 11:05写道：
> > > >> > > >
> > > >> > > > Hi Celeborn Community,
> > > >> > > >
> > > >> > > > The Project Management Committee (PMC) for Apache Celeborn
> > > >> > > > has invited Fei Wang to become a committer and we are pleased
> > > >> > > > to announce that he has accepted.
> > > >> > > >
> > > >> > > > Being a committer enables easier contribution to the
> > > >> > > > project since there is no need to go via the patch
> > > >> > > > submission process. This should enable better productivity.
> > > >> > > > A PMC member helps manage and guide the direction of the
> > project.
> > > >> > > >
> > > >> > > > Please join me in congratulating Fei!
> > > >> > > >
> > > >> > > > Thanks,
> > > >> > > > Cheng Pan
> > > >> > >
> > > >> >
> > > >>
> > >
> >
>

Re: Re: [VOTE] Contrinute Apache Celeborn CLI

[Yu Li]

+1

Best Regards,
Yu

On Thu, 13 Jun 2024 at 13:54, Fu Chen  wrote:
>
> +1
>
> Thanks for the proposal!
>
> Thanks,
> Fu Chen
>
> Ethan Feng  于2024年6月13日周四 10:59写道：
> >
> > Hi Aravind,
> >
> > Thanks for your detailed response and insight into the CLI
> > implementation for Celeborn. I appreciate the explanation regarding
> > the choice to use Java/Scala for the CLI. I agree that aligning with
> > the prevalent use of Java/Scala within the Celeborn community is the
> > right approach.
> >
> > Your proposed use cases for the CLI functionalities are comprehensive
> > and interesting. I appreciate your proactive approach in considering
> > various cluster management systems and the need for an abstraction
> > layer to interface uniformly.
> >
> > +1 for the current proposal.
> >
> > Looking forward to the CLI evolution.
> >
> > regards,
> > Ethan
> >
> > Aravind Patnam  于2024年6月13日周四 05:35写道：
> > >
> > > Hi Ethan,
> > >
> > > Thanks for your comments!
> > >
> > > Regarding using Java/Scala for the CLI, I am fine with this. I had 
> > > believed
> > > that using Python would be an easier/simpler implementation given that 
> > > many
> > > CLI's are implemented in Python, but the points you make are fair. Most of
> > > the Celeborn community uses Java/Scala, so this would be more beneficial
> > > for the development and evolution of the CLI.
> > >
> > > Yes, I think the CLI should contain capabilities beyond the HTTP endpoints
> > > Celeborn exposes. The Celeborn HTTP endpoints work great for application
> > > specific use cases, such as finding the applications or shuffles on a
> > > particular worker, however it would not work for situations in which we
> > > would need information on the cluster itself. For example, we use K8s and
> > > these are use cases internally I can foresee that require communication
> > > with an external cluster manager:
> > >
> > >- Retrieve all pods running masters/workers and their statuses
> > >- Manually evict an Celeborn unhealthy pod
> > >- SSH into various different Celeborn pods
> > >- Manage ACLs of the cluster
> > >- Manually restart pods
> > >- Wipe Ratis storage if state is messed up
> > >- Wipe shuffle directories if state is messed up
> > >- Adding/removing new nodes into our node pool
> > >- Perform any other manual arbitrary function on a Celeborn pod
> > >
> > >
> > > These are just a few of the use cases I can think of, but I am sure more
> > > will arise as more users adopt Celeborn :)
> > >
> > > Given that users will have various different cluster managers, I think as 
> > > I
> > > mentioned before there should be an abstraction layer present that exposes
> > > different operations. Based on the cluster manager the user is using, the
> > > user can implement their specific logic. We can have a few default ones
> > > included (e.g. Kubernetes).
> > >
> > > Hope this answers your questions, let me know if you have any more
> > > questions!
> > >
> > > Thanks,
> > > Aravind
> > >
> > > On Tue, Jun 11, 2024 at 11:57 PM Ethan Feng  wrote:
> > >
> > > > Hi Aravind,
> > > >
> > > > I hope this message finds you well. I wanted to express my
> > > > appreciation for the energy and creativity you've invested in the
> > > > Celeborn project; the proposal you submitted is intriguing.
> > > >
> > > > I apologize for the delayed feedback on your proposal — it took me a
> > > > bit longer to get to it than anticipated. After reviewing it, I have a
> > > > couple of inquiries that I'd like to discuss in order to gain a
> > > > clearer understanding:
> > > >
> > > > I observed that you're planning to implement the CLI in Python. Could
> > > > you elaborate on the choice behind not leveraging the Java stack for
> > > > this purpose? The Java ecosystem already includes mature tools such as
> > > > "commons-cli" or "Scala CLI," which are capable of facilitating CLI
> > > > tool development. Given the prevalent familiarity with the Java stack
> > > > within our community, I believe leveraging it could accelerate the
> > > > CLI's development and evolution through wider collaboration.
> > > >
> > > > From email discussions, you've indicated an interest in offering a
> > > > generic interface API for Celeborn, which is certainly exciting.
> > > > However, I'm concerned that basing a CLI on HTTP API might not fully
> > > > align with this vision. Could you provide additional insights into how
> > > > you envision the CLI advancing beyond the capabilities of the current
> > > > HTTP REST API?
> > > >
> > > > Based on previous exchanges, the CLI is expected to communicate with
> > > > an external cluster manager. Is there an abstraction layer in place to
> > > > interface uniformly with various external cluster managers, or is this
> > > > something under consideration?
> > > >
> > > > I'm looking forward to learning more about your perspectives and the
> > > > pathway you foresee for the CLI's development.
> > > >
> > > > regards,
> > > > Ethan
> > 

Re: [DISCUSS] Celeborn CLI Proposal

[Yu Li]

IIUIC, we need a formal vote on this CIP and make sure there are (at
least one) committer(s) to help review the coming up PRs.

>From the existing discussions, I believe there's no blocker but just a
normal process for this CIP to move on (smile).

And thanks for the proposal, Aravind!

Best Regards,
Yu

On Tue, 11 Jun 2024 at 13:10, Aravind Patnam  wrote:
>
> Hi all,
>
> Thanks for the reviews everyone!!
>
> Is there any other process required (such as a vote thread), or can I start
> contributing the CLI now?
>
> Thanks,
> Aravind
>
> Aravind K. Patnam
>
>
> On Mon, Jun 10, 2024 at 11:29 AM Mridul Muralidharan 
> wrote:
>
> > Hi,
> >
> >   Looks good to me as well, I had reviewed this proposal internally already
> > :-)
> >
> > Regards,
> > Mridul
> >
> >
> > On Fri, Jun 7, 2024 at 11:32 PM Keyong Zhou  wrote:
> >
> > > Hi Aravind,
> > >
> > > Thanks for the proposal! The proposal LGTM, I think it's very valuable.
> > >
> > > Regards,
> > > Keyong Zhou
> > >
> > > Aravind Patnam  于2024年6月7日周五 12:47写道：
> > >
> > > > Hi,
> > > >
> > > > Thanks Nicholas for the comments!
> > > >
> > > > I now got access to put the proposal in Confluence in the form of CIP,
> > > here
> > > > <
> > >
> > https://cwiki.apache.org/confluence/display/CELEBORN/CIP+7+-+Celeborn+CLI
> > > > >
> > > > it is.
> > > >
> > > > Regarding your questions:
> > > >
> > > > > 1. From a user's perspective, the CLI is more used for some
> > maintenance
> > > > operations such as online and offline of server, rescaling of cluster
> > > etc,
> > > > not only based on the REST API. What CLI interfaces are there that the
> > > REST
> > > > API doesn’t have for maintenance?
> > > > This is highly dependent on what the user is leveraging to manage their
> > > > cluster. For example, in k8s, you would be using k8s APIs to achieve
> > > this.
> > > > We can probably add a generic interface API for it that provides basic
> > > > operations that users can implement themselves for their cluster
> > > management
> > > > logic based on what cluster managers they are using. Although, I think
> > > this
> > > > will likely be a later evolution of the CLI, once basic REST API
> > > operations
> > > > are implemented in the CLI. WDYT?
> > > >
> > > > > 2. There are same sub-commands between MASTER and WORKER. Why not
> > these
> > > > sub-commands belong to BOTH?
> > > > Agreed - this was a formatting mistake. I fixed it now, thanks for
> > > pointing
> > > > that out.
> > > >
> > > > > 3. Does the implementation of CLI invoke the REST API? IMO, the CLI
> > > works
> > > > well no matter the server is alive.
> > > > Yes, I agree. I think for this we would have to talk to the cluster
> > > > manager, similar to my response to #1. We would have to query the
> > > specific
> > > > cluster manager to get details if the Celeborn servers are dead, since
> > > the
> > > > Celeborn REST API would not work then. We can add a generic API that
> > > users
> > > > can implement based on their own environment.
> > > >
> > > > Thanks,
> > > > Aravind
> > > >
> > > >
> > > >
> > > > On Wed, Jun 5, 2024 at 10:43 PM Nicholas Jiang <
> > nicholasji...@apache.org
> > > >
> > > > wrote:
> > > >
> > > > > Hi Aravind,
> > > > >
> > > > > Thanks for driving this CIP about Celeborn CLI. I have some comments
> > on
> > > > > this CIP:
> > > > >
> > > > > 1. From a user's perspective, the CLI is more used for some
> > maintenance
> > > > > operations such as online and offline of server, rescaling of cluster
> > > > etc,
> > > > > not only based on the REST API. What CLI interfaces are there that
> > the
> > > > REST
> > > > > API doesn’t have for maintenance?
> > > > >
> > > > > 2. There are same sub-commands between MASTER and WORKER. Why not
> > these
> > > > > sub-commands belong to BOTH?
> > > > >
> > > > > 3. Does the implementation of CLI invoke the REST API? IMO, the CLI
> > > works
> > > > > well no matter the server is alive.
> > > > >
> > > > > BTW, could this design doc of proposal follow the template of CIP[1]?
> > > > >
> > > > > [1]
> > > > >
> > > >
> > >
> > https://cwiki.apache.org/confluence/display/CELEBORN/Celeborn+Improvement+Proposals
> > > > >
> > > > > Regards,
> > > > > Nicholas Jiang
> > > > >
> > > > > On 2024/06/05 23:33:02 Aravind Patnam wrote:
> > > > > > Hi all,
> > > > > >
> > > > > > I have written up a proposal about introducing a CLI for Celeborn.
> > > You
> > > > > can
> > > > > > find the proposal
> > > > > > <
> > > > >
> > > >
> > >
> > https://docs.google.com/document/d/1j9wKFSR_ychYDF0NU5YN67WCCtNAgYTbN5CN8V3SOnk/edit?usp=sharing
> > > > > >
> > > > > > here.
> > > > > > Please let me know if you have any comments or questions.
> > > > > >
> > > > > > TLDR by introducing a CLI, it would complement the existing
> > dashboard
> > > > and
> > > > > > would benefit us internally. We rely on CLI tools internally a lot
> > > for
> > > > > > automation and other operations.
> > > > > >
> > > > > > FYI, I was not able to access the cwiki page to put 

Re: [DRAFT] Celeborn Board Report

[Yu Li]

+1. Thanks for compiling this, Keyong!

Best Regards,
Yu

On Tue, 4 Jun 2024 at 09:42, Keyong Zhou  wrote:
>
> Hi community,
>
> The board report is due on June 12th, following is the draft I made, any
> comments
> will be appreciated, thanks!
>
> ## Description:
> The mission of Apache Celeborn is the creation and maintenance of software
> related to an intermediate data service for big data computing engines to
> boost
> performance, stability, and flexibility
>
> ## Project Status:
> Current project status: New
> Issues for the board: None
>
> ## Membership Data:
> Apache Celeborn was founded 2024-03-20 (3 months ago).
> There are currently 21 committers and 13 PMC members in this project.
> The Committer-to-PMC ratio is roughly 3:2.
>
> Community changes, past quarter:
>
> - No new PMC members (project graduated recently).
> - Chandni Singh was added as committer on 2024-03-21.
> - Mridul Muralidharan was added as committer on 2024-04-29.
>
> ## Project Activity:
> Software development activity:
>
>  - We released 0.4.1 on May 28th.
>  - We are in the process of releasing 0.5.0.
>  - Memory file storage is merged to main.
>  - An optimized AQE support is under review.
>
> Meetups and Conferences:
>
>  - A talk was given in Apache Local Conference Hangzhou on May 28th.
>
> Recent releases:
>
> - 0.4.1 was released on May 22th, 2024.
> - 0.4.0-incubating was released on February 6th, 2024.
>
> ## Community Health:
> Overall community health is good. In the past quarter, dev/users mail list
> had 11%/450% increase in traffic respectively.
> The issues maillist had a 17% decrease in traffic, the PMCs treat it as
> normal fluctuation. We have been performing extensive
> outreach for our users, and encouraging them to contribute back to the
> project. Also, we are active in making a voice in various
> conferences to attract more users.
>
> Regards,
> Keyong Zhou

Re: [Discussion] Proposal Management in Celeborn Community

[Yu Li]

+1. Thanks for the efforts, Jiashu!

Best Regards,
Yu

On Wed, 29 May 2024 at 13:55, Xintong Song  wrote:
>
> Big +1! Thanks for bringing this up, Jiashu.
>
> From my experiences with Apache Flink / Paimon, the wiki-based proposal
> management works quite well.
>
> Another important improvement that I see in the CIP process is that it
> enforces a public discussion and a formal vote on mailing list for
> important changes to the project. I think this is a good practice of
> open-communication and consensus decision making of the Apache Way.
>
> Best,
>
> Xintong
>
>
>
> On Wed, May 29, 2024 at 11:19 AM rexxiong  wrote:
>
> > Hello, Celeborn community,
> >
> > In the past, when Celeborn introduced new major features or significant
> > changes, we typically used Google Docs to launch proposals. However, a
> > major issue with Google Docs is the difficulty in centrally managing these
> > proposals. Therefore, after referring to other communities and based on
> > discussions with several PMCs offline, it appears that Apache Confluence
> > could be a viable alternative for our needs. With that in mind, I would
> > like to invite all of you to share your thoughts, experiences, and
> > preferences regarding the use of Apache Confluence versus Google Docs for
> > our proposal management. Your feedback will be invaluable in helping us
> > make an informed decision that best meets the needs of our community.
> >
> > Meanwhile, I have archived previous proposals and written the Celeborn
> > Improvement Proposal (CIP) process
> > <
> > https://cwiki.apache.org/confluence/display/CELEBORN/Celeborn+Improvement+Proposals
> > >
> > on Confluence.
> >
> > What do you think? Looking forward to your thoughts on this proposal.
> >
> >
> > Thanks,
> > Jiashu Xiong
> >

Re: [DRAFT] Celeborn Board Report

[Yu Li]

LGTM. Thanks for the efforts, Keyong.

Best Regards,
Yu


On Tue, May 7, 2024 at 9:30 AM Keyong Zhou  wrote:

> Thanks Yu for your comments, based on your suggestion,
> I will restate the section as follows:
>
> In addition to encourage more discussions on mailing lists, we will
> also synchronize important information/conclusions to the mailing
> lists if they happen elsewhere.
>
> What do you think?
>
> Regards,
> Keyong Zhou
>
>
>
> Yu Li  于2024年5月6日周一 18:38写道：
>
> > Thanks for drafting the report, Keyong.
> >
> > While other parts LGTM, the below section draws my attention:
> > >> We expect issues traffic to be steady, but there may be fluctuation
> for
> > >> dev/users traffic because many of the discussions happen
> > >> in slack/wechat/dingtalk. We are encouraging more discussion to happen
> > in
> > >> maillists.
> >
> > As "if it didn’t happen on a mailing list, it didn’t happen" is one of
> > the ASF Mottos [1], in addition to encouraging more discussions on
> > mailing list, we also need to make sure important
> > information/conclusions drawn through other channels are synchronized
> > to the mailing list, especially the decision-making ones. In other
> > words, we should ensure the mailing list is the most active and the
> > official channels for making decisions.
> >
> > Best Regards,
> > Yu
> >
> > [1]
> >
> https://community.apache.org/newbiefaq.html#NewbieFAQ-IsthereaCodeofConductforApacheprojects
> >
> > On Sat, 4 May 2024 at 20:31, Mridul Muralidharan 
> wrote:
> > >
> > > Ah ! Then it makes sense to not include it :-)
> > > Thanks for clarifying !
> > >
> > > Regards,
> > > Mridul
> > >
> > >
> > > On Sat, May 4, 2024 at 4:15 AM Keyong Zhou  wrote:
> > >
> > > > Actually it's the second one. For the first one I didn't send the
> draft
> > > > to dev maillist for discussion because of lack of experience...
> > > >
> > > > Regards,
> > > > Keyong Zhou
> > > >
> > > > Mridul Muralidharan  于2024年5月3日周五 23:38写道：
> > > >
> > > > > Hi,
> > > > >
> > > > >   I meant call it out as part of the board report, so that it is
> > captured
> > > > > in our updates to board.
> > > > >
> > > > > This is the first update post TLP, right ?
> > > > >
> > > > > Regards,
> > > > > Mridul
> > > > >
> > > > > On Fri, May 3, 2024 at 1:41 AM Keyong Zhou 
> > wrote:
> > > > >
> > > > > > Hi Mridul,
> > > > > >
> > > > > > The news is posted in the following links:
> > > > > >
> > > > > > Apache.org:
> > > > > >
> > > > > >
> > > > >
> > > >
> >
> https://news.apache.org/foundation/entry/apache-software-foundation-announces-new-top-level-project-apache-celeborn
> > > > > >
> > > > > > Newswire:
> > > > > >
> > > > > >
> > > > >
> > > >
> >
> https://www.globenewswire.com/news-release/2024/04/23/2867699/0/en/Apache-Software-Foundation-Announces-New-Top-Level-Project-Apache-Celeborn.html
> > > > > >
> > > > > > X (Twitter):
> https://twitter.com/TheASF/status/1782756834450801037
> > > > > >
> > > > > > LinkedIn:
> > > > > >
> > > >
> > https://www.linkedin.com/feed/update/urn:li:activity:7188522508231352321
> > > > > >
> > > > > > Besides, we also posted a blog here (in Chinese :D) :
> > > > > > https://mp.weixin.qq.com/s/DdoJW-f3BZAvxciDbI3mTw
> > > > > > <https://mp.weixin.qq.com/s/DdoJW-f3BZAvxciDbI3mTw>
> > > > > >
> > > > > > It'll be great if we can call out louder, do you have any idea?
> : )
> > > > > >
> > > > > > Regards,
> > > > > > Keyong Zhou
> > > > > >
> > > > > > Mridul Muralidharan  于2024年5月3日周五 07:40写道：
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > >   Do we want to call out graduation to TLP ?
> > > > > > >
> > > > > > > Regards,
> > > > > > > Mridu

Re: [ANNOUNCE] Add Mridul Muralidharan as new committer

[Yu Li]

Congrats and welcome, Mridul!

Best Regards,
Yu

On Tue, 30 Apr 2024 at 10:49, angers zhu  wrote:
>
> Congratulation!
>
> Yihe Li  于2024年4月30日周二 09:53写道：
>
> > Congratulation Mridul !
> >
> > On 2024/04/29 14:02:54 Shaoyun Chen wrote:
> > > Congratulations!
> > >
> > > Mridul Muralidharan  于2024年4月29日周一 14:02写道：
> > > >
> > > > Thank you everyone :-)
> > > > It has been a pleasure working with the Celeborn community, and I look
> > > > forward to continuing to learn from and contribute to the project !
> > > >
> > > > Regards,
> > > > Mridul
> > > >
> > > > On Mon, Apr 29, 2024 at 12:38 AM Fu Chen  wrote:
> > > >
> > > > > Congratulations and thank you to Mridul for the contributions to the
> > > > > community!
> > > > >
> > > > > Regards,
> > > > > Fu Chen
> > > > >
> > > > > Cheng Pan  于2024年4月29日周一 12:10写道：
> > > > > >
> > > > > > Congrats Mridul, your expertise in Spark kernel, and the Security
> > area
> > > > > are impressive.
> > > > > >
> > > > > > Thanks,
> > > > > > Cheng Pan
> > > > > >
> > > > > >
> > > > > > > On Apr 29, 2024, at 09:21, Keyong Zhou 
> > wrote:
> > > > > > >
> > > > > > > Hi Celeborn Community,
> > > > > > >
> > > > > > > The Project Management Committee (PMC) for Apache Celeborn
> > > > > > > has invited Mridul Muralidharan to become a committer and we are
> > > > > pleased
> > > > > > > to announce that he has accepted.
> > > > > > >
> > > > > > > Being a committer enables easier contribution to the
> > > > > > > project since there is no need to go via the patch
> > > > > > > submission process. This should enable better productivity.
> > > > > > > A PMC member helps manage and guide the direction of the project.
> > > > > > >
> > > > > > > Please join me in congratulating Mridul Muralidharan!
> > > > > > >
> > > > > > > Regards,
> > > > > > > Keyong Zhou
> > > > > >
> > > > >
> > >
> >

Re: [DRAFT] Celeborn Board Report

[Yu Li]

Thanks for drafting the report, Keyong.

While other parts LGTM, the below section draws my attention:
>> We expect issues traffic to be steady, but there may be fluctuation for
>> dev/users traffic because many of the discussions happen
>> in slack/wechat/dingtalk. We are encouraging more discussion to happen in
>> maillists.

As "if it didn’t happen on a mailing list, it didn’t happen" is one of
the ASF Mottos [1], in addition to encouraging more discussions on
mailing list, we also need to make sure important
information/conclusions drawn through other channels are synchronized
to the mailing list, especially the decision-making ones. In other
words, we should ensure the mailing list is the most active and the
official channels for making decisions.

Best Regards,
Yu

[1] 
https://community.apache.org/newbiefaq.html#NewbieFAQ-IsthereaCodeofConductforApacheprojects

On Sat, 4 May 2024 at 20:31, Mridul Muralidharan  wrote:
>
> Ah ! Then it makes sense to not include it :-)
> Thanks for clarifying !
>
> Regards,
> Mridul
>
>
> On Sat, May 4, 2024 at 4:15 AM Keyong Zhou  wrote:
>
> > Actually it's the second one. For the first one I didn't send the draft
> > to dev maillist for discussion because of lack of experience...
> >
> > Regards,
> > Keyong Zhou
> >
> > Mridul Muralidharan  于2024年5月3日周五 23:38写道：
> >
> > > Hi,
> > >
> > >   I meant call it out as part of the board report, so that it is captured
> > > in our updates to board.
> > >
> > > This is the first update post TLP, right ?
> > >
> > > Regards,
> > > Mridul
> > >
> > > On Fri, May 3, 2024 at 1:41 AM Keyong Zhou  wrote:
> > >
> > > > Hi Mridul,
> > > >
> > > > The news is posted in the following links:
> > > >
> > > > Apache.org:
> > > >
> > > >
> > >
> > https://news.apache.org/foundation/entry/apache-software-foundation-announces-new-top-level-project-apache-celeborn
> > > >
> > > > Newswire:
> > > >
> > > >
> > >
> > https://www.globenewswire.com/news-release/2024/04/23/2867699/0/en/Apache-Software-Foundation-Announces-New-Top-Level-Project-Apache-Celeborn.html
> > > >
> > > > X (Twitter): https://twitter.com/TheASF/status/1782756834450801037
> > > >
> > > > LinkedIn:
> > > >
> > https://www.linkedin.com/feed/update/urn:li:activity:7188522508231352321
> > > >
> > > > Besides, we also posted a blog here (in Chinese :D) :
> > > > https://mp.weixin.qq.com/s/DdoJW-f3BZAvxciDbI3mTw
> > > > 
> > > >
> > > > It'll be great if we can call out louder, do you have any idea? : )
> > > >
> > > > Regards,
> > > > Keyong Zhou
> > > >
> > > > Mridul Muralidharan  于2024年5月3日周五 07:40写道：
> > > >
> > > > > Hi,
> > > > >
> > > > >   Do we want to call out graduation to TLP ?
> > > > >
> > > > > Regards,
> > > > > Mridul
> > > > >
> > > > > On Thu, May 2, 2024 at 3:34 AM Keyong Zhou 
> > wrote:
> > > > >
> > > > > > Hi community,
> > > > > >
> > > > > > The board report is due on May 8th, following is the draft I made,
> > > any
> > > > > > comments
> > > > > > will be appreciated, thanks!
> > > > > >
> > > > > > ## Description:
> > > > > > The mission of Apache Celeborn is the creation and maintenance of
> > > > > software
> > > > > > related to an intermediate data service for big data computing
> > > engines
> > > > to
> > > > > > boost
> > > > > > performance, stability, and flexibility
> > > > > >
> > > > > > ## Project Status:
> > > > > > Current project status: New
> > > > > > Issues for the board: None
> > > > > >
> > > > > > ## Membership Data:
> > > > > > Apache Celeborn was founded 2024-03-20 (2 months ago).
> > > > > > There are currently 21 committers and 13 PMC members in this
> > project.
> > > > > > The Committer-to-PMC ratio is roughly 3:2.
> > > > > >
> > > > > > Community changes, past quarter:
> > > > > >
> > > > > > - No new PMC members (project graduated recently).
> > > > > > - Chandni Singh was added as committer on 2024-03-21.
> > > > > > - Mridul Muralidharan was added as committer on 2024-04-29.
> > > > > >
> > > > > > ## Project Activity:
> > > > > > Software development activity:
> > > > > >
> > > > > >  - We are preparing to release 0.4.1 in May.
> > > > > >  - We are preparing to release 0.5.0 in May.
> > > > > >  - Security support (authentication and SSL) has been merged.
> > > > > >  - Memory storage is close to being merged.
> > > > > >
> > > > > > Meetups and Conferences:
> > > > > >
> > > > > >  - An online meetup was held on April 16th with some developers.
> > > > > >  - An online meetup was held on April 25th with some users.
> > > > > >
> > > > > > Recent releases:
> > > > > >
> > > > > > - 0.4.0-incubating was released on 2024-02-06.
> > > > > > - 0.3.2-incubating was released on 2024-01-08.
> > > > > >
> > > > > > ## Community Health:
> > > > > > Overall community health is good. In the past quarter,
> > > dev/issues/users
> > > > > > mail list had 6%/11%/1100% increase in traffic respectively.
> > > > > > We expect issues traffic to be steady, but there may be fluctuatio

Re: [DISCUSS] Time for 0.4.1

[Yu Li]

+1, thanks for driving this and volunteering as our RM, Nicholas!

Best Regards,
Yu

On Sat, 13 Apr 2024 at 10:31, Keyong Zhou  wrote:
>
> +1, thanks Nicholas for volunteering!
>
> Regards,
> Keyong Zhou
>
> Shaoyun Chen  于2024年4月12日周五 22:03写道：
>
> > +1
> >
> > Cheng Pan  于2024年4月12日周五 20:04写道：
> > >
> > > +1, we do need a patch release for 0.4
> > >
> > > Thanks,
> > > Cheng Pan
> > >
> > >
> > > > On Apr 12, 2024, at 19:59, Nicholas Jiang 
> > wrote:
> > > >
> > > > Hey, Celeborn community,
> > > >
> > > >
> > > > It has been a while since the 0.4.0 release, and there are some
> > critical fixes land branch-0.4, for example, [CELEBORN-1252][FOLLOWUP] Fix
> > Worker#computeResourceConsumption NullPointerException for
> > userResourceConsumption that does not contain given userIdentifier. From my
> > perspective, it’s time to prepare for releasing 0.4.1.
> > > >
> > > >
> > > > WDYT? And I’m volunteering to be the release manager if no one has
> > applied.
> > > >
> > > > Regards,
> > > > Nicholas Jiang
> > >
> > >
> >

Re: Re: [ANNOUNCE] Add Chandni Singh as new committer

[Yu Li]

Congratulations, Chandni!

Best Regards,
Yu

On Fri, 22 Mar 2024 at 15:15, Ethan Feng  wrote:
>
> Congratulations.
>
> Thanks,
> Ethan Feng
>
> Cheng Pan  于2024年3月21日周四 23:08写道：
> >
> > Welcome, and congrats!
> >
> > Thanks,
> > Cheng Pan
> >
> > On Thu, Mar 21, 2024 at 7:46 PM Yihe Li  wrote:
> > >
> > > Congratulations!
> > >
> > > Regards,
> > > Yihe Li
> > >
> > > On 2024/03/21 11:21:52 Fu Chen wrote:
> > > > Congratulations and thank you to Chandni for the contributions to the 
> > > > community!
> > > >
> > > > Regards,
> > > > Fu Chen
> > > >
> > > > Nicholas  于2024年3月21日周四 19:20写道：
> > > > >
> > > > > Congratulations Chandni. Well deserved!
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > Regards,
> > > > > Nicholas Jiang
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > At 2024-03-21 19:16:25, "Shaoyun Chen"  wrote:
> > > > > >Congratulations!
> > > > > >
> > > > > >Mridul Muralidharan  于2024年3月21日周四 16:54写道：
> > > > > >>
> > > > > >> Congratulations Chandni ! Great job :-)
> > > > > >>
> > > > > >> Regards,
> > > > > >> Mridul
> > > > > >>
> > > > > >>
> > > > > >> On Thu, Mar 21, 2024 at 3:30 AM Keyong Zhou  
> > > > > >> wrote:
> > > > > >>
> > > > > >> > Hi Celeborn Community,
> > > > > >> >
> > > > > >> > The Podling Project Management Committee (PPMC) for Apache 
> > > > > >> > Celeborn
> > > > > >> > has invited Chandni Singh to become a committer and we are 
> > > > > >> > pleased
> > > > > >> > to announce that she has accepted.
> > > > > >> >
> > > > > >> > Being a committer enables easier contribution to the
> > > > > >> > project since there is no need to go via the patch
> > > > > >> > submission process. This should enable better productivity.
> > > > > >> > A (P)PMC member helps manage and guide the direction of the 
> > > > > >> > project.
> > > > > >> >
> > > > > >> > Please join me in congratulating Chandni Singh!
> > > > > >> >
> > > > > >> > Thanks,
> > > > > >> > Keyong Zhou
> > > > > >> >
> > > >

[RESULT] [VOTE] Graduate Apache Celeborn (incubating) as a TLP - Community

[Yu Li]

Hi All

The vote for "Graduate Apache Celeborn (incubating) as a TLP -
Community" has passed with 12 +1 votes (* = binding) and no +0/-1:

- Cheng Pan *
- Yi (Angers) Zhu *
- Fu Chen *
- Binjie Yang
- Nicholas Jiang
- Mridul Muralidharan
- Shaoyun Chen
- Keyong Zhou *
- Wu Wei *
- Jiashu Xiong *
- Yihe Li
- Yu Li *

Thanks all. We'll start the discussion on the general@incubator
mailing list soon.

Best Regards,
Yu

On Mon, 4 Mar 2024 at 18:58, Yu Li  wrote:
>
> Here is my own +1.
>
> Thanks all for the vote and I will conclude it in another email.
>
> Best Regards,
> Yu
>
> On Mon, 4 Mar 2024 at 16:09, Yihe Li  wrote:
> >
> > +1
> >
> > Thanks,
> > Yihe Li
> >
> > On 2024/03/04 07:37:10 rexxiong wrote:
> > > +1
> > >
> > > Thanks,
> > > Jiashu Xiong
> > >
> > > keyong zhou  于2024年3月1日周五 21:24写道：
> > >
> > > > +1
> > > >
> > > > Regards,
> > > > Keyong Zhou
> > > >
> > > > Mridul Muralidharan  于2024年3月1日周五 19:58写道：
> > > >
> > > > > +1
> > > > >
> > > > > Regards,
> > > > > Mridul
> > > > >
> > > > >
> > > > > On Fri, Mar 1, 2024 at 4:35 AM Nicholas  wrote:
> > > > >
> > > > > >
> > > > > > +1.
> > > > > >
> > > > > >
> > > > > > Regards,
> > > > > > Nicholas Jiang
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > 发自我的网易邮箱手机智能版
> > > > > > 
> > > > > >
> > > > > >
> > > > > > - Original Message -
> > > > > > From: "Yu Li" 
> > > > > > To: dev@celeborn.apache.org
> > > > > > Sent: Fri, 1 Mar 2024 16:52:10 +0800
> > > > > > Subject: [VOTE] Graduate Apache Celeborn (incubating) as a TLP -
> > > > > Community
> > > > > >
> > > > > > Hi All,
> > > > > >
> > > > > > After a thorough discussion [1], I'd like to call a formal vote to
> > > > > > graduate Apache Celeborn (incubating) as a TLP. Below are some facts
> > > > > > and project highlights carried from [1] as well as the draft
> > > > > > resolution:
> > > > > >
> > > > > > - Currently, our community consists of 19 committers (including
> > > > > > mentors) from more than 10 companies, with 12 serving as PPMC 
> > > > > > members.
> > > > > > - So far, we have boasted 81 contributors.
> > > > > > - Throughout the incubation period, we've made 6 releases in 16
> > > > > > months, at a stable pace.
> > > > > > - We've had 6 different release managers to date.
> > > > > > - Our software is used in production by 10+ well known entities.
> > > > > > - As yet, we have opened 1,286 issues with 1,176 successfully 
> > > > > > resolved.
> > > > > > - We have submitted a total of 1,816 PRs, out of which 1,805 have 
> > > > > > been
> > > > > > merged or closed.
> > > > > > - Through self-assessment [2], we have met all maturity criteria as
> > > > > > outlined in [3].
> > > > > >
> > > > > > We've resolved all branding issues which include Logo, GitHub repo,
> > > > > > document, website, and others [4] [5].
> > > > > >
> > > > > > --
> > > > > > Establish the Apache Celeborn Project
> > > > > >
> > > > > > WHEREAS, the Board of Directors deems it to be in the best 
> > > > > > interests of
> > > > > > the Foundation and consistent with the Foundation's purpose to
> > > > establish
> > > > > > a Project Management Committee charged with the creation and
> > > > maintenance
> > > > > > of open-source software, for distribution at no charge to the 
> > > > > > public,
> > > > > > related to an intermediate data service for big data computing 
> > > > > > engines
> > > > > > to boost performance, stability, and flexibility.
> > >

Re: [VOTE] Graduate Apache Celeborn (incubating) as a TLP - Community

[Yu Li]

Here is my own +1.

Thanks all for the vote and I will conclude it in another email.

Best Regards,
Yu

On Mon, 4 Mar 2024 at 16:09, Yihe Li  wrote:
>
> +1
>
> Thanks,
> Yihe Li
>
> On 2024/03/04 07:37:10 rexxiong wrote:
> > +1
> >
> > Thanks,
> > Jiashu Xiong
> >
> > keyong zhou  于2024年3月1日周五 21:24写道：
> >
> > > +1
> > >
> > > Regards,
> > > Keyong Zhou
> > >
> > > Mridul Muralidharan  于2024年3月1日周五 19:58写道：
> > >
> > > > +1
> > > >
> > > > Regards,
> > > > Mridul
> > > >
> > > >
> > > > On Fri, Mar 1, 2024 at 4:35 AM Nicholas  wrote:
> > > >
> > > > >
> > > > > +1.
> > > > >
> > > > >
> > > > > Regards,
> > > > > Nicholas Jiang
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > 发自我的网易邮箱手机智能版
> > > > > 
> > > > >
> > > > >
> > > > > - Original Message -
> > > > > From: "Yu Li" 
> > > > > To: dev@celeborn.apache.org
> > > > > Sent: Fri, 1 Mar 2024 16:52:10 +0800
> > > > > Subject: [VOTE] Graduate Apache Celeborn (incubating) as a TLP -
> > > > Community
> > > > >
> > > > > Hi All,
> > > > >
> > > > > After a thorough discussion [1], I'd like to call a formal vote to
> > > > > graduate Apache Celeborn (incubating) as a TLP. Below are some facts
> > > > > and project highlights carried from [1] as well as the draft
> > > > > resolution:
> > > > >
> > > > > - Currently, our community consists of 19 committers (including
> > > > > mentors) from more than 10 companies, with 12 serving as PPMC members.
> > > > > - So far, we have boasted 81 contributors.
> > > > > - Throughout the incubation period, we've made 6 releases in 16
> > > > > months, at a stable pace.
> > > > > - We've had 6 different release managers to date.
> > > > > - Our software is used in production by 10+ well known entities.
> > > > > - As yet, we have opened 1,286 issues with 1,176 successfully 
> > > > > resolved.
> > > > > - We have submitted a total of 1,816 PRs, out of which 1,805 have been
> > > > > merged or closed.
> > > > > - Through self-assessment [2], we have met all maturity criteria as
> > > > > outlined in [3].
> > > > >
> > > > > We've resolved all branding issues which include Logo, GitHub repo,
> > > > > document, website, and others [4] [5].
> > > > >
> > > > > --
> > > > > Establish the Apache Celeborn Project
> > > > >
> > > > > WHEREAS, the Board of Directors deems it to be in the best interests 
> > > > > of
> > > > > the Foundation and consistent with the Foundation's purpose to
> > > establish
> > > > > a Project Management Committee charged with the creation and
> > > maintenance
> > > > > of open-source software, for distribution at no charge to the public,
> > > > > related to an intermediate data service for big data computing engines
> > > > > to boost performance, stability, and flexibility.
> > > > >
> > > > > NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee
> > > > > (PMC), to be known as the "Apache Celeborn Project", be and hereby is
> > > > > established pursuant to Bylaws of the Foundation; and be it further
> > > > >
> > > > > RESOLVED, that the Apache Celeborn Project be and hereby is 
> > > > > responsible
> > > > > for the creation and maintenance of software related to an 
> > > > > intermediate
> > > > > data service for big data computing engines to boost performance,
> > > > > stability, and flexibility; and be it further
> > > > >
> > > > > RESOLVED, that the office of "Vice President, Apache Celeborn" be and
> > > > > hereby is created, the person holding such office to serve at the
> > > > > direction of the Board of Directors as the chair of the Apache 
> > > > > Celeborn
> > > > 

[VOTE] Graduate Apache Celeborn (incubating) as a TLP - Community

[Yu Li]

Hi All,

After a thorough discussion [1], I'd like to call a formal vote to
graduate Apache Celeborn (incubating) as a TLP. Below are some facts
and project highlights carried from [1] as well as the draft
resolution:

- Currently, our community consists of 19 committers (including
mentors) from more than 10 companies, with 12 serving as PPMC members.
- So far, we have boasted 81 contributors.
- Throughout the incubation period, we've made 6 releases in 16
months, at a stable pace.
- We've had 6 different release managers to date.
- Our software is used in production by 10+ well known entities.
- As yet, we have opened 1,286 issues with 1,176 successfully resolved.
- We have submitted a total of 1,816 PRs, out of which 1,805 have been
merged or closed.
- Through self-assessment [2], we have met all maturity criteria as
outlined in [3].

We've resolved all branding issues which include Logo, GitHub repo,
document, website, and others [4] [5].

--
Establish the Apache Celeborn Project

WHEREAS, the Board of Directors deems it to be in the best interests of
the Foundation and consistent with the Foundation's purpose to establish
a Project Management Committee charged with the creation and maintenance
of open-source software, for distribution at no charge to the public,
related to an intermediate data service for big data computing engines
to boost performance, stability, and flexibility.

NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee
(PMC), to be known as the "Apache Celeborn Project", be and hereby is
established pursuant to Bylaws of the Foundation; and be it further

RESOLVED, that the Apache Celeborn Project be and hereby is responsible
for the creation and maintenance of software related to an intermediate
data service for big data computing engines to boost performance,
stability, and flexibility; and be it further

RESOLVED, that the office of "Vice President, Apache Celeborn" be and
hereby is created, the person holding such office to serve at the
direction of the Board of Directors as the chair of the Apache Celeborn
Project, and to have primary responsibility for management of the
projects within the scope of responsibility of the Apache Celeborn
Project; and be it further

RESOLVED, that the persons listed immediately below be and hereby are
appointed to serve as the initial members of the Apache Celeborn
Project:

 * Becket Qin
 * Cheng Pan 
 * Duo Zhang 
 * Ethan Feng
 * Fu Chen   
 * Jiashu Xiong  
 * Kerwin Zhang  
 * Keyong Zhou   
 * Lidong Dai
 * Willem Ning Jiang 
 * Wu Wei
 * Yi Zhu
 * Yu Li 

NOW, THEREFORE, BE IT FURTHER RESOLVED, that Keyong Zhou be appointed to
the office of Vice President, Apache Celeborn, to serve in accordance
with and subject to the direction of the Board of Directors and the
Bylaws of the Foundation until death, resignation, retirement, removal
or disqualification, or until a successor is appointed; and be it
further

RESOLVED, that the Apache Celeborn Project be and hereby is tasked with
the migration and rationalization of the Apache Incubator Celeborn
podling; and be it further

RESOLVED, that all responsibilities pertaining to the Apache Incubator
Celeborn podling encumbered upon the Apache Incubator PMC are hereafter
discharged.
--

Best Regards,
Yu

[1] https://lists.apache.org/thread/z17rs0mw4nyv0s112dklmv7s3j053mby
[2] 
https://cwiki.apache.org/confluence/display/CELEBORN/Apache+Maturity+Model+Assessment+for+Celeborn
[3] https://community.apache.org/apache-way/apache-project-maturity-model.html
[4] https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-206
[5] https://whimsy.apache.org/pods/project/celeborn

Re: [DISCUSS] Graduate Celeborn as TLP

[Yu Li]

Thanks all for the feedback and Cheng for the quick fix. I will start
a vote in this mailing list soon.

Best Regards,
Yu

On Thu, 29 Feb 2024 at 13:45, Cheng Pan  wrote:
>
> The Apache Podling Website Checks[1] issue has been fixed now.
>
> [1] https://whimsy.apache.org/pods/project/celeborn
>
> Thanks,
> Cheng Pan
>
>
> > On Feb 29, 2024, at 13:41, Mridul Muralidharan  wrote:
> >
> > +1
> > Looking forward to Celeborn as a TLP !
> >
> > Best wishes to the community :-)
> >
> > Regards,
> > Mridul
> >
> >
> > On Tue, Feb 27, 2024 at 5:23 AM Willem Jiang  wrote:
> >
> >> Thanks for the clarification. Now we are good to go.
> >>
> >> Willem Jiang
> >>
> >>
> >>
> >> On Tue, Feb 27, 2024 at 7:15 PM Keyong Zhou  wrote:
> >>>
> >>> Thanks Willian for the information, as Cheng said, we didn't start the
> >>> registration process before :)
> >>>
> >>> Best,
> >>> Keyong Zhou
> >>>
> >>> Willem Jiang  于2024年2月27日周二 18:48写道：
> >>>
> >>>> It‘s OK if we don't register any trademark of Celeborn.
> >>>> If we already registered the trademark of Celeborn, we need to have
> >>>> the approval of the trademark VP.
> >>>>
> >>>> Willem Jiang
> >>>>
> >>>>
> >>>> On Tue, Feb 27, 2024 at 6:19 PM Cheng Pan  wrote:
> >>>>>
> >>>>> Hi Willem,
> >>>>>
> >>>>> For trademark concerns, the "Apache Celeborn” gets approval by
> >> ASF[1],
> >>>> do we need any additional work?
> >>>>>
> >>>>> [1] https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-206
> >>>>>
> >>>>> Thanks,
> >>>>> Cheng Pan
> >>>>>
> >>>>>
> >>>>>> On Feb 27, 2024, at 17:45, Willem Jiang 
> >>>> wrote:
> >>>>>>
> >>>>>> +1， it's good to see Celeborn is ready for graduation.
> >>>>>>
> >>>>>> I have a quick question about Celeborn's trademark. Did we start
> >> the
> >>>>>> registration process before?
> >>>>>>
> >>>>>> BTW  the podling name search is approved by trademark VP [1]
> >>>>>>
> >>>>>> [1] https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-206
> >>>>>>
> >>>>>> Willem Jiang
> >>>>>>
> >>>>>> On Tue, Feb 27, 2024 at 9:40 AM Yu Li  wrote:
> >>>>>>>
> >>>>>>> Dear Celeborn Devs,
> >>>>>>>
> >>>>>>> We, the Celeborn community, began our incubation journey on
> >> October
> >>>>>>> 18, 2022. Since then, with the continuous efforts of you all, our
> >>>>>>> community has steadily developed and gradually matured,
> >> approaching
> >>>>>>> the graduation criteria [1]. Therefore, I'd like to call a
> >> discussion
> >>>>>>> to graduate Celeborn as TLP. Below are some statistics I
> >> collected,
> >>>>>>> please check it and let me know your thoughts.
> >>>>>>>
> >>>>>>> - Currently, our community consists of 19 committers (including
> >>>>>>> mentors) from more than 10 companies, with 12 serving as PPMC
> >> members
> >>>>>>> [2].
> >>>>>>> - So far, we have boasted 81 contributors.
> >>>>>>> - Throughout the incubation period, we've made 6 releases [3] in
> >> 16
> >>>>>>> months, at a stable pace.
> >>>>>>> - We've had 6 different release managers to date.
> >>>>>>> - Our software is used in production by 10+ well known entities
> >> [4].
> >>>>>>> - As yet, we have opened 1,286 issues with 1,176 successfully
> >>>> resolved [5].
> >>>>>>> - We have submitted a total of 1,816 PRs, out of which 1,805 have
> >> been
> >>>>>>> merged or closed [6].
> >>>>>>> - Through self-assessment [7], we have met all maturity criteria
> >> as
> >>>>>>> outlined in [1

Re: [DISCUSS] Graduate Celeborn as TLP

[Yu Li]

Thanks for pointing this out, Cheng. I will wait for the fix of these
issues before starting the vote.

Best Regards,
Yu

On Tue, 27 Feb 2024 at 11:14, Cheng Pan  wrote:
>
> Thanks, Yu, for driving this, overall I agree we can graduate and move 
> forward.
>
> I just found there are minor issues on the Podling Website Checks[1], the 
> PPMC is actively working on this.
>
> [1] https://whimsy.apache.org/pods/project/celeborn
>
> Thanks,
> Cheng Pan
>
>
> > On Feb 27, 2024, at 10:58, Nicholas Jiang  wrote:
> >
> > Hi Yu,
> >
> >
> >
> >
> > +1. Celeborn has active community with much contribution of developers and 
> > many company production practice including my company bilibili. It's time 
> > to start the graduation procedure. Forward to the graduation of Apache 
> > Celeborn.
> >
> >
> >
> >
> > Regards,
> >
> > Nicholas Jiang
> >
> >
> > At 2024-02-27 09:40:04, "Yu Li"  wrote:
> >> Dear Celeborn Devs,
> >>
> >> We, the Celeborn community, began our incubation journey on October
> >> 18, 2022. Since then, with the continuous efforts of you all, our
> >> community has steadily developed and gradually matured, approaching
> >> the graduation criteria [1]. Therefore, I'd like to call a discussion
> >> to graduate Celeborn as TLP. Below are some statistics I collected,
> >> please check it and let me know your thoughts.
> >>
> >> - Currently, our community consists of 19 committers (including
> >> mentors) from more than 10 companies, with 12 serving as PPMC members
> >> [2].
> >> - So far, we have boasted 81 contributors.
> >> - Throughout the incubation period, we've made 6 releases [3] in 16
> >> months, at a stable pace.
> >> - We've had 6 different release managers to date.
> >> - Our software is used in production by 10+ well known entities [4].
> >> - As yet, we have opened 1,286 issues with 1,176 successfully resolved [5].
> >> - We have submitted a total of 1,816 PRs, out of which 1,805 have been
> >> merged or closed [6].
> >> - Through self-assessment [7], we have met all maturity criteria as
> >> outlined in [1].
> >>
> >> And below is the drafted graduation resolution, JFYI:
> >> --
> >> Establish the Apache Celeborn Project
> >>
> >> WHEREAS, the Board of Directors deems it to be in the best interests of
> >> the Foundation and consistent with the Foundation's purpose to establish
> >> a Project Management Committee charged with the creation and maintenance
> >> of open-source software, for distribution at no charge to the public,
> >> related to an intermediate data service for big data computing engines
> >> to boost performance, stability, and flexibility.
> >>
> >> NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee
> >> (PMC), to be known as the "Apache Celeborn Project", be and hereby is
> >> established pursuant to Bylaws of the Foundation; and be it further
> >>
> >> RESOLVED, that the Apache Celeborn Project be and hereby is responsible
> >> for the creation and maintenance of software related to an intermediate
> >> data service for big data computing engines to boost performance,
> >> stability, and flexibility; and be it further
> >>
> >> RESOLVED, that the office of "Vice President, Apache Celeborn" be and
> >> hereby is created, the person holding such office to serve at the
> >> direction of the Board of Directors as the chair of the Apache Celeborn
> >> Project, and to have primary responsibility for management of the
> >> projects within the scope of responsibility of the Apache Celeborn
> >> Project; and be it further
> >>
> >> RESOLVED, that the persons listed immediately below be and hereby are
> >> appointed to serve as the initial members of the Apache Celeborn
> >> Project:
> >>
> >> * Becket Qin
> >> * Cheng Pan 
> >> * Duo Zhang 
> >> * Ethan Feng
> >> * Fu Chen   
> >> * Jiashu Xiong  
> >> * Kerwin Zhang  
> >> * Keyong Zhou   
> >> * Lidong Dai
> >> * Willem Ning Jiang 
> >> * Wu Wei
> >> * Yi Zhu
> >> * Yu Li 
> >>
> >> NOW, THEREFORE, BE IT FURTHER RESOLVED, that Keyong Zhou be appointed

[DISCUSS] Graduate Celeborn as TLP

[Yu Li]

Dear Celeborn Devs,

We, the Celeborn community, began our incubation journey on October
18, 2022. Since then, with the continuous efforts of you all, our
community has steadily developed and gradually matured, approaching
the graduation criteria [1]. Therefore, I'd like to call a discussion
to graduate Celeborn as TLP. Below are some statistics I collected,
please check it and let me know your thoughts.

- Currently, our community consists of 19 committers (including
mentors) from more than 10 companies, with 12 serving as PPMC members
[2].
- So far, we have boasted 81 contributors.
- Throughout the incubation period, we've made 6 releases [3] in 16
months, at a stable pace.
- We've had 6 different release managers to date.
- Our software is used in production by 10+ well known entities [4].
- As yet, we have opened 1,286 issues with 1,176 successfully resolved [5].
- We have submitted a total of 1,816 PRs, out of which 1,805 have been
merged or closed [6].
- Through self-assessment [7], we have met all maturity criteria as
outlined in [1].

And below is the drafted graduation resolution, JFYI:
--
Establish the Apache Celeborn Project

WHEREAS, the Board of Directors deems it to be in the best interests of
the Foundation and consistent with the Foundation's purpose to establish
a Project Management Committee charged with the creation and maintenance
of open-source software, for distribution at no charge to the public,
related to an intermediate data service for big data computing engines
to boost performance, stability, and flexibility.

NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee
(PMC), to be known as the "Apache Celeborn Project", be and hereby is
established pursuant to Bylaws of the Foundation; and be it further

RESOLVED, that the Apache Celeborn Project be and hereby is responsible
for the creation and maintenance of software related to an intermediate
data service for big data computing engines to boost performance,
stability, and flexibility; and be it further

RESOLVED, that the office of "Vice President, Apache Celeborn" be and
hereby is created, the person holding such office to serve at the
direction of the Board of Directors as the chair of the Apache Celeborn
Project, and to have primary responsibility for management of the
projects within the scope of responsibility of the Apache Celeborn
Project; and be it further

RESOLVED, that the persons listed immediately below be and hereby are
appointed to serve as the initial members of the Apache Celeborn
Project:

 * Becket Qin
 * Cheng Pan 
 * Duo Zhang 
 * Ethan Feng
 * Fu Chen   
 * Jiashu Xiong  
 * Kerwin Zhang  
 * Keyong Zhou   
 * Lidong Dai
 * Willem Ning Jiang 
 * Wu Wei    
 * Yi Zhu
 * Yu Li 

NOW, THEREFORE, BE IT FURTHER RESOLVED, that Keyong Zhou be appointed to
the office of Vice President, Apache Celeborn, to serve in accordance
with and subject to the direction of the Board of Directors and the
Bylaws of the Foundation until death, resignation, retirement, removal
or disqualification, or until a successor is appointed; and be it
further

RESOLVED, that the Apache Celeborn Project be and hereby is tasked with
the migration and rationalization of the Apache Incubator Celeborn
podling; and be it further

RESOLVED, that all responsibilities pertaining to the Apache Incubator
Celeborn podling encumbered upon the Apache Incubator PMC are hereafter
discharged.
--

Best Regards,
Yu

[1] https://incubator.apache.org/guides/graduation.html
[2] https://celeborn.apache.org/community/project_management_committee
[3] 
https://issues.apache.org/jira/projects/CELEBORN?selectedItem=com.atlassian.jira.jira-projects-plugin:release-page&status=released
[4] https://github.com/apache/incubator-celeborn/issues/2140
[5] https://s.apache.org/celeborn_jira_issues
[6] https://github.com/apache/incubator-celeborn/pulls
[7] 
https://cwiki.apache.org/confluence/display/CELEBORN/Apache+Maturity+Model+Assessment+for+Celeborn

Re: [VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc4

[Yu Li]

-1 (binding)

- Checked the diff between 0.3.2 and 0.4.0-rc4: FAILED (
https://github.com/apache/incubator-celeborn/compare/v0.3.2-incubating...v0.4.0-incubating-rc4).
Problems observed include:
   * The client-flink/flink-1.15-shaded module bundles
*com.google.guava:failureaccess* but has no entry in the embedded LICENSE
file. Actually, most (if not all) shaded jars
(flink-1.14/1.15/1.17/1.18-shaded, spark-3-shaded, mr-shaded, etc.) have
this problem.
   * The client-mr/mr-shaded module bundles *com.github.luben:zstd-jni* but
has no entry in the embedded LICENSE file. What's more, since this bundled
dependency is with BSD license [1], the relative license file needs to be
embedded.

AFAICS, this release has multiple dependency-related (dep version change,
new dep introduced, etc.) commits, so I suggest paying more attention to
the legal check for the next RC.

And maybe a shorter release cycle for major versions would help to reduce
the efforts required for (incremental) legal checking.

Best Regards,
Yu

[1] https://github.com/luben/zstd-jni?tab=License-1-ov-file#readme

On Tue, 23 Jan 2024 at 15:20, Suyan  wrote:

> I was just kidding. Don't worry about it.
> It's certainly not a problem.
>
> Sincerely,
> Suyan
>
> > 2024年1月23日 01:49，Fu Chen  写道：
> >
> > Hi Suyan,
> >
> > Thank you for your vote. The GPG key was generated when I first released
> > the Kyuubi project. Regarding the GPG key name, it's merely an
> identifier,
> > and I believe it should not be a blocking issue.
> >
> > Thanks,
> > Fu Chen
> >
> > Suyan  于2024年1月22日周一 22:01写道：
> >
> >> +1 non-binding
> >>
> >> [x] Download links are valid
> >> [x] Checksums and signatures
> >> gpg: assuming signed data in
> >> './apache-celeborn-0.4.0-incubating-source.tgz'
> >> gpg: Signature made 四  1/18 21:06:45 2024 CST
> >> gpg:using RSA key
> 92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B
> >> gpg: checking the trustdb
> >> gpg: marginals needed: 3  completes needed: 1  trust model: pgp
> >> gpg: depth: 0  valid:  12  signed:   0  trust: 0-, 0q, 0n, 0m, 0f, 12u
> >> gpg: next trustdb check due at 2024-05-25
> >> gpg: Good signature from "Fu Chen (For Kyuubi release)
> >> " [ultimate]
> >>
> >> [x] LICENSE/NOTICE files exist
> >> [x] NO unexpected binary files
> >> [x] Source files have ASF headers
> >> [x] Can compile from source
> >>
> >> Build successed on Apple Silicon M1(arm64).
> >>
> >>
> >> I noticed the release manager's key name  'Fu Chen (for Kyuubi
> >> release)', maybe a different name would be better? lol
> >>
> >> Sincerely,
> >> Suyan
> >>
> >> Fu Chen  于2024年1月22日周一 00:25写道：
> >>>
> >>> Hi IPMC,
> >>>
> >>> This is a call for a vote to release Apache Celeborn (Incubating)
> >>> 0.4.0-incubating-rc4
> >>>
> >>> The Apache Celeborn community has voted on and approved a proposal to
> >>> release Apache Celeborn (Incubating) version 0.4.0-incubating-rc4.
> >>> We now kindly request the Incubator PMC members review and vote on this
> >>> incubator release.
> >>>
> >>> celeborn@dev vote thread:
> >>>
> >>> https://lists.apache.org/thread/w91n2vgwts06gskoc5y19gl49myjm1jq
> >>>
> >>> celeborn@dev vote result thread:
> >>>
> >>> https://lists.apache.org/thread/7ylzdq6htzvlnnjzb5lhdd1nsfv4cjmn
> >>>
> >>> The git tag to be voted upon:
> >>>
> >>>
> >>
> https://github.com/apache/incubator-celeborn/releases/tag/v0.4.0-incubating-rc4
> >>>
> >>> The git commit hash:
> >>> 8bc07466dd85a90216820617015e329fb806c7dd
> >>>
> >>> The source and binary artifacts can be found at:
> >>>
> >>>
> >>
> https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.4.0-incubating-rc4
> >>>
> >>> The staging repo:
> >>>
> >>>
> >>
> https://repository.apache.org/content/repositories/orgapacheceleborn-1051
> >>>
> >>> Fingerprint of the PGP key release artifacts are signed with:
> >>> 92AF4750DAFCB5E25B5B83EA76F54B977EB5C09B
> >>>
> >>> My public key to verify signatures can be found in:
> >>>
> >>> https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS
> >>>
> >>> The vote will be open for at least 72 hours or until the necessary
> >>>
> >>> number of votes are reached.
> >>>
> >>> Please vote accordingly:
> >>>
> >>> [ ] +1 approve
> >>> [ ] +0 no opinion
> >>> [ ] -1 disapprove (and the reason)
> >>>
> >>> Checklist for release:
> >>>
> >>>
> >>
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> >>>
> >>> Steps to validate the release:
> >>>
> >>> https://www.apache.org/info/verification.html
> >>>
> >>> Please be aware that there has been a transition in the Celeborn
> >> project's
> >>> build tool, shifting from Maven to SBT. The SBT build documentation is
> >>> available at https://celeborn.apache.org/docs/latest/developers/sbt/.
> >>>
> >>> For illustrative purposes:
> >>>
> >>> Packaging the project
> >>> ```
> >>> ./build/sbt clean package
> >>> ```
> >>>
> >>> Creating the distribution
> >>> ```
> >>> ./build/make-distribution.sh --sbt-enabled --release
> >>> ```
> >>>
> >>> Regards,
> >>> Fu Chen

Re: [ANNOUNCE] Add Yihe Li as new committer

[Yu Li]

Congratulations, Yihe!

Best Regards,
Yu


On Fri, 17 Nov 2023 at 15:32, Shaoyun Chen  wrote:

> Congrats!
>
> Keyong Zhou  于2023年11月16日周四 20:25写道：
> >
> > Hi Celeborn Community,
> >
> > The Podling Project Management Committee (PPMC) for Apache Celeborn
> > has invited Yihe Li to become a committer and we are pleased
> > to announce that he has accepted.
> >
> > Being a committer enables easier contribution to the
> > project since there is no need to go via the patch
> > submission process. This should enable better productivity.
> > A (P)PMC member helps manage and guide the direction of the project.
> >
> > Please join me in congratulating Yihe Li!
> >
> > Thanks,
> > Keyong Zhou
>

Re: [VOTE] Release Apache Celeborn(Incubating) 0.3.0-incubating-rc2

[Yu Li]

+1 (binding)

- Checked the diff between 0.2.1 and 0.3.0-rc2: *OK* (
https://github.com/apache/incubator-celeborn/compare/v0.2.1-incubating...v0.3.0-incubating-rc2
)
   - Mainly checked changes on pom.xml and the newly added client-flink
modules, and confirmed no new dependency introduced
- Checked release file name and location: *OK*
- Checked sum and signatures: *OK*
- Checked DISCLAIMER file exists: *OK*
- Checked LICENSE and NOTICE files: *OK*
- Checked no binary files in source package: *OK*

Minor: when checking the diff commits, I found some issues resolved in
0.3.0 but not marked with the correct fix version on JIRA, for example
CELEBORN-105 (noticed since it introduced new test-scope dependency).
Please double check and make sure that all JIRA issues resolved in 0.3.0
have the correct fix version.

Best Regards,
Yu


On Wed, 26 Jul 2023 at 17:46, Kent Yao  wrote:

> +1 (nonbinding), I have checked:
>
> [✓] The checksums and signatures are validated
> [✓] The LICENSE and NOTICE are fine
> [✓] DISCLAIMER is present
> [✓] No binary files in the source release
> [✓] incubating in the name
> [✓] Built from source
>
> Kent Yao
>
> 张铎(Duo Zhang)  于2023年7月26日周三 16:12写道：
> >
> > +1 binding
> >
> > Checked sigs and sums: Matched
> > LICENSE and NOTICE: OK
> > DISCLAIMER: In place
> > Built from src: 'mvn clean install -DskipTests' passed.
> > Run UTs: 'mvn test' passed.
> >
> > Thanks.
> >
> > angers zhu  于2023年7月25日周二 11:57写道：
> > >
> > > +1 (non-binding)
> > >
> > > checked
> > >
> > > -- build with all flink profile
> > > -- build doc and check all content and link
> > > -- PGP keys are good
> > > -- LICENSE is ok
> > >
> > >
> > > Keyong Zhou  于2023年7月24日周一 23:47写道：
> > >
> > > > +1 (non-binding)
> > > >
> > > > I checked
> > > >
> > > > - git commit hash is correct.
> > > > - links are valid.
> > > > - "incubating" is in the name.
> > > > - PGP keys are good.
> > > > - hashes are correct.
> > > > - LICENSE looks good.
> > > > - NOTICE looks good.
> > > > - DISCLAIMER exists.
> > > > - build success from source code (macOS):
> ./build/make-distribution.sh
> > > > --release
> > > >
> > > > Thanks,
> > > > Keyong Zhou
> > > >
> > > > Cheng Pan  于2023年7月24日周一 11:51写道：
> > > >
> > > > > +1 (non-binding)
> > > > >
> > > > > I checked
> > > > >
> > > > > - signature and checksum of source artifacts are good
> > > > > - DISCLAIMER exists
> > > > > - artifacts' name contains "incubating"
> > > > > - no unexpected binary files inside source artifacts
> > > > > - building succeeded from source on Ubuntu 20.04 with OpenJDK 8
> > > > >   command: build/mvn clean package -DskipTests -Pspark-3.3
> > > > >
> > > > > Additionally, I tested it with 1T TeraSort[1], and everything
> looks fine.
> > > > >
> > > > > spark-submit \
> > > > > --class io.github.pan3793.spark.terasort.TeraGen \
> > > > > --packages io.github.pan3793:spark-terasort_2.12:2.0.0 \
> > > > > spark-internal \
> > > > > 1t hdfs:///tmp/terasort_1t_in
> > > > >
> > > > > spark-submit \
> > > > > --class io.github.pan3793.spark.terasort.TeraSort \
> > > > > --packages io.github.pan3793:spark-terasort_2.12:2.0.0 \
> > > > > spark-internal \
> > > > > hdfs:///tmp/terasort_1t_in hdfs:///tmp/terasort_1t_out
> > > > >
> > > > > spark-submit \
> > > > > --class io.github.pan3793.spark.terasort.TeraValidate \
> > > > > --packages io.github.pan3793:spark-terasort_2.12:2.0.0 \
> > > > > spark-internal \
> > > > > hdfs:///tmp/terasort_1t_out
> > > > >
> > > > > [1] https://github.com/pan3793/spark-terasort
> > > > >
> > > > > Thanks,
> > > > > Cheng Pan
> > > > >
> > > > >
> > > > > > On Jul 24, 2023, at 10:45, Zhongqiang Chen <
> zhongqiangc...@apache.org>
> > > > > wrote:
> > > > > >
> > > > > > I sincerely apologize for the inconvenience caused by the email
> issue
> > > > > that resulted in the sending of three email duplicates. Please
> disregard
> > > > > the previous email duplicates and consider the latest one as the
> valid
> > > > > email. I would like to emphasize that the vote email is still
> valid.
> > > > Thank
> > > > > you for your understanding and patience.
> > > > > >
> > > > > >
> > > > > > On 2023/07/22 10:00:50 Xuanwo wrote:
> > > > > >> Hi, It seems that I got three copies of the same VOTE. Does
> everything
> > > > > work as expected?
> > > > > >>
> > > > > >> On Sat, Jul 22, 2023, at 15:32, zhongqiang chen wrote:
> > > > > >>> Hello Incubator Community,
> > > > > >>>
> > > > > >>> This is a call for a vote to release Apache
> Celeborn(Incubating)
> > > > > version
> > > > > >>> 0.3.0-incubating-rc2
> > > > > >>>
> > > > > >>> The Apache Celeborn community has voted on and approved a
> proposal to
> > > > > release
> > > > > >>> Apache Celeborn(Incubating) version 0.3.0-incubating-rc2
> > > > > >>>
> > > > > >>> We now kindly request the Incubator PMC members review and
> vote on
> > > > this
> > > > > >>> incubator release.
> > > > > >>>
> > > > > >>> Celeborn community vote thread:
> > > > > >>> •
> https://lists.apache.org/thread/6x7cqy

Re: [NOTICE] Fix solution about rare data loss in release 0.2.0.

[Yu Li]

Thanks for the update and good to know, Keyong.

Best Regards,
Yu


On Thu, 9 Mar 2023 at 14:47, keyong zhou  wrote:

> Hi Yu,
>
> We do have a plan for a quick fix, before that we'd like to do more tests
> and
> collect more feedbacks for about a week.
>
> Thanks,
> Keyong Zhou
>
> Yu Li  于2023年3月9日周四 13:48写道：
>
> > Thanks for the note Ethan.
> >
> > I'm not sure but maybe it is worth a quick bug fix release, i.e. 0.2.1?
> Any
> > plan for that?
> >
> > Best Regards,
> > Yu
> >
> >
> > On Wed, 8 Mar 2023 at 11:55, Ethan Feng 
> > wrote:
> >
> > > Hello users,
> > > Regretfully to inform you that we found a bug[2] in release 0.2.0
> > > yesterday. The bug[2] caused data loss rarely when reading from skew
> > > partitions on a high-pressure cluster.
> > > You need to apply this patch[1] to your Celeborn client jar. We'll
> > > ship this patch in our next release.
> > > Feel free to contact us if you encounter any other questions.
> > >
> > > Regards,
> > > Ethan Feng
> > >
> > > ---
> > > 1. https://github.com/apache/incubator-celeborn/pull/1315
> > > 2. https://issues.apache.org/jira/browse/CELEBORN-383
> > >
> >
>

Re: [NOTICE] Fix solution about rare data loss in release 0.2.0.

[Yu Li]

Thanks for the note Ethan.

I'm not sure but maybe it is worth a quick bug fix release, i.e. 0.2.1? Any
plan for that?

Best Regards,
Yu


On Wed, 8 Mar 2023 at 11:55, Ethan Feng 
wrote:

> Hello users,
> Regretfully to inform you that we found a bug[2] in release 0.2.0
> yesterday. The bug[2] caused data loss rarely when reading from skew
> partitions on a high-pressure cluster.
> You need to apply this patch[1] to your Celeborn client jar. We'll
> ship this patch in our next release.
> Feel free to contact us if you encounter any other questions.
>
> Regards,
> Ethan Feng
>
> ---
> 1. https://github.com/apache/incubator-celeborn/pull/1315
> 2. https://issues.apache.org/jira/browse/CELEBORN-383
>

Re: [ANNOUNCE] Apache Celeborn(incubating) 0.2.0 available

[Yu Li]

Congratulations! This is our first apache release and a memorable moment.
Thanks all for the efforts.

Best Regards,
Yu


On Thu, 2 Mar 2023 at 10:52, Cheng Pan  wrote:

> Congrats, and thank Ethan and everyone who helps with the first release
> after Celeborn entered the Apache Incubator, one minor thing is we should
> create a new tag[2] on the same commit of the passed vote RC version[1]
> instead of just using it.
>
> [1]
>
> https://github.com/apache/incubator-celeborn/releases/tag/v0.2.0-incubating-rc5
> [2]
> https://github.com/apache/incubator-celeborn/releases/tag/v0.2.0-incubating
>
> Thanks,
> Cheng Pan
>
>
> On Mar 1, 2023 at 23:38:45, Ethan Feng  wrote:
>
> > Hi all,
> >
> > Apache Celeborn(Incubating) community is glad to announce the
> > new release of Apache Celeborn(Incubating) 0.2.0
> >
> > Celeborn is dedicated to improving the efficiency and elasticity of
> > different map-reduce engines and provides an elastic, high-efficient
> > service for intermediate data including shuffle data, spilled data,
> > result data, etc.
> > Currently Celeborn supports Spark full-featured and improves Spark
> > job's performance, stability and elasticity.
> >
> > Download Link: https://celeborn.apache.org/download/
> >
> > GitHub Release Tag:
> > -
> >
> https://github.com/apache/incubator-celeborn/releases/tag/v0.2.0-incubating-rc5
> >
> > Release Notes:
> > - https://celeborn.apache.org/community/release_notes/release_note_0.2.0
> >
> > Website: https://celeborn.apache.org/
> >
> > Celeborn Resources:
> > - Issue: https://issues.apache.org/jira/projects/CELEBORN
> > - Mailing list: dev@celeborn.apache.org
> >
> > Ethan Feng
> > On behalf of the Apache Celeborn(incubating) community
> >
>

Re: [Question] LimitedInputStream license issue in Spark source.

[Yu Li]

Thanks for the update Keyong. Good to know (smile)

On Fri, Mar 3, 2023 at 6:23 PM Keyong Zhou  wrote:

> Hi Yu,
>
> Thanks for the reminder, we have already fixed it :)
>
>
> https://github.com/apache/incubator-celeborn/commit/9aabb43699225d47c1470027b98a42210df914e8
>
> https://github.com/apache/incubator-celeborn/commit/dcf1e018f6352a64250c64d64e21e3eae1f8fa14
>
> Thanks,
> Keyong Zhou
>
> Yu Li  于2023年3月3日周五 18:03写道：
>
> > Hi all,
> >
> > Since Spark has already taken action to fix the issue, do we have a PR to
> > fix ours? Thanks.
> >
> > Some background for easier reference:
> > https://lists.apache.org/thread/6mcwfb2gmxpj1r281pd13gs35wjqfxom
> >
> > Best Regards,
> > Yu
> >
> >
> > -- Forwarded message -
> > From: Dongjoon Hyun 
> > Date: Thu, 2 Mar 2023 at 16:14
> > Subject: Re: [Question] LimitedInputStream license issue in Spark source.
> > To: 
> > Cc: incubator general apache , Cheng Pan <
> > cheng...@apache.org>, Ethan Feng , Willem Jiang <
> > ningji...@apache.org>, 
> >
> >
> > Thank you. Here is the PR to fix that.
> >
> > https://github.com/apache/spark/pull/40249
> > [SPARK-42649][CORE] Remove the standard Apache License header from the
> top
> > of third-party source files
> >
> > Dongjoon.
> >
> >
> > On Wed, Mar 1, 2023 at 11:53 PM  wrote:
> >
> > > Hi,
> > >
> > > See https://www.apache.org/legal/src-headers.html#3party - "Do not add
> > > the standard Apache License header to the top of third-party source
> > files.”
> > > and "Minor modifications/additions to third-party source files should
> > > typically be licensed under the same terms as the rest of the
> third-party
> > > source for convenience.”
> > >
> > > Kind Regards,
> > > Justin
> >
>
-- 
Best Regards,
Yu

Fwd: [Question] LimitedInputStream license issue in Spark source.

[Yu Li]

Hi all,

Since Spark has already taken action to fix the issue, do we have a PR to
fix ours? Thanks.

Some background for easier reference:
https://lists.apache.org/thread/6mcwfb2gmxpj1r281pd13gs35wjqfxom

Best Regards,
Yu


-- Forwarded message -
From: Dongjoon Hyun 
Date: Thu, 2 Mar 2023 at 16:14
Subject: Re: [Question] LimitedInputStream license issue in Spark source.
To: 
Cc: incubator general apache , Cheng Pan <
cheng...@apache.org>, Ethan Feng , Willem Jiang <
ningji...@apache.org>, 


Thank you. Here is the PR to fix that.

https://github.com/apache/spark/pull/40249
[SPARK-42649][CORE] Remove the standard Apache License header from the top
of third-party source files

Dongjoon.


On Wed, Mar 1, 2023 at 11:53 PM  wrote:

> Hi,
>
> See https://www.apache.org/legal/src-headers.html#3party - "Do not add
> the standard Apache License header to the top of third-party source
files.”
> and "Minor modifications/additions to third-party source files should
> typically be licensed under the same terms as the rest of the third-party
> source for convenience.”
>
> Kind Regards,
> Justin

Re: [VOTE] Release Apache Celeborn(Incubating) 0.2.0-incubating-rc4

[Yu Li]

Hi Angers and Kerwin,

Could you supplement some more details (items checked against this RC
according to the checklist [1]) for your voting? Thanks.

Best Regards,
Yu

[1]
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist

On Mon, 6 Feb 2023 at 17:34, kerwin zhang  wrote:

> +1 (binding)
>
> angers zhu  于2023年2月6日周一 17:33写道：
>
> > +1 (binding)
> >
> > Keyong Zhou  于2023年2月6日周一 17:31写道：
> >
> > > +1 (binding)
> > >
> > > I checked
> > >
> > > - git commit hash is correct.
> > > - links are valid.
> > > - "incubating" is in the name.
> > > - PGP keys are good.
> > > - hashes are correct.
> > > - LICENSE looks good.
> > > - NOTICE looks good.
> > > - DISCLAIMER exists.
> > > - build success from source code (macOS).
> > >
> > > ```
> > > ./build/make-distribution.sh --release
> > > ```
> > >
> > > Thanks,
> > > Keyong Zhou
> > >
> > > Ethan Feng  于2023年2月4日周六 21:29写道：
> > >
> > > > Hi Celeborn community,
> > > >
> > > > This is a call for a vote to release Apache Celeborn (Incubating)
> > > > 0.2.0-incubating-rc4
> > > >
> > > > The git tag to be voted upon:
> > > >
> > > >
> > >
> >
> https://github.com/apache/incubator-celeborn/releases/tag/v0.2.0-incubating-rc4
> > > >
> > > > The git commit hash:
> > > > 282e0b0bbc76fa9339e931b0b252b6cbb16dddf5
> > > >
> > > > The source and binary artifacts can be found at:
> > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/incubator/celeborn/v0.2.0-incubating-rc4/
> > > >
> > > > Fingerprint of the PGP key release artifacts are signed with:
> > > > FCF20BB29C7BEFDF58F998F76392F71F37356FA0
> > > >
> > > > My public key to verify signatures can be found in:
> > > > https://dist.apache.org/repos/dist/release/incubator/celeborn/KEYS
> > > >
> > > > The vote will be open for at least 72 hours or until necessary
> > > > number of votes are reached.
> > > >
> > > > Please vote accordingly:
> > > >
> > > > [ ] +1 approve
> > > > [ ] +0 no opinion
> > > > [ ] -1 disapprove (and the reason)
> > > >
> > > > Checklist for release:
> > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> > > > Steps to validate the release:
> > > > https://www.apache.org/info/verification.html
> > > >
> > > > Starting with my +1 (binding):
> > > >
> > > > * Download links, checksums and PGP signatures are valid.
> > > > * Source code distributions have correct names matching the current
> > > > release.
> > > > * Release files have the word incubating in their name.
> > > > * DISCLAIMER, LICENSE and NOTICE files are correct.
> > > > * All files have license headers if necessary.
> > > > * No unlicensed compiled archives bundled in source archive.
> > > > * The source tarball matches the git tag.
> > > > * Build from source is successful.
> > > >
> > > > Thanks,
> > > > Ethan Feng
> > > >
> > >
> >
>

Re: [ANNOUNCE] Add nafiyaix(Xia Yifan) as new committer

[Yu Li]

Congratulations and welcome, Yifan!

Best Regards,
Yu

On Wed, Nov 30, 2022 at 11:25 PM Keyong Zhou  wrote:

> Hi celeborn(-incubating) community,
>
> I'm very excited to announce that recently we added nafiyaix(Xia Yifan) as
> our new Committer!
>
> nafiyaix has kept contributing to celeborn for more than six months,
> including new features, bugfixes, refactors, and documentation.
>
> Looking forward that nafiyaix will continue contributing to the project,
> pushing celeborn to the next level together with all contributors of the
> community!
>
> Also, we are looking forward to add more and more committers to our project
> :)
>
> Thanks!
> Keyong Zhou
>
-- 
Best Regards,
Yu