[VOTE] Release Apache Celeborn 0.5.2-rc0

2024-10-08 Thread Nicholas Jiang
source archive. * The source tarball matches the git tag. * Build from source is successful. Regards, Nicholas Jiang

[VOTE] Release Apache Celeborn 0.5.2-rc0

2024-10-08 Thread Nicholas Jiang
source archive. * The source tarball matches the git tag. * Build from source is successful. Regards, Nicholas Jiang

[DISCUSS] Time for 0.5.2

2024-09-23 Thread Nicholas Jiang
/b9382a045b0e1c0d04d470d53237b8dee680e2be [2] https://github.com/apache/celeborn/commit/1578f6701105fcc61977b13a4c8d866c093f045f Regards, Nicholas Jiang

Re:Re: [VOTE] CIP-11: Supporting Tags in Celeborn

2024-09-08 Thread Nicholas Jiang
+1(binding) Regards, Nicholas Jiang 在 2024-09-09 11:16:24,"rexxiong" 写道: >+1(binding) > >Thanks, >Jiashu Xiong > >Ethan Feng 于2024年9月9日周一 11:14写道: > >> +1(binding) >> >> Thanks, >> Ethan Feng >> >> Sanskar Modi 于2024年9月6日周五 1

[RESULT][VOTE] CIP-10: Introduce Celeborn Chaos Testing Framework

2024-08-22 Thread Nicholas Jiang
everyone who participated in the discussion and voting. [1] https://cwiki.apache.org/confluence/display/CELEBORN/CIP-10+Introduce+Celeborn+Chaos+Testing+Framework [2] https://lists.apache.org/thread/2lqq021vyc98w3yly678s8lpv0o8vpz5 Regards, Nicholas Jiang

Re: [VOTE] CIP-10: Introduce Celeborn Chaos Testing Framework

2024-08-22 Thread Nicholas Jiang
Hi all, Thanks for all your votes, I hereby close the vote and I'll announce the results in a separate email. Regards, Nicholas Jiang On 2024/08/02 14:37:19 Nicholas Jiang wrote: > Hi all, > > Thanks for all the feedback about the CIP-10: Introduce Celeborn Chaos > Testing

Re: [DRAFT] Celeborn Board Report

2024-08-13 Thread Nicholas Jiang
Thanks Keyong! LGTM. Regards, Nicholas Jiang On 2024/08/12 02:58:10 Keyong Zhou wrote: > Hi community, > > The board report is due on August 14th, following is the draft I made, any > comments > will be appreciated, thanks! > > ## Description: > The mission of Apache

[VOTE] CIP-10: Introduce Celeborn Chaos Testing Framework

2024-08-02 Thread Nicholas Jiang
ingly: [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove (and the reason) [1] https://cwiki.apache.org/confluence/display/CELEBORN/CIP-10+Introduce+Celeborn+Chaos+Testing+Framework [2] https://lists.apache.org/thread/670qw80wwfflgv3djqg4304xqy9y8l19 Regards, Nicholas Jiang

Re: [DISCUSS] CIP-10: Introduce Celeborn Chaos Testing Framework

2024-08-02 Thread Nicholas Jiang
Hi all, Thank you for your feedback. I will start a VOTE thread for CIP-10. Regards, Nicholas Jiang On 2024/07/02 21:20:57 Nicholas Jiang wrote: > Hi all, > > I would like to start a discussion on CIP-10: Introduce Celeborn Chaos > Testing Framework[1]. > > A chaos te

Re: [VOTE] Release Apache Celeborn 0.5.1-rc0

2024-07-25 Thread Nicholas Jiang
-snapshot in internal test environment a week ago. 0.5.1 works well in test environment. Regards, Nicholas Jiang On 2024/07/23 03:38:57 Ethan Feng wrote: > Hello, Celeborn community, > > This is a call for a vote to release Apache Celeborn > 0.5.1-rc0 > > The git tag to be v

Re: [VOTE] Release Apache Celeborn 0.4.2-rc1

2024-07-25 Thread Nicholas Jiang
0.4.2 with chaos testing framework. The test result is that everything worked well. Regards, Nicholas Jiang On 2024/07/22 10:14:45 Fu Chen wrote: > Hi Celeborn community, > > This is a call for a vote to release Apache Celeborn 0.4.2-rc1 > > > The git tag to be voted upon: &g

Re:Re: [ANNOUNCE] New Celeborn Committer: Fei Wang

2024-07-22 Thread Nicholas Jiang
Congratulations!Regards, Nicholas Jiang 在 2024-07-23 12:21:19,"Yihe Li" 写道: >Congratulations! > >Regards, >Yihe Li > >On 2024/07/23 04:16:20 Keyong Zhou wrote: >> Congratulations! >> >> Regards, >> Keyong Zhou >> >

Re: [DISCUSS] CIP-10: Introduce Celeborn Chaos Testing Framework

2024-07-15 Thread Nicholas Jiang
Hi community, I would like to emphasize here that this proposal is derived from the chaos testing framework built by @Ethan Feng within Alibaba Cloud. Thanks for efforts of @Ethan Feng in providing a testing framework to verify the reliability and stability of Celeborn. Thanks, Nicholas Jiang

Re: [DISCUSS] CIP-10: Introduce Celeborn Chaos Testing Framework

2024-07-15 Thread Nicholas Jiang
Hey Keyong, Thanks for your feedback. In my opinion, validating the data quality by checking "Shuffle Records Written" and "Records Read" satisfies the correctness check. Meanwhile, the codes of chaos testing framework are separated into "verifier" module. WDYT

Re: [DISCUSS] CIP-10: Introduce Celeborn Chaos Testing Framework

2024-07-11 Thread Nicholas Jiang
simulating various abnormal events, but also reproduces problem cases to troubleshoot the root cause of Celeborn problems. I would like to take this reproduction feature into consideration for this CIP. Best Regards, Nicholas Jiang On 2024/07/10 09:35:52 Mridul Muralidharan wrote: > Hi, > &g

Re:[DISCUSS] CIP-10: Introduce Celeborn Chaos Testing Framework

2024-07-10 Thread Nicholas Jiang
to further ensure the reliability of Celeborn through chaos testing. Regards, Nicholas Jiang At 2024-07-03 05:20:57, "Nicholas Jiang" wrote: >Hi all, > >I would like to start a discussion on CIP-10: Introduce Celeborn Chaos Testing >Framework[1]. > >A chaos tes

Re: [DISCUSS] CIP-10: Introduce Celeborn Chaos Testing Framework

2024-07-07 Thread Nicholas Jiang
Hi Ethan, Thanks for your feedback. I have already added the helm chart support of chaos testing framework in "Test Plan". The deployment on K8S environment is significant for practice chaos testing framework. Regards, Nicholas Jiang On 2024/07/04 09:24:32 Ethan Feng wrote: >

[DISCUSS] CIP-10: Introduce Celeborn Chaos Testing Framework

2024-07-02 Thread Nicholas Jiang
various anomalies and test the stability of Celeborn in distributed environments via chaos testing. Looking forward to everyone's feedback and suggestions. Thank you! [1] https://cwiki.apache.org/confluence/display/CELEBORN/CIP-10+Introduce+Celeborn+Chaos+Testing+Framework Regards, Nicholas Jiang

Re: [VOTE] Release Apache Celeborn 0.5.0-rc3

2024-06-22 Thread Nicholas Jiang
clean performance of Worker for 0.5.0-rc3. It works well and there is no backlog for clean task queue. Regards, Nicholas Jiang On 2024/06/19 04:45:52 Ethan Feng wrote: > Hello, Celeborn community, > > This is a call for a vote to release Apache Celeborn > 0.5.0-rc3 > > The git ta

Re:[VOTE] CIP-6: Support Flink hybrid shuffle integration with Apache Celeborn

2024-06-13 Thread Nicholas Jiang
+1(non-binding) Regards, Nicholas Jiang At 2024-06-14 11:36:17, "Yuxin Tan" wrote: >Hi all, > >Thanks for all the feedback about the CIP-6: Support Flink >hybrid shuffle integration with Apache Celeborn[1]. >The discussion thread is here [2]. > >I'd l

Re: [VOTE] Release Apache Celeborn 0.5.0-rc2

2024-06-12 Thread Nicholas Jiang
internal version to 0.5.0 in our production environment. Regards, Nicholas Jiang On 2024/06/12 05:56:07 Ethan Feng wrote: > Hello, Celeborn community, > > This is a call for a vote to release Apache Celeborn > 0.5.0-rc2 > > The git tag to be voted upon: > https://githu

Re: [DISCUSSION] CIP-6: Support Flink hybrid shuffle integration with Apache Celeborn

2024-06-11 Thread Nicholas Jiang
, Nicholas Jiang On 2024/06/11 08:09:06 Yuxin Tan wrote: > Hi Nicholas, > > Thanks for the valuable feedbacks. > > > 1. Could you describe in detail what functions the relevant components > mentioned in Proposed Changes > > These components are only the pluggable impl

Re:Re: [VOTE] Contrinute Apache Celeborn CLI

2024-06-11 Thread Nicholas Jiang
+1. Looking forward to Celeborn CLI. Regards, Nicholas Jiang At 2024-06-12 12:26:34, "Aravind Patnam" wrote: >Hi all, > >Sorry, this is the correct link to the Celeborn CLI CIP ><https://cwiki.apache.org/confluence/display/CELEBORN/CIP+7+-+Celeborn+CLI> >

Re: [DISCUSS] Celeborn CLI Proposal

2024-06-05 Thread Nicholas Jiang
esign doc of proposal follow the template of CIP[1]? [1] https://cwiki.apache.org/confluence/display/CELEBORN/Celeborn+Improvement+Proposals Regards, Nicholas Jiang On 2024/06/05 23:33:02 Aravind Patnam wrote: > Hi all, > > I have written up a proposal about introducing a CLI for Cel

Re: [DISCUSSION] CIP-6: Support Flink hybrid shuffle integration with Apache Celeborn

2024-06-05 Thread Nicholas Jiang
accuracy and recoverability of Segment information? 5. Should Celeborn wait until FLIP-459 is released before releasing this integration? Which Flink version will release FLIP-459? Regards, Nicholas Jiang On 2024/05/28 12:51:32 Yuxin Tan wrote: > Hi all, > > I would like to start a disc

[ANNOUNCE] Apache Celeborn 0.4.1 available

2024-05-22 Thread Nicholas Jiang
Resources: - Issue Management: https://issues.apache.org/jira/projects/CELEBORN - Mailing List: dev@celeborn.apache.org Regards, Nicholas Jiang On behalf of the Apache Celeborn community

[RESULT][VOTE] Release Apache Celeborn 0.4.1-rc1

2024-05-21 Thread Nicholas Jiang
Hello Apache Celeborn PMC and Community, The vote closes now as 72hr have passed. The vote PASSES with (* = binding) +1: - Cheng Pan * - Yi Zhu * - Keyong Zhou * - Ethan Feng * - Jiashu Xiong * - Yihe Li - Mridul Muralidharan - Shaoyun Chen +0: None -1: None The vote thread: https://lists.apa

[VOTE] Release Apache Celeborn 0.4.1-rc1

2024-05-13 Thread Nicholas Jiang
source archive. * The source tarball matches the git tag. * Build from source is successful. Regards, Nicholas Jiang

[CANCEL][VOTE] Release Apache Celeborn 0.4.1-rc0

2024-05-12 Thread Nicholas Jiang
Hi Celeborn community, Cancel this vote of 0.4.1-rc0 because of the bug that celeborn.network.bind.preferIpAddressconfiguration is only effective on worker nodes, will prepare the next RC once it gets resolved. Regards, Nicholas Jiang

Re:Re: [VOTE] Release Apache Celeborn 0.4.1-rc0

2024-05-08 Thread Nicholas Jiang
Hi Keyong, If no one takes the third test, I perhaps take random killing test via chaos testing framework of celeborn in internal testing environment. Regard, Nicholas Jiang At 2024-05-07 17:09:24, "Keyong Zhou" wrote: >Hi Nicholas, > >Thanks for the work! I th

[VOTE] Release Apache Celeborn 0.4.1-rc0

2024-05-07 Thread Nicholas Jiang
source archive. * The source tarball matches the git tag. * Build from source is successful. Regards, Nicholas Jiang

Re: [ANNOUNCE] Add Mridul Muralidharan as new committer

2024-04-28 Thread Nicholas Jiang
Congratulate Mridul!!! Well deserved! Welcome. Regards, Nicholas Jiang On 2024/04/29 01:21:15 Keyong Zhou wrote: > Hi Celeborn Community, > > The Project Management Committee (PMC) for Apache Celeborn > has invited Mridul Muralidharan to become a committer and we are pleased > t

[DISCUSS] Time for 0.4.1

2024-04-12 Thread Nicholas Jiang
. From my perspective, it’s time to prepare for releasing 0.4.1. WDYT? And I’m volunteering to be the release manager if no one has applied. Regards, Nicholas Jiang

Re: Re:Re: Add k8s operator for celeborn

2024-04-01 Thread Nicholas Jiang
to build Celeborn K8S operator with you. WDYT? Regards, Nicholas Jiang On 2023/11/08 18:38:25 leo65535 wrote: > Hi Ethan Feng, Cheng Pan > > > > 1. More detail about the design, you can check this doc. > > https://github.com/xleoken/incubator-celeborn/blob/operator/o

Re:[ANNOUNCE] Apache Celeborn is graduated to Top Level Project

2024-03-26 Thread Nicholas Jiang
Congratulations! Witness the continuous development of the community.Regards, Nicholas Jiang At 2024-03-25 20:49:36, "Ethan Feng" wrote: >Hello Celeborn community, > >I am glad to share that the ASF board has approved a resolution to >graduate Celeborn into a full Top Level

Re:[DISCUSS] Graduate Celeborn as TLP

2024-02-26 Thread Nicholas Jiang
Hi Yu, +1. Celeborn has active community with much contribution of developers and many company production practice including my company bilibili. It's time to start the graduation procedure. Forward to the graduation of Apache Celeborn. Regards, Nicholas Jiang At 2024-02-27 09:

Re:[VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc6

2024-01-31 Thread Nicholas Jiang
, Nicholas Jiang At 2024-01-29 21:45:50, "Fu Chen" wrote: >Hi Celeborn community, > >This is a call for a vote to release Apache Celeborn (Incubating) >0.4.0-incubating-rc6 > > >The git tag to be voted upon: >https://github.com/apache/incubator-celeborn/

Re: [VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc5

2024-01-27 Thread Nicholas Jiang
-3.1 Regards, Nicholas Jiang On 2024/01/25 15:18:49 Fu Chen wrote: > Hi Celeborn community, > > This is a call for a vote to release Apache Celeborn (Incubating) > 0.4.0-incubating-rc5 > > > The git tag to be voted upon: > https://github.com/apache/incubator-celeborn/releas

[ANNOUNCE] Apache Celeborn(incubating) 0.3.2 available

2024-01-07 Thread Nicholas Jiang
Page: https://celeborn.apache.org/ Celeborn Resources: - Issue Management: https://issues.apache.org/jira/projects/CELEBORN - Mailing List: dev@celeborn.apache.org Regards, Nicholas Jiang On behalf of the Apache Celeborn(incubating) community

[RESULT][VOTE] Release Apache Celeborn(Incubating) 0.3.2-incubating-rc2

2024-01-01 Thread Nicholas Jiang
Hello Apache Celeborn PPMC and Community, The vote closes now as 72hr have passed. The vote PASSES with (* = binding) +1: - Keyong Zhou * - Ethan Feng * - Jiashu Xiong * - Yihe Li +0: None -1: None The vote thread: https://lists.apache.org/thread/zq5kb3ovr53xkocgh0jyx30nsrjqw9do I will now b

[VOTE] Release Apache Celeborn(Incubating) 0.3.2-incubating-rc2

2023-12-29 Thread Nicholas Jiang
the git tag. * Build from source is successful. Regards, Nicholas Jiang

[RESULT][VOTE] Release Apache Celeborn(Incubating) 0.3.2-incubating-rc1

2023-12-24 Thread Nicholas Jiang
Hello Apache Celeborn PPMC and Community, The vote closes now as 72hr have passed. The vote PASSES with (* = binding) +1: - Keyong Zhou * - Jiashu Xiong * - Cheng Pan * - Ethan Feng * - Fu Chen - Shaoyun Chen - Yihe Li +0: None -1: None The vote thread: https://lists.apach

Re: [VOTE] Release Apache Celeborn(Incubating) 0.4.0-incubating-rc0

2023-12-21 Thread Nicholas Jiang
via command: ./build/make-distribution.sh --release Regards, Nicholas Jiang On 2023/12/21 13:41:36 Fu Chen wrote: > Hi Celeborn community, > > This is a call for a vote to release Apache Celeborn (Incubating) > 0.4.0-incubating-rc0 > > > The git tag to be voted upon:

[VOTE] Release Apache Celeborn(Incubating) 0.3.2-incubating-rc1

2023-12-20 Thread Nicholas Jiang
git tag. * Build from source is successful. Regards, Nicholas Jiang

[CANCEL][VOTE] Release Apache Celeborn(Incubating) 0.3.2-incubating-rc0

2023-12-20 Thread Nicholas Jiang
Hi Celeborn community, Cancel this vote of 0.3.2-incubating-rc0 because of the correctness issue of log level for CommitHandler, will prepare the next RC once it gets resolved. Regards, Nicholas Jiang

[VOTE] Release Apache Celeborn(Incubating) 0.3.2-incubating-rc0

2023-12-18 Thread Nicholas Jiang
the git tag. * Build from source is successful. Regards, Nicholas Jiang