Re: [PROPOSAL] Spark stage resubmission for shuffle fetch failure

2023-10-13 Thread Mridul Muralidharan
Hi, So there are a couple of things here based on whether the stages are DETERMINATE or INDETERMINATE. The exit I added to my example was to trigger some of these cases, and you can come up with more involved scenarios where this would apply :-) At a high level, we have the following: a) If on

Re: [PR] Release 0.3.1-incubating [incubator-celeborn-website]

2023-10-13 Thread via GitHub
pan3793 merged PR #23: URL: https://github.com/apache/incubator-celeborn-website/pull/23 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...

Re: [PR] Release 0.3.1-incubating [incubator-celeborn-website]

2023-10-13 Thread via GitHub
pan3793 commented on PR #23: URL: https://github.com/apache/incubator-celeborn-website/pull/23#issuecomment-1761612486 Let me merge it first to make the 0.3.1 available on the website, reviewers could leave comments and I will address them in the follow-up PRs -- This is an automated mes

[PR] Release 0.3.1-incubating [incubator-celeborn-website]

2023-10-13 Thread via GitHub
pan3793 opened a new pull request, #23: URL: https://github.com/apache/incubator-celeborn-website/pull/23 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[ANNOUNCE] Apache Celeborn(incubating) 0.3.1 available

2023-10-13 Thread Cheng Pan
Hi all, Apache Celeborn(Incubating) community is glad to announce the new release of Apache Celeborn(Incubating) 0.3.1. Celeborn is dedicated to improving the efficiency and elasticity of different map-reduce engines and provides an elastic, high-efficient service for intermediate data including

Re: [RESULT][VOTE] Release Apache Celeborn(Incubating) 0.3.1-incubating-rc3

2023-10-13 Thread Cheng Pan
Sorry, with additional non-binding +1 from Kent Yao Thanks, Cheng Pan > On Oct 13, 2023, at 20:17, Cheng Pan wrote: > > Hi IMPC, > > The vote to release Apache Celeborn(Incubating) 0.3.1-incubating-rc3 > PASSES with +3 (binding), +1 (non-binding), and no +0 or -1. > > +1 (binding): > Willem

[RESULT][VOTE] Release Apache Celeborn(Incubating) 0.3.1-incubating-rc3

2023-10-13 Thread Cheng Pan
Hi IMPC, The vote to release Apache Celeborn(Incubating) 0.3.1-incubating-rc3 PASSES with +3 (binding), +1 (non-binding), and no +0 or -1. +1 (binding): Willem Jiang Duo Zhang Gang Li +1 (non-binding): Cheng Pan The vote thread: https://lists.apache.org/thread/g9ctor045zv0v9o0y2vocdj44k75rfst