[jira] [Created] (YUNIKORN-1003) YIP: define and publish end-to-end process of a YIP

2022-01-07 Thread Bowen Li (Jira)
Bowen Li created YUNIKORN-1003: -- Summary: YIP: define and publish end-to-end process of a YIP Key: YUNIKORN-1003 URL: https://issues.apache.org/jira/browse/YUNIKORN-1003 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-1001) YIP: define and publish section of "what should be included in a YIP"

2022-01-07 Thread Bowen Li (Jira)
Bowen Li created YUNIKORN-1001: -- Summary: YIP: define and publish section of "what should be included in a YIP" Key: YUNIKORN-1001 URL: https://issues.apache.org/jira/browse/YUNIKORN-1001

[jira] [Created] (YUNIKORN-1002) YIP: define and publish section of "who should initiate or be involved in a YIP"

2022-01-07 Thread Bowen Li (Jira)
Bowen Li created YUNIKORN-1002: -- Summary: YIP: define and publish section of "who should initiate or be involved in a YIP" Key: YUNIKORN-1002 URL: https://issues.apache.org/jira/browse/YUN

[jira] [Created] (YUNIKORN-1000) YIP: define and publish section of "definition of 'major change' that needs a YIP"

2022-01-07 Thread Bowen Li (Jira)
Bowen Li created YUNIKORN-1000: -- Summary: YIP: define and publish section of "definition of 'major change' that needs a YIP" Key: YUNIKORN-1000 URL: https://issues.apache.org/jira/browse/YUN

[jira] [Created] (YUNIKORN-999) [UMBRELLA] Define and publish YuniKorn Improvement Proposal (YIP)

2022-01-07 Thread Bowen Li (Jira)
Bowen Li created YUNIKORN-999: - Summary: [UMBRELLA] Define and publish YuniKorn Improvement Proposal (YIP) Key: YUNIKORN-999 URL: https://issues.apache.org/jira/browse/YUNIKORN-999 Project: Apache

Re: Observability of actually cpu/memory usage

2022-01-05 Thread Bowen Li
igured. > > > > > > > > > > > > The only time the scheduler would have any idea about a "maximum" > > is > > > > > when a > > > > > > gang request is made. For gang scheduling we can track if the > gang > > &

Form a process of YuniKorn Improvement Proposal (YIP)

2022-01-05 Thread Bowen Li
Hi all, I'd like to start conversation of building a formal process of YuniKorn Improvement Proposal (YIP). (X)IP is a common approach to propose, discuss, collaborate on and tackle major or important changes in open source projects and communities. Within Apache projects, there're successful

Re: Apache YuniKorn (Incubating) 0.12.1 Released

2021-12-27 Thread Bowen Li
Congratulations! Thanks Chaoran for driving the effort On Mon, Dec 27, 2021 at 9:17 AM Craig Condit wrote: > Great news! > > Thanks Chaoran for all your work on this release. > > > Craig > > > > On Dec 27, 2021, at 12:09 AM, Chaoran Yu > wrote: > > > > Hi all, > > > > The IPMC has voted in

Observability of actually cpu/memory usage

2021-12-20 Thread Bowen Li
Hi community, Reviving https://issues.apache.org/jira/browse/YUNIKORN-829 . We are running Spark on YuniKorn, and have a requirement to provide more observability of *actual* resource usage for our customers, data engineers/scientists who wrote Spark jobs who may not have deep expertise in Spark

Advantages of running Flink on YuniKorn?

2021-10-18 Thread Bowen Li
Hi folks, Wondering what're the advantages of running Flink (especially Flink streaming apps) on YuniKorn v.s. default or other scheduler of K8S? Asking since 1) I didn't find much about it on https://yunikorn.apache.org/docs/user_guide/workloads/run_flink 2) we quite well understand the

Re: [ANNOUNCE] New committer: Chaoran Yu

2021-10-13 Thread Bowen Li
Congrats Chaoran! On Wed, Oct 13, 2021 at 6:08 PM Chenya Zhang wrote: > Congrats Chaoran! Well deserved. > > On Wed, Oct 13, 2021 at 6:05 PM Wilfred Spiegelenburg > > wrote: > > > The Project Management Committee (PMC) for Apache YuniKorn has invited > > Chaoran to > > become a committer and

Re: [ANNOUNCE] New committer: Chenya Zhang

2021-10-02 Thread Bowen Li
Congratulations Chenya! Well deserved On Wed, Sep 29, 2021 at 7:48 AM Chenya Zhang wrote: > Appreciate the trust and support from our YuniKorn community. Look forward > to more collaboration and exciting work with everyone! > > Best, > Chenya > > On Sat, Sep 25, 2021 at 4:43 AM Sunil Govindan

Re: Next YuniKorn release discussion - the next step

2021-04-21 Thread Bowen Li
Hi Weiwei, Thanks for bringing up this discussion. That may depend on what "1.0" means, and what bumping a major version means. Usually a new major version (e.g. 0.x -> 1.x -> 2.x) contains some critical new features or breaking changes. One critical feature of the next release is integration

Re: [ANNOUNCE] Release v0.10.0 available for download

2021-04-13 Thread Bowen Li
Congratulations! On Mon, Apr 12, 2021 at 10:38 PM Wilfred Spiegelenburg wrote: > Thanks to Tao as the release manager we have now updated the website and > the new release v0.10.0 is available for download. The release > announcement is located here: >

[jira] [Created] (YUNIKORN-614) support co-deployment of YuniKorn with other schedulers, or multiple YuniKorn, in a single cluster

2021-03-27 Thread Bowen Li (Jira)
Bowen Li created YUNIKORN-614: - Summary: support co-deployment of YuniKorn with other schedulers, or multiple YuniKorn, in a single cluster Key: YUNIKORN-614 URL: https://issues.apache.org/jira/browse/YUNIKORN-614

Re: Apache YuniKorn 0.10.0 Release Plan

2021-03-24 Thread Bowen Li
Thanks Tao. Hope we can release it faster/on-time since it's been delayed from the beginning of March. Look forward to the 0.10 release with gang scheduling in place. Thanks, Bowen On Wed, Mar 24, 2021 at 6:50 PM Tao Yang wrote: > Hi all, > > Currently the jiras tracked for 0.10 [1] are

[jira] [Created] (YUNIKORN-558) Integrate YuniKorn with Spark K8S Operator

2021-03-09 Thread Bowen Li (Jira)
Bowen Li created YUNIKORN-558: - Summary: Integrate YuniKorn with Spark K8S Operator Key: YUNIKORN-558 URL: https://issues.apache.org/jira/browse/YUNIKORN-558 Project: Apache YuniKorn Issue Type