Re: YuniKorn community meetup: Santa Clara, CA

2022-10-03 Thread Chenya Zhang
Big +1! I'll also be in the Bay area the week of Oct 17th. I can also help Wilfred to organize this meetup. Let me check if there are topics of interest from our side and share them here. This is very exciting! Best, Chenya On Fri, Sep 30, 2022 at 4:38 PM Weiwei Yang wrote: > That sounds

Re: [ANNOUNCE] Apache YuniKorn v1.0.0 release

2022-05-05 Thread Chenya Zhang
Big Congrats!!! :D On Thu, May 5, 2022 at 3:20 PM Sunil Govindan wrote: > Kudos! > > This is a great milestone for the YuniKorn community. Thank you. > > Sunil > > On Wed, May 4, 2022 at 4:58 PM Chaoran Yu wrote: > > > Congrats! Amazing milestone! > > > > > > On Wed, May 4, 2022 at 1:45 PM

[jira] [Created] (YUNIKORN-1071) Update website for YuniKorn Meetup in Feb 2022

2022-02-07 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-1071: -- Summary: Update website for YuniKorn Meetup in Feb 2022 Key: YUNIKORN-1071 URL: https://issues.apache.org/jira/browse/YUNIKORN-1071 Project: Apache YuniKorn

Re: [VOTE] Release Apache YuniKorn (incubating) 0.12.2 RC4

2022-01-30 Thread Chenya Zhang
+1 (binding) Thanks Craig for the efforts! - Build from source - Run unit tests - Run sample workloads - Checked logs and K8s messages - Verified the Web UI - Verified REST endpoints - Checked no unexpected files Best, Chenya On Fri, Jan 28, 2022 at 4:34 AM Wilfred Spiegelenburg wrote: > +1

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-25 Thread Chenya Zhang
+1 to graduate YuniKorn from the ASF incubator and become a top-level Apache project! Best, Chenya On Tue, Jan 25, 2022 at 9:09 PM Weiwei Yang wrote: > Hi YuniKorn community and mentors > > Based on the discussion thread [1], after 2 years time of incubating, it is > considered that now is a

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-25 Thread Chenya Zhang
. Best, Chenya On Tue, Jan 25, 2022 at 10:03 AM Sunil Govindan wrote: > Yes. I reached out to a couple of them and added them to the list. > We still have a gap. Will try again. > > Thanks > Sunil > > On Mon, Jan 24, 2022 at 10:45 PM Chenya Zhang > > wrote: > >

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-24 Thread Chenya Zhang
issues: a > > >> moderator > > >>>>>>> needs to approve any message not sent by a PMC member. This will > > >>> slow > > >>>>>>> down the process of interaction with the reporter. It would also > > >

Re: [VOTE} Release Apache YuniKorn (incubating) 0.12.2 RC3

2022-01-22 Thread Chenya Zhang
+1 - Build from source - Run unit tests - Run sample workloads - Checked logs and K8s messages - Verified the Web UI - Verified REST endpoints - Checked no unexpected files Best, Chenya On Fri, Jan 21, 2022 at 11:18 PM Weiwei Yang wrote: > +1 (binding) > > - Build from source > - Deploy the

Re: Add Chinese translation for documents

2022-01-16 Thread Chenya Zhang
Thanks Xiang for this wonderful contribution! It can help many more folks to learn about YuniKorn and join our community! I will also help to review your PRs. Cheers On Sun, Jan 16, 2022 at 11:23 AM Weiwei Yang wrote: > Hi Chen Xiang > > This is so awesome!!! Thank you so much for working on

Re: [VOTE] Release Apache YuniKorn (incubating) 0.12.2 RC2

2022-01-14 Thread Chenya Zhang
+1 - Build from source - Run unit tests - Run sample workloads - Checked logs and K8s messages - Verified the Web UI - Verified REST endpoints - Checked no unexpected files Best, Chenya On Fri, Jan 14, 2022 at 1:00 AM Peter Bacsko wrote: > +1 > > - Verified signature & hash > - Built images

Re: [ANNOUNCE] New committer: Yu Teng Chen

2022-01-12 Thread Chenya Zhang
Congrats Yu Teng, well deserved! On Wed, Jan 12, 2022 at 4:36 PM Wilfred Spiegelenburg wrote: > The Project Management Committee (PMC) for Apache YuniKorn has invited > Yu Teng to > become a committer and we are pleased to announce that he has accepted. > Please join me in congratulating him. >

Re: [DISCUSS] v0.12.2 release to allow K8s 1.22 and K8s 1.23 deployments

2022-01-11 Thread Chenya Zhang
+1 thanks Wilfred and Craig for driving YUNIKORN-941! Look forward to the release! On Tue, Jan 11, 2022 at 8:48 PM Weiwei Yang wrote: > Apart from the issues that have been fixed. > Can we also make sure > >- Update e2e test matrix to include 1.22 >- Update the user doc to include

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-10 Thread Chenya Zhang
e. > > + @Wilfred Spiegelenburg > > Thanks > Sunil > > On Mon, Jan 10, 2022 at 11:59 AM Chenya Zhang > > wrote: > > > Thanks Weiwei for creating the tickets! I will help to work on > > https://issues.apache.org/jira/browse/YUNIKORN-1006 to address QU 30,

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-10 Thread Chenya Zhang
security related issue. I think that > > would probably work well for Yunikorn too. > > > > > > On Mon, Jan 10, 2022 at 7:04 AM Chenya Zhang < > chenyazhangche...@gmail.com> > > wrote: > > > >> Hi Weiwei, > >> > >> Thanks for driving t

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-10 Thread Chenya Zhang
Hi Weiwei, Thanks for driving this! The evaluation is quite comprehensive overall. I checked our Apache project maturity guidelines and noticed the below three items. Not sure if we already have them but they are not blockers to our graduation. We could think more about them along the way. QU30

[jira] [Created] (YUNIKORN-1004) Investigate tagging in GIT and the interaction with go modules

2022-01-08 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-1004: -- Summary: Investigate tagging in GIT and the interaction with go modules Key: YUNIKORN-1004 URL: https://issues.apache.org/jira/browse/YUNIKORN-1004 Project

Re: [DISCUSS] Next release: Apache YuniKorn v1.0.0

2022-01-07 Thread Chenya Zhang
Thanks Wiflred for initiating the v1.0.0 release! I have resolved all sub-tasks under the umbrella ticket of https://issues.apache.org/jira/browse/YUNIKORN-720. Please let me know for any questions. Meanwhile, I'm also interested in learning more about the release process. I will check with you

[jira] [Resolved] (YUNIKORN-720) Add and improve queue metrics throughout the scheduling cycle

2022-01-06 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang resolved YUNIKORN-720. --- Resolution: Fixed > Add and improve queue metrics throughout the scheduling cy

Re: YuniKorn for Streaming Use Cases

2022-01-05 Thread Chenya Zhang
** Corrections: Apache YuniKorn meetup :) ** On Wed, Jan 5, 2022 at 4:56 PM Chenya Zhang wrote: > Hi Weiwei, thanks for sharing your past experience! This is a helpful > discussion. > > We should set up some dedicated discussions and topic threads for > "Streaming with Apac

Re: YuniKorn for Streaming Use Cases

2022-01-05 Thread Chenya Zhang
subscription, and performance etc. > > > Some of the basic functionalities are available in YK, some more needs > to > > > be built. > > > Please take a look at the slides from the Alibaba Flink team, they have > > > shared how they use YK to address their use cas

Re: Form a process of YuniKorn Improvement Proposal (YIP)

2022-01-05 Thread Chenya Zhang
+1 The intention is really good. If we are free to do it as an incubating project, we should go for it. On Wed, Jan 5, 2022 at 4:35 PM Sunil Govindan wrote: > Thanks, Bowen for initiating this. > > As an incubating project, do we have permission to define such a process? > And will there be any

Re: YuniKorn for Streaming Use Cases

2022-01-04 Thread Chenya Zhang
ake a look at the slides from the Alibaba Flink team, they have > shared how they use YK to address their use cases. > This was presented in ApacheConf: > https://www.youtube.com/watch?v=4hghJCuZk5M > > On Tue, Jan 4, 2022 at 6:35 PM Chenya Zhang > wrote: > > > Hey

YuniKorn for Streaming Use Cases

2022-01-04 Thread Chenya Zhang
Hey folks, We have some new streaming use cases with Apache Flink that could potentially leverage YuniKorn for resource scheduling. The initial implementation is to use K8s namespace for resource quota management. We are investigating what could be some strong benefits switching to YuniKorn in

[jira] [Closed] (YUNIKORN-829) Produce metrics on queue-level resource utilization

2022-01-04 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang closed YUNIKORN-829. - Resolution: Won't Do > Produce metrics on queue-level resource utilizat

Re: [ANNOUNCE] New committer: Peter Bacsko

2022-01-04 Thread Chenya Zhang
Welcome aboard, Peter! On Tue, Jan 4, 2022 at 8:53 AM Chaoran Yu wrote: > Congrats Peter. Welcome aboard! > > > > On Jan 4, 2022, at 08:23, Weiwei Yang wrote: > > > > Hi Peter > > > > Thank you! Have fun!! > > > > On Tue, Jan 4, 2022 at 8:07 AM Peter Bacsko wrote: > > > >> Hi everyone, > >> >

Re: [DISCUSS] Graduate YuniKorn from Apache Incubator

2022-01-04 Thread Chenya Zhang
>>> Time's running out. > > > >>> > > > >>> On Tue, Jan 4, 2022 at 2:08 PM Wilfred Spiegelenburg < > > > >> wilfr...@apache.org> > > > >>> wrote: > > > >>> > > > >>>> Graduation is not li

Re: [DISCUSS] Graduate YuniKorn from Apache Incubator

2022-01-03 Thread Chenya Zhang
Thanks Weiwei for initiating this discussion! So happy to see all the milestones achieved by YuniKorn in the past two years. Big Kudos to the whole community! A few follow-up questions, do we plan to release the plug-in framework before graduating from Apache Incubator? Any potential timeline is

Re: Apache YuniKorn (Incubating) 0.12.1 Released

2021-12-27 Thread Chenya Zhang
Thanks Chaoran for the great efforts! Look forward to our 1.0 release and graduation from the Apache incubator! Best, Chenya On Sun, Dec 26, 2021 at 11:35 PM Weiwei Yang wrote: > Hi Chaoran > > This is awesome, thank you for getting our release out!! > > On Sun, Dec 26, 2021 at 10:16 PM

[jira] [Closed] (YUNIKORN-722) Improve YuniKorn core's queue-level and scheduler metrics

2021-12-23 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang closed YUNIKORN-722. - > Improve YuniKorn core's queue-level and scheduler metr

[jira] [Resolved] (YUNIKORN-718) Redefine YuniKorn core's scheduler metrics names and help messages for usability and clarity

2021-12-23 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang resolved YUNIKORN-718. --- Resolution: Duplicate The work is covered by https://issues.apache.org/jira/browse

[jira] [Closed] (YUNIKORN-718) Redefine YuniKorn core's scheduler metrics names and help messages for usability and clarity

2021-12-23 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang closed YUNIKORN-718. - > Redefine YuniKorn core's scheduler metrics names and help messages for > usability and c

[jira] [Resolved] (YUNIKORN-719) Refactor YuniKorn core's scheduler metrics for sorting latency

2021-12-23 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang resolved YUNIKORN-719. --- Resolution: Duplicate The work is covered by https://issues.apache.org/jira/browse

[jira] [Closed] (YUNIKORN-719) Refactor YuniKorn core's scheduler metrics for sorting latency

2021-12-23 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang closed YUNIKORN-719. - > Refactor YuniKorn core's scheduler metrics for sorting late

Re: Observability of actually cpu/memory usage

2021-12-21 Thread Chenya Zhang
>From metrics server's documentation, Don't use Metrics Server when you need: - Non-Kubernetes clusters - An accurate source of resource usage metrics - Horizontal autoscaling based on other resources than CPU/Memory I think they have some concerns on metrics accuracy. We may need to understand

[jira] [Resolved] (YUNIKORN-722) Improve YuniKorn core's queue-level and scheduler metrics

2021-12-21 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang resolved YUNIKORN-722. --- Resolution: Duplicate https://issues.apache.org/jira/browse/YUNIKORN-721 > Impr

Re: [VOTE] Release Apache YuniKorn (incubating) 0.12.1

2021-12-15 Thread Chenya Zhang
+1 Verified the following: - Built from source - Docker image - Signature - Installed with Helm Charts - REST API, Web UI - Triggered simple jobs and checked scheduling, events, logs - Unit tests On Wed, Dec 15, 2021 at 10:13 AM Peter Bacsko wrote: > +1 (non-binding) > > Verified the

Fwd: [DISCUSSION] SPIP: Support Volcano/Alternative Schedulers Proposal

2021-11-30 Thread Chenya Zhang
FYI. Volcano folks are proposing more native integration with Spark. It would be great if we also get involved in the discussion. -- Forwarded message - From: Yikun Jiang Date: Tue, Nov 30, 2021 at 12:53 AM Subject: [DISCUSSION] SPIP: Support Volcano/Alternative Schedulers

Re: Prepare for YuniKorn Nov 18th Meetup

2021-11-18 Thread Chenya Zhang
> >>> > >>> On Fri, Oct 29, 2021 at 3:00 PM Weiwei Yang wrote: > >>> > >>> > Thanks. Info updated to: > http://yunikorn.apache.org/community/sessions > >>> > Please spread this out via twitter, linkedin, etc. > >>> > &

Re: [ANNOUNCE] New committer: Craig Condit

2021-11-14 Thread Chenya Zhang
Congrats Craig! Well deserved! On Sun, Nov 14, 2021 at 6:54 PM Manikandan R wrote: > Congratulations Craig. > > Thanks, > Mani > > On Mon, Nov 15, 2021 at 8:21 AM Sunil Govindan wrote: > > > Congratulations Craig, welcome aboard! > > > > Thanks > > Sunil > > > > On Sun, Nov 14, 2021 at 4:44 PM

Re: YK Perf benchmark

2021-11-07 Thread Chenya Zhang
Great effort, Tingyao and Yuteng! You guys can write a tech blog to share with the community. We will all help you to spread it. It would also be nice if you can present the benchmark in a YuniKorn Meetup early 2022. Best, Chenya On Sun, Nov 7, 2021 at 3:17 PM Wilfred Spiegelenburg wrote: >

Re: Discussion with K8s Sig Team

2021-11-04 Thread Chenya Zhang
btw. We have the YK Meetup on Nov 18th 4:30 - 6:00pm. Hope it will not be in conflict with the K8s Sig call. On Thu, Nov 4, 2021 at 5:33 PM Sunil Govindan wrote: > Thanks, Chaoron. > > > On Thu, Nov 4, 2021 at 5:23 PM Chaoran Yu wrote: > > > Sure, let's use my list as the agenda and finalize

[jira] [Resolved] (YUNIKORN-918) Test YouTube Live to broadcast YuniKorn Meetup in Nov 2021

2021-11-01 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang resolved YUNIKORN-918. --- Resolution: Later > Test YouTube Live to broadcast YuniKorn Meetup in Nov 2

[jira] [Resolved] (YUNIKORN-915) Create LinkedIn Event for YuniKorn Meetup in Nov 2021

2021-11-01 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang resolved YUNIKORN-915. --- Resolution: Fixed > Create LinkedIn Event for YuniKorn Meetup in Nov 2

[jira] [Closed] (YUNIKORN-917) Update website to include YuniKorn Meetup contents

2021-11-01 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang closed YUNIKORN-917. - > Update website to include YuniKorn Meetup conte

[jira] [Closed] (YUNIKORN-914) Prepare an abstract of talk for YuniKorn meetup in Nov 2021

2021-11-01 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang closed YUNIKORN-914. - > Prepare an abstract of talk for YuniKorn meetup in Nov 2

[jira] [Closed] (YUNIKORN-913) Invite speaker and set date for YuniKorn Meetup in Nov 2021

2021-11-01 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang closed YUNIKORN-913. - > Invite speaker and set date for YuniKorn Meetup in Nov 2

Re: Prepare for YuniKorn Nov 18th Meetup

2021-10-29 Thread Chenya Zhang
1 at 8:53 AM Chenya Zhang > wrote: > > > Hey devs, > > > > This is the blurb for our meetup. Thanks to Wilfred to provide the > details > > < > https://docs.google.com/document/d/1-NP0J22-Gp3cZ_hfKyA9htXJw7tlk-BmljF-7CBJg44/edit?usp=sharing >

Re: Prepare for YuniKorn Nov 18th Meetup

2021-10-29 Thread Chenya Zhang
uler core code and a new node sorting algorithm, and a future roadmap of leveraging Kubernetes plugin architecture. On Sun, Oct 24, 2021 at 7:12 PM Chenya Zhang wrote: > Sounds good, thanks Sunil! > > On Sun, Oct 24, 2021 at 4:21 PM Sunil Govindan wrote: > >> Awesome. Thanks, C

Re: Prepare for YuniKorn Nov 18th Meetup

2021-10-24 Thread Chenya Zhang
ell. > > Thanks > Sunil > > On Sun, Oct 24, 2021 at 3:20 PM Chenya Zhang > wrote: > >> Hi devs, >> >> I created an umbrella ticket to hold necessary work for our external >> meetup setup & broadcast. The upcoming one, as we discussed, is Nov 1

Prepare for YuniKorn Nov 18th Meetup

2021-10-24 Thread Chenya Zhang
Hi devs, I created an umbrella ticket to hold necessary work for our external meetup setup & broadcast. The upcoming one, as we discussed, is Nov 18th. => https://issues.apache.org/jira/browse/YUNIKORN-912 Please take a look. Esp. Wilfred, Weiwei, Sunil, and Chaoran: Let me know if you have

[jira] [Created] (YUNIKORN-919) Create YuniKorn Youtube channel and upload past videos

2021-10-24 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-919: - Summary: Create YuniKorn Youtube channel and upload past videos Key: YUNIKORN-919 URL: https://issues.apache.org/jira/browse/YUNIKORN-919 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-918) Test YouTube Live to broadcast YuniKorn Meetup in Nov 2021

2021-10-24 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-918: - Summary: Test YouTube Live to broadcast YuniKorn Meetup in Nov 2021 Key: YUNIKORN-918 URL: https://issues.apache.org/jira/browse/YUNIKORN-918 Project: Apache

[jira] [Created] (YUNIKORN-917) Update website for YuniKorn Meetup in Nov 2021

2021-10-24 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-917: - Summary: Update website for YuniKorn Meetup in Nov 2021 Key: YUNIKORN-917 URL: https://issues.apache.org/jira/browse/YUNIKORN-917 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-916) Create Twitter Post for YuniKorn Meetup in Nov 2021

2021-10-24 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-916: - Summary: Create Twitter Post for YuniKorn Meetup in Nov 2021 Key: YUNIKORN-916 URL: https://issues.apache.org/jira/browse/YUNIKORN-916 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-915) Create LinkedIn Event for YuniKorn Meetup in Nov 2021

2021-10-24 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-915: - Summary: Create LinkedIn Event for YuniKorn Meetup in Nov 2021 Key: YUNIKORN-915 URL: https://issues.apache.org/jira/browse/YUNIKORN-915 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-914) Prepare an abstract of talk for YuniKorn meetup in Nov 2021

2021-10-24 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-914: - Summary: Prepare an abstract of talk for YuniKorn meetup in Nov 2021 Key: YUNIKORN-914 URL: https://issues.apache.org/jira/browse/YUNIKORN-914 Project: Apache

[jira] [Resolved] (YUNIKORN-913) Invite speaker and set date for YuniKorn Meetup on Nov 2021

2021-10-24 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang resolved YUNIKORN-913. --- Resolution: Fixed > Invite speaker and set date for YuniKorn Meetup on Nov 2

[jira] [Created] (YUNIKORN-913) [Umbrella] Apache YuniKorn External Meetup on 11/18/2021

2021-10-24 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-913: - Summary: [Umbrella] Apache YuniKorn External Meetup on 11/18/2021 Key: YUNIKORN-913 URL: https://issues.apache.org/jira/browse/YUNIKORN-913 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-912) [Umbrella] Apache YuniKorn External Meetups

2021-10-24 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-912: - Summary: [Umbrella] Apache YuniKorn External Meetups Key: YUNIKORN-912 URL: https://issues.apache.org/jira/browse/YUNIKORN-912 Project: Apache YuniKorn

Re: Broadcast YuniKorn to the Industry!

2021-10-22 Thread Chenya Zhang
> to spread? > > On Fri, Oct 22, 2021 at 7:17 AM Chenya Zhang > wrote: > > > Wonderful, thanks Sunil and Chaoran for the input! > > > > Our first speaker will be Wilfred sharing about features in the latest > > release, Gang scheduling, bin packing, nod

Re: [DISCUSS] release v1.0.0 planning

2021-10-22 Thread Chenya Zhang
Great to see that we are going to have a new 1.0.0 release! I could help Chaoran and shadow this release. Would be interested in becoming our next release manager but happy to take a fight when it comes. :D Will follow up on this thread for v1.0.0. Best, Chenya On Fri, Oct 22, 2021 at 11:37 AM

Re: Broadcast YuniKorn to the Industry!

2021-10-22 Thread Chenya Zhang
he evening. > > This will help to cover all time zones as we have folks from Budapest, > > India, China, East Asia, and Australia. > > > > On Fri, Oct 15, 2021 at 8:02 AM Chenya Zhang < > chenyazhangche...@gmail.com> > > wrote: > > > > >

Re: Broadcast YuniKorn to the Industry!

2021-10-15 Thread Chenya Zhang
;> >>audiences, via email, twitter, LinkedIn, or ASF, etc >> >>- We need to publish the agenda & schedule of the next meeting on >> our >> >>web-site >> >>- We need to log the event recording onto the yunikorn youtube >> channel

Broadcast YuniKorn to the Industry!

2021-10-12 Thread Chenya Zhang
Hi YuniKorn devs, We have achieved a lot together in the past year on major releases including exciting new features, important bug fixes, and multiple improvements! It could be a wonderful time for us to further broadcast YuniKorn to the industry and welcome more people onboard. What could be

Re: Design review request: (YUNIKORN-337) interface message complexity

2021-09-28 Thread Chenya Zhang
+1 on splitting the large message sending between Shim and Core and processing them in a parallel way. Look forward to the performance improvement! On Tue, Sep 28, 2021 at 1:16 AM Wilfred Spiegelenburg wrote: > Oops: something went wrong with this sentence: > > * k8shim: the proxy is pushed

[jira] [Created] (YUNIKORN-858) Pass node labels as node attributes for node sorting

2021-09-22 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-858: - Summary: Pass node labels as node attributes for node sorting Key: YUNIKORN-858 URL: https://issues.apache.org/jira/browse/YUNIKORN-858 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-853) Update the value type of node attribute to support Any type

2021-09-17 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-853: - Summary: Update the value type of node attribute to support Any type Key: YUNIKORN-853 URL: https://issues.apache.org/jira/browse/YUNIKORN-853 Project: Apache

[jira] [Created] (YUNIKORN-830) Node sorting need to support "preferredDuringScheduling" node affinity

2021-08-27 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-830: - Summary: Node sorting need to support "preferredDuringScheduling" node affinity Key: YUNIKORN-830 URL: https://issues.apache.org/jira/browse/YUNIKORN-830

Re: [ANNOUNCE] Release v0.11.0 available for download

2021-08-26 Thread Chenya Zhang
Exciting and thanks Kinga! On Wed, Aug 25, 2021 at 10:44 PM Weiwei Yang wrote: > Congrats! > Thanks for making this happen Kinga! > > On Tue, Aug 24, 2021 at 1:54 AM Julia Kinga Marton > wrote: > > > Hi, All, > > > > I am happy to announce that we have now updated the website and the new > >

[jira] [Created] (YUNIKORN-828) Add YuniKorn core's queue-level capacity metrics

2021-08-25 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-828: - Summary: Add YuniKorn core's queue-level capacity metrics Key: YUNIKORN-828 URL: https://issues.apache.org/jira/browse/YUNIKORN-828 Project: Apache YuniKorn

Re: [VOTE] Release Apache YuniKorn (incubating) 0.11.0 RC2

2021-08-03 Thread Chenya Zhang
Thanks Kinga and everyone! +1 approve +1 on facing the same issue as Wilfred mentioned Verified: * Built images from the source * Ran unit tests * Ran the scheduler in K8s 1.17 and 1.20. Verified that regular scheduling works and gang scheduling works for Spark. * Verified UI and REST APIs

[jira] [Resolved] (YUNIKORN-714) Refactor YuniKorn core's scheduler metrics for application submission

2021-06-30 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang resolved YUNIKORN-714. --- Resolution: Fixed PR: https://github.com/apache/incubator-yunikorn-core/pull/281

[jira] [Resolved] (YUNIKORN-713) Align YuniKorn core's scheduler metrics with queue metrics for total applications accepted

2021-06-30 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang resolved YUNIKORN-713. --- Resolution: Fixed PR: https://github.com/apache/incubator-yunikorn-core/pull/280 > Al

[jira] [Created] (YUNIKORN-722) Refactor YuniKorn core's queue-level resource metrics

2021-06-21 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-722: - Summary: Refactor YuniKorn core's queue-level resource metrics Key: YUNIKORN-722 URL: https://issues.apache.org/jira/browse/YUNIKORN-722 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-721) Refactor YuniKorn core's queue-level application metrics

2021-06-21 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-721: - Summary: Refactor YuniKorn core's queue-level application metrics Key: YUNIKORN-721 URL: https://issues.apache.org/jira/browse/YUNIKORN-721 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-720) Add and improve queue metrics throughout the scheduling cycle

2021-06-21 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-720: - Summary: Add and improve queue metrics throughout the scheduling cycle Key: YUNIKORN-720 URL: https://issues.apache.org/jira/browse/YUNIKORN-720 Project: Apache

[jira] [Created] (YUNIKORN-719) Refactor YuniKorn core's scheduler metrics for sorting latency

2021-06-21 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-719: - Summary: Refactor YuniKorn core's scheduler metrics for sorting latency Key: YUNIKORN-719 URL: https://issues.apache.org/jira/browse/YUNIKORN-719 Project: Apache

[jira] [Created] (YUNIKORN-718) Redefine YuniKorn core's scheduler metrics names and help messages for usability and clarity

2021-06-21 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-718: - Summary: Redefine YuniKorn core's scheduler metrics names and help messages for usability and clarity Key: YUNIKORN-718 URL: https://issues.apache.org/jira/browse/YUNIKORN-718

[jira] [Created] (YUNIKORN-717) Refactor YuniKorn core's scheduler metrics for node status

2021-06-21 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-717: - Summary: Refactor YuniKorn core's scheduler metrics for node status Key: YUNIKORN-717 URL: https://issues.apache.org/jira/browse/YUNIKORN-717 Project: Apache

[jira] [Created] (YUNIKORN-716) Refactor YuniKorn core's scheduler metrics for application running and completed

2021-06-21 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-716: - Summary: Refactor YuniKorn core's scheduler metrics for application running and completed Key: YUNIKORN-716 URL: https://issues.apache.org/jira/browse/YUNIKORN-716

[jira] [Created] (YUNIKORN-715) Refactor YuniKorn core's scheduler metrics for container allocation

2021-06-21 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-715: - Summary: Refactor YuniKorn core's scheduler metrics for container allocation Key: YUNIKORN-715 URL: https://issues.apache.org/jira/browse/YUNIKORN-715 Project

[jira] [Created] (YUNIKORN-714) Refactor YuniKorn core's scheduler metrics for application submission

2021-06-21 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-714: - Summary: Refactor YuniKorn core's scheduler metrics for application submission Key: YUNIKORN-714 URL: https://issues.apache.org/jira/browse/YUNIKORN-714 Project

[jira] [Created] (YUNIKORN-713) Align YuniKorn core's scheduler metrics with queue metrics for total applications accepted

2021-06-21 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-713: - Summary: Align YuniKorn core's scheduler metrics with queue metrics for total applications accepted Key: YUNIKORN-713 URL: https://issues.apache.org/jira/browse/YUNIKORN-713

[jira] [Reopened] (YUNIKORN-3) Add scheduling metrics throughout the scheduling cycle

2021-06-21 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang reopened YUNIKORN-3: - Need more improvement on the scheduling metrics part. Creating subtasks. > Add scheduling metr

[jira] [Closed] (YUNIKORN-647) Add new metrics to monitor pending applications: "long_pending_app"

2021-05-25 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenya Zhang closed YUNIKORN-647. - Resolution: Invalid > Add new metrics to monitor pending applications: "long_pen

[jira] [Created] (YUNIKORN-647) Add new metrics to monitor pending applications: "long_pending_app"

2021-04-20 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-647: - Summary: Add new metrics to monitor pending applications: "long_pending_app" Key: YUNIKORN-647 URL: https://issues.apache.org/jira/browse/YUNIKORN-647

[jira] [Created] (YUNIKORN-646) Metrics missing implementation: "allocating_latency_seconds"

2021-04-20 Thread Chenya Zhang (Jira)
Chenya Zhang created YUNIKORN-646: - Summary: Metrics missing implementation: "allocating_latency_seconds" Key: YUNIKORN-646 URL: https://issues.apache.org/jira/browse/YUNIKORN-646 Proje