APAC community sync up schedule changes

2022-01-25 Thread Weiwei Yang
FYI: the APAC community call schedule has changed to bi-weekly, please check the latest calendar. We will use this schedule for now and may change it back to weekly if more frequent meetings are necessary.

[jira] [Resolved] (YUNIKORN-1043) Minor fix on the people page

2022-01-25 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-1043. --- Fix Version/s: 1.0.0 Assignee: Weiwei Yang Resolution: Fixed > Minor

[jira] [Created] (YUNIKORN-1043) Minor fix on the people page

2022-01-25 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-1043: - Summary: Minor fix on the people page Key: YUNIKORN-1043 URL: https://issues.apache.org/jira/browse/YUNIKORN-1043 Project: Apache YuniKorn Issue Type: Sub

[jira] [Resolved] (YUNIKORN-1021) Add committer/PPMC user list on the website

2022-01-25 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-1021. --- Fix Version/s: 1.0.0 Resolution: Fixed > Add committer/PPMC user l

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-23 Thread Weiwei Yang
Hi Sunil I don’t think we ever have a wiki, do we still need to add that? I see some projects leave that empty as well. Sent from my iPhone > On Jan 23, 2022, at 2:07 PM, Sunil Govindan wrote: > > @Weiwei Yang > Could you please add WIKI as well to this? > > Thanks &g

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-23 Thread Weiwei Yang
; > > These can be found on > > https://whimsy.apache.org/roster/ppmc/yunikorn > > > > < > https://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/ > > > > > > > From: Weiwei Yang > > Sent: Thursd

Re: [VOTE} Release Apache YuniKorn (incubating) 0.12.2 RC3

2022-01-21 Thread Weiwei Yang
+1 (binding) - Build from source - Deploy the scheduler using helm charts - Run sample jobs - Verify the bug that has been fixed PS: since this is just adding a bug fix on top of RC2, I did not repeat all the validation steps I have done for RC2 On Fri, Jan 21, 2022 at 12:28 PM Chaoran Yu

Re: [RESULT] [VOTE] Release Apache YuniKorn (incubating) 0.12.2 RC2

2022-01-21 Thread Weiwei Yang
ed towards > > the YuniKorn scheduler. We can start on a next release on the branch > > v0.12. We should get this case as part of our e2e tests added. > > > > Wilfred > > > > On Fri, 21 Jan 2022 at 17:15, Weiwei Yang wrote: > >> > >> Agree, this n

Re: [RESULT] [VOTE] Release Apache YuniKorn (incubating) 0.12.2 RC2

2022-01-20 Thread Weiwei Yang
critical because if the scheduler pod fails for any > reason, someone has to manually redeploy the whole thing. > > > > On Jan 20, 2022, at 21:45, Weiwei Yang wrote: > > > > Hmmm. that is a bug. But during the release verification, I have tried > the > > he

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-20 Thread Weiwei Yang
s, Gobblin, TVM, Superset and Datasketches. There are more but I > think this provides an overview of what is expected on graduation. > > Wilfred > > [1] https://www.apache.org/security/ > > On Tue, 11 Jan 2022 at 18:21, Weiwei Yang wrote: > > > > Hi Wilfred > >

Re: [RESULT] [VOTE] Release Apache YuniKorn (incubating) 0.12.2 RC2

2022-01-20 Thread Weiwei Yang
Hmmm. that is a bug. But during the release verification, I have tried the helm install, and that works as expected. I am guessing that is because the scheduler always gets started first. Maybe the same for the upgrade? In this case, maybe this can work as long as people are using helm charts to

[jira] [Resolved] (YUNIKORN-1037) Update community conf links

2022-01-20 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-1037. --- Fix Version/s: 1.0.0 Resolution: Fixed > Update community conf li

[jira] [Created] (YUNIKORN-1037) Update community conf links

2022-01-20 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-1037: - Summary: Update community conf links Key: YUNIKORN-1037 URL: https://issues.apache.org/jira/browse/YUNIKORN-1037 Project: Apache YuniKorn Issue Type: Bug

[jira] [Created] (YUNIKORN-1036) Fix why yunikorn doc format on the home page

2022-01-19 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-1036: - Summary: Fix why yunikorn doc format on the home page Key: YUNIKORN-1036 URL: https://issues.apache.org/jira/browse/YUNIKORN-1036 Project: Apache YuniKorn

Re: [DISCUSS] Kubernetes supported version policy

2022-01-19 Thread Weiwei Yang
Hi Craig Thanks for raising up this for discussion. I agree with your proposal, now YK is using stable APIs, supporting different K8s versions won't add too much work for us. Most time just updating the test matrix and getting every test passed should be sufficient. To extend your proposal, we

[jira] [Resolved] (YUNIKORN-1009) add git sha as label to admission controller image

2022-01-18 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-1009. --- Fix Version/s: 1.0.0 Resolution: Fixed > add git sha as label to admiss

Re: Add Chinese translation for documents

2022-01-16 Thread Weiwei Yang
Hi Chen Xiang This is so awesome!!! Thank you so much for working on this!! We have some people in the committer/PPMC list who can speak Chinese, we will help to review. Thank you again for creating the PR and raising up this in the mailing list, great work! On Sun, Jan 16, 2022 at 4:33 AM 陈 翔

Re: [VOTE] Release Apache YuniKorn (incubating) 0.12.2 RC2

2022-01-13 Thread Weiwei Yang
+1 Verified the following things: - Checked NOTICE, DISCLAIMER, README, and CHANGELOG - Verified signature - Build from source using make - Run unit test using make test - Run some sample workloads, roughly went over the logs and k8s messages - Verified the basic UI

Re: [VOTE] Release Apache YuniKorn (incubating) 0.12.2 RC1

2022-01-13 Thread Weiwei Yang
Hi Craig Found one issue in the release tarball, the README file said: The scheduler and shim are build as one set of artifacts and have one requirement: * Go 1.11 or later this needs to be updated to Go 1.15 or later. The build will fail if the go version is lower than 1.15. Other than that,

[jira] [Created] (YUNIKORN-1021) Add committer/PPMC user list on the website

2022-01-12 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-1021: - Summary: Add committer/PPMC user list on the website Key: YUNIKORN-1021 URL: https://issues.apache.org/jira/browse/YUNIKORN-1021 Project: Apache YuniKorn

[jira] [Resolved] (YUNIKORN-1007) LC20 For Docker Repo

2022-01-12 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-1007. --- Fix Version/s: 1.0.0 Resolution: Fixed > LC20 For Docker R

[jira] [Created] (YUNIKORN-1020) Update security issue report guidelines

2022-01-12 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-1020: - Summary: Update security issue report guidelines Key: YUNIKORN-1020 URL: https://issues.apache.org/jira/browse/YUNIKORN-1020 Project: Apache YuniKorn

Re: [ANNOUNCE] New committer: Yu Teng Chen

2022-01-12 Thread Weiwei Yang
Yu Teng, congrats! Hope to work with you more : ) On Wed, Jan 12, 2022 at 4:40 PM Craig Condit wrote: > Congratulations Yu Teng, and welcome to the team! > > Craig > > > > On Jan 12, 2022, at 6:35 PM, Wilfred Spiegelenburg > wrote: > > > > The Project Management Committee (PMC) for Apache

Re: [DISCUSS] v0.12.2 release to allow K8s 1.22 and K8s 1.23 deployments

2022-01-12 Thread Weiwei Yang
a YUNIKORN-1010 [1] > > > > The upgrade is the same as it has always been. A simple helm upgrade > > should trigger the upgrade as per normal. > > > > Wilfred > > > > [1] https://issues.apache.org/jira/browse/YUNIKORN-1010 > > > > On Wed, 12 Jan 20

Time change for Jan 12's community sync up (U.S timezone)

2022-01-11 Thread Weiwei Yang
Hi all I have rescheduled tomorrow's U.S timezone community sync up to 4:30 pm in the afternoon. Just to make it more convenient for some more people to join. This is a one-time change, but I guess we can also discuss the timeslot in the coming meeting and see if we want to move this permanently.

Re: [DISCUSS] v0.12.2 release to allow K8s 1.22 and K8s 1.23 deployments

2022-01-11 Thread Weiwei Yang
the remaining issues for 1.22? People can help out some of unfinished tasks. On Tue, Jan 11, 2022 at 8:44 PM Weiwei Yang wrote: > Fantastic, thank you, Wilfred, Craig for getting this solved! > +1 of having a 1.22 release, to unblock people who use 1.22+ K8s versions. > > > On Tue, Jan 11,

Re: [DISCUSS] v0.12.2 release to allow K8s 1.22 and K8s 1.23 deployments

2022-01-11 Thread Weiwei Yang
Fantastic, thank you, Wilfred, Craig for getting this solved! +1 of having a 1.22 release, to unblock people who use 1.22+ K8s versions. On Tue, Jan 11, 2022 at 8:40 PM Chaoran Yu wrote: > +1 because it unblocks some users. > > On Tue, Jan 11, 2022 at 4:35 PM Sunil Govindan wrote: > > > I

Reminder: today's community sync up meeting for APAC region (Chinese/中文)

2022-01-11 Thread Weiwei Yang
Hi all For community folks in the APAC region speaking Chinese, we have a community sync-up meeting today. Please check the details in your calendar. Thanks!

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-10 Thread Weiwei Yang
> > >> The project puts a high priority on backwards compatibility and aims to > document any incompatible changes and provide tools and documentation to > help users transition to new features. > >> > >> CO50 > >> > >> The project documents h

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-10 Thread Weiwei Yang
>>>> <https://issues.apache.org/jira/browse/YUNIKORN-1007> > >>>> > >>>> We have to look at LC20 more closely given the public artifacts that > we > >>>> have. > >>>> > >>>> + @Wilfred Spiegelenburg > &

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-10 Thread Weiwei Yang
ools and documentation to >> help users transition to new features. >> >> CO50 >> >> The project documents how contributors can earn more rights such as >> commit access or decision power, and applies these principles consistently. >> >> >>

[jira] [Created] (YUNIKORN-1006) Address QU 30, 40, 50

2022-01-10 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-1006: - Summary: Address QU 30, 40, 50 Key: YUNIKORN-1006 URL: https://issues.apache.org/jira/browse/YUNIKORN-1006 Project: Apache YuniKorn Issue Type: Sub-task

[jira] [Created] (YUNIKORN-1005) [Umbrella] Prepare graduation from ASF incubator

2022-01-10 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-1005: - Summary: [Umbrella] Prepare graduation from ASF incubator Key: YUNIKORN-1005 URL: https://issues.apache.org/jira/browse/YUNIKORN-1005 Project: Apache YuniKorn

Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-10 Thread Weiwei Yang
Hi YuniKorn community and mentors Based on the discussion thread [1], after 2 years time of incubating, it is considered that now is a good time to graduate YuniKorn from the ASF incubator and become a top-level Apache project. We have reviewed the ASF project maturity model [2] and provided some

Re: [DISCUSS] Graduate YuniKorn from Apache Incubator

2022-01-07 Thread Weiwei Yang
I think we can aim for Feb'22, considering we can close all the tasks > > that > > > we planned. > > > We had these discussions earlier, and it is great to see that we are in > > > much better shape. > > > > > > Let's go ahead with the TLP path and

[jira] [Resolved] (YUNIKORN-541) Unexpected WARN log in node.go#refreshAvailableResource

2022-01-06 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-541. -- Fix Version/s: 0.11 Assignee: Tao Yang Resolution: Fixed > Unexpected W

[jira] [Resolved] (YUNIKORN-138) Redesign display of resources in web UI

2022-01-06 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-138. -- Fix Version/s: 1.0.0 Resolution: Abandoned > Redesign display of resources in web

[jira] [Resolved] (YUNIKORN-147) Extensive resource quota management

2022-01-06 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-147. -- Fix Version/s: 0.11 Resolution: Fixed > Extensive resource quota managem

[jira] [Resolved] (YUNIKORN-183) Logging clean up

2022-01-06 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-183. -- Fix Version/s: 1.0.0 Resolution: Fixed > Logging clean

[jira] [Resolved] (YUNIKORN-689) Pods could be scheduled on nodes that don't have enough CPUs

2022-01-06 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-689. -- Fix Version/s: 1.0.0 Resolution: Done This issue happens when there is some

[jira] [Resolved] (YUNIKORN-629) Add size specification to queue config

2022-01-06 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-629. -- Fix Version/s: 1.0.0 Resolution: Abandoned > Add size specification to queue con

[jira] [Resolved] (YUNIKORN-410) Pod state change may cause incorrect update on SchedulerNode#occupied

2022-01-06 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-410. -- Fix Version/s: 1.0.0 Resolution: Cannot Reproduce Close this for now, reopen

Re: Form a process of YuniKorn Improvement Proposal (YIP)

2022-01-05 Thread Weiwei Yang
Oops, got it wrong, you mean broader review, not ASF board. Sorry, please ignore my last comment : ) On Wed, Jan 5, 2022 at 4:25 PM Weiwei Yang wrote: > Hi Bowen > > +1 > Having a formal process will definitely help the cross-org communication. > Do we need the ASF board to re

Re: Form a process of YuniKorn Improvement Proposal (YIP)

2022-01-05 Thread Weiwei Yang
Hi Bowen +1 Having a formal process will definitely help the cross-org communication. Do we need the ASF board to review this? I am not sure, usually, each project committee is able to decide what is the best for the project. Thanks On Wed, Jan 5, 2022 at 4:07 PM Bowen Li wrote: > Hi all, > >

Re: YuniKorn for Streaming Use Cases

2022-01-05 Thread Weiwei Yang
or other advanced > scheduling needs. Will keep this thread updated. > > Meanwhile, happy to hear more thoughts from you! > > Best, > Chenya > > On Tue, Jan 4, 2022 at 9:20 PM Weiwei Yang wrote: > > > Hi Chenya > > > > The use case is similar, YK will play

Re: YuniKorn for Streaming Use Cases

2022-01-04 Thread Weiwei Yang
Hi Chenya The use case is similar, YK will play a big role there. Lots of features are relevant, such as queues, job ordering, user/group ACLs, preemption, over-subscription, and performance etc. Some of the basic functionalities are available in YK, some more needs to be built. Please take a

Re: [DISCUSS] Next release: Apache YuniKorn v1.0.0

2022-01-04 Thread Weiwei Yang
hi Wilfred Thank you for setting up the plan. Thank you for being the release manager! On Mon, Jan 3, 2022 at 11:21 PM Manikandan R wrote: > Wilfred, Thank you for the proposal. We should be able to cover major tasks > of YUNIKORN-984 umbrella jira as well. > > Thanks, > Mani > > On Tue, Jan

Re: [DISCUSS] Graduate YuniKorn from Apache Incubator

2022-01-04 Thread Weiwei Yang
ed by YuniKorn in the past > two > > > > years. Big Kudos to the whole community! > > > > > > > > A few follow-up questions, do we plan to release the plug-in > framework > > > > before graduating from Apache Incubator? Any potential timeline is > nee

Re: [ANNOUNCE] New committer: Peter Bacsko

2022-01-04 Thread Weiwei Yang
Hi Peter Thank you! Have fun!! On Tue, Jan 4, 2022 at 8:07 AM Peter Bacsko wrote: > Hi everyone, > > thanks everyone for inviting as a committer, I'm sure we'll have some good > time together with YK! :) > > Cheers, > Peter > > On Tue, Jan 4, 2022 at 11:37 AM Wilfred Spiegelenburg > > wrote:

[DISCUSS] Graduate YuniKorn from Apache Incubator

2022-01-03 Thread Weiwei Yang
Hi, yunikorn community Happy new year!! I hope you all have an excellent start in 2022. YuniKorn started incubating in ASF on Jan/21/2020, and the project has been incredibly well managed and maintained by the community in almost 2 years under ASF now. There were 5 releases published in a good

[jira] [Created] (YUNIKORN-990) DocSearch Migration

2021-12-27 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-990: Summary: DocSearch Migration Key: YUNIKORN-990 URL: https://issues.apache.org/jira/browse/YUNIKORN-990 Project: Apache YuniKorn Issue Type: Task

Re: Apache YuniKorn (Incubating) 0.12.1 Released

2021-12-26 Thread Weiwei Yang
Hi Chaoran This is awesome, thank you for getting our release out!! On Sun, Dec 26, 2021 at 10:16 PM Chaoran Yu wrote: > I forgot to mention that the source code and convenience images can be > found at the Downloads page: > https://yunikorn.apache.org/community/download < >

Re: yunikorn contributor

2021-12-23 Thread Weiwei Yang
Hi Youxuan Added you as a contributor, you can get started now :) On Thu, Dec 23, 2021 at 10:08 PM 林祐軒 wrote: > want to contribute > apache jiar user name: youxuan >

Re: yunikorn contributor

2021-12-23 Thread Weiwei Yang
Hi Hsi-Huang I have added you to the contributor list, feel free to find anything you are interested to start with. Thanks On Thu, Dec 23, 2021 at 9:56 PM Chaoran Yu wrote: > Welcome! Forking the project and starting to use it will be a good start. > Also you are welcome to attend the

Re: Design review request: (YUNIKORN-984) Enforcing User and Group limits

2021-12-22 Thread Weiwei Yang
Hi Mani Thank you for bringing this up, this is a long-wanted feature. I think this is not just about the user/group limits, e.g YUNIKORN-985 is to introduce a limit for the max number of applications. Shall we rename this to something like

Re: Observability of actually cpu/memory usage

2021-12-21 Thread Weiwei Yang
es release. > Integrating with these APIs doesn't sound promising. But besides Kubelet, > the actual utilization info of workloads is not readily available anywhere > else. We'll need to explore other ideas. > > On Tue, Dec 21, 2021 at 12:51 PM Weiwei Yang wrote: > > > Thank y

Re: Observability of actually cpu/memory usage

2021-12-21 Thread Weiwei Yang
Thank you Bowen to raise this up, this is an interesting topic. Bear with me this long reply : ) Like Wilfred mentioned, YK doesn't know about the actual used resources in terms of CPU and memory for each pod, or application, at least not today. I understand the requirements about tracking this

[jira] [Resolved] (YUNIKORN-953) Investigate of kubeflow/training-operator

2021-12-18 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-953. -- Fix Version/s: 1.0.0 Resolution: Fixed > Investigate of kubeflow/training-opera

[jira] [Resolved] (YUNIKORN-973) Correct the link in master/deployments/examples

2021-12-15 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-973. -- Fix Version/s: 1.0.0 Resolution: Fixed > Correct the link in master/deployme

Re: [VOTE] Release Apache YuniKorn (incubating) 0.12.1

2021-12-14 Thread Weiwei Yang
+1 (binding) Verified the following things: - Verified the signature - Built from source, docker images are good - Verified the source code SHAs using docker inspect - Successfully installed the build locally using helm-charts - Run a simple job to verify the basic scheduling,

Re: [VOTE] Release Apache YuniKorn (incubating) 0.12.1

2021-12-14 Thread Weiwei Yang
A couple of things: - There seems to be an empty dir: helm-charts/yunikorn/charts - Not sure about these files under helm-charts/yunikorn/templates/ dir, are they necessary here? - hpa.yaml - ingress.yaml - tests/test-connection.yaml other than these, looks good. On

Re: Renaming v0.12.0 to v0.12.1

2021-12-13 Thread Weiwei Yang
that will be used for 1.0.0. > When I make the website changes to announce 0.12.1, I’ll briefly explain > the reason we skipped 0.12.0 > > > > On Dec 13, 2021, at 17:20, Weiwei Yang wrote: > > > > Just had a discussion with Craig about this. Given this is not fixable, I > &

Re: Renaming v0.12.0 to v0.12.1

2021-12-13 Thread Weiwei Yang
iling. > > We cannot use 0.12.0 any more at this point. > > > Craig > > > > On Dec 13, 2021, at 6:49 PM, Weiwei Yang wrote: > > > > We should not have a 0.12.1 without a 0.12.0 release, I think that is > > against the release convention. > > I

Re: Renaming v0.12.0 to v0.12.1

2021-12-13 Thread Weiwei Yang
We should not have a 0.12.1 without a 0.12.0 release, I think that is against the release convention. I don't think we need to worry too much about the tags, we can tag it after the RC passed all the votes. Because the dependency in our release binary is locally resolved, what was in the go mod

[jira] [Created] (YUNIKORN-979) Add e2e test coverage for the admission controller

2021-12-13 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-979: Summary: Add e2e test coverage for the admission controller Key: YUNIKORN-979 URL: https://issues.apache.org/jira/browse/YUNIKORN-979 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-978) Admission controller improvements

2021-12-13 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-978: Summary: Admission controller improvements Key: YUNIKORN-978 URL: https://issues.apache.org/jira/browse/YUNIKORN-978 Project: Apache YuniKorn Issue Type

Perf benchmark is available now for the latest version

2021-12-10 Thread Weiwei Yang
Hi all The perf result is published on the website now, please see https://yunikorn.apache.org/docs/performance/evaluate_perf_function_with_kubemark, We see a 2x ~ 4x perf advantage over the default scheduler in general. Thanks for getting this done Tingyao Huang, Yuteng Chen!

[jira] [Resolved] (YUNIKORN-842) [Umbrella] YuniKorn performance tuning and benchmark

2021-12-10 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-842. -- Fix Version/s: 0.12 Resolution: Fixed > [Umbrella] YuniKorn performance tun

[jira] [Resolved] (YUNIKORN-845) Publish benchmark result on web-site

2021-12-10 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-845. -- Fix Version/s: 0.12 Resolution: Fixed > Publish benchmark result on web-s

[jira] [Resolved] (YUNIKORN-851) Documents of build kubemark and prometheus

2021-11-30 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-851. -- Fix Version/s: 0.12 Resolution: Fixed > Documents of build kubemark and prometh

Today's community sync up (中文) has been canceled

2021-11-23 Thread Weiwei Yang
Hi folks Today's community sync up meeting has been cancelled since many folks are on vacation, happy thanksgiving !!

[jira] [Resolved] (YUNIKORN-844) Kubemark build, setup and configuration

2021-11-19 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-844. -- Fix Version/s: 0.12 Resolution: Fixed Thank you [~Yukali] helping us to setup 2K, 4K

[jira] [Resolved] (YUNIKORN-33) Performance benchmark with kubemark

2021-11-19 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-33?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-33. - Fix Version/s: 0.12 Resolution: Fixed > Performance benchmark with kubem

[jira] [Resolved] (YUNIKORN-29) Add integration testing tools to generate function/performance reports

2021-11-19 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-29. - Fix Version/s: 0.12 Resolution: Fixed > Add integration testing tools to gener

[jira] [Resolved] (YUNIKORN-843) Prepare servers and hardware for benchmark work

2021-11-16 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-843. -- Fix Version/s: 0.12 Resolution: Fixed > Prepare servers and hardware for benchm

[jira] [Resolved] (YUNIKORN-929) Rename "sessions" to "events"

2021-11-16 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-929. -- Fix Version/s: 0.12 Resolution: Fixed > Rename "sessions&quo

[jira] [Resolved] (YUNIKORN-911) Verify helm chart install on 1.21

2021-11-16 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-911. -- Fix Version/s: 0.12 Resolution: Fixed Cool, thank you [~lowc1012]! > Verify h

Re: Prepare for YuniKorn Nov 18th Meetup

2021-11-14 Thread Weiwei Yang
Hi Sunil, thank you! On Sun, Nov 14, 2021 at 7:31 AM Sunil Govindan wrote: > Hello Folks, > > Here is our Twitter feed for the upcoming meetup. > https://twitter.com/YuniKorn_Sched/status/1459906107279757316 > > Thanks > Sunil > > On Fri, Oct 29, 2021 at 5:42 PM Weiwe

Re: [DISCUSS] release v1.0.0 planning

2021-11-08 Thread Weiwei Yang
Hi Wilfred Thank you for the updates! On Sun, Nov 7, 2021 at 9:57 PM Wilfred Spiegelenburg wrote: > After some further discussion and some new insights some of us think the > choice for a v1.0 is not the right thing at the moment. We think that we > need one further release v0.12.0 before a

Re: Discussion with K8s Sig Team

2021-11-04 Thread Weiwei Yang
> > > > > > > Hi Weiwei > > > > > > > > Yes. I suggest meeting next Wed inside of the YK community. > > > > Based on that we can take a call whether to join on 18th. > > > > > > > > Thanks, Chaoron for summing it up.

YK Perf benchmark

2021-11-04 Thread Weiwei Yang
Hi all As you know or may not know, in the last 2 months, Tingyao and Yuteng are helping to perform a new round of perf-bench marking based on the latest codebase. They've done this from scratch, set up a simulated env using their lab's hardware, setup up metrics servers to observe and discover

[jira] [Resolved] (YUNIKORN-934) Correct the link in deployments/examples/Readme

2021-11-04 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-934. -- Fix Version/s: 1.0.0 Resolution: Fixed Thank you [~steinsgateted] for fixing

Re: Discussion with K8s Sig Team

2021-11-04 Thread Weiwei Yang
I think Chaoran covered most of the questions we discussed yesterday. Sunil, are you suggesting to meet next Wed inside of the YK community before setting up a call with sig-scheduling? I noticed the next sig-scheduling meeting is Nov 18, we probably can try to set up sometime earlier than that

[jira] [Reopened] (YUNIKORN-911) Verify helm chart install on 1.21

2021-11-02 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YUNIKORN-911: -- Reopen because we need to use the latest master code image. > Verify helm chart inst

[jira] [Resolved] (YUNIKORN-911) Verify helm chart install on 1.21

2021-11-02 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-911. -- Resolution: Fixed > Verify helm chart install on 1

Reschedule Nov 3 community sync up

2021-11-02 Thread Weiwei Yang
Hi all I have rescheduled tomorrows' community sync-up meeting to 3pm - 4pm PST, in order to let more people join. Please be aware of this one-time schedule change. We might want to see if the afternoon time is better for folks to join, in that case, we can move the meeting schedule permanently.

[jira] [Created] (YUNIKORN-929) Rename "sessions" to "events"

2021-11-01 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-929: Summary: Rename "sessions" to "events" Key: YUNIKORN-929 URL: https://issues.apache.org/jira/browse/YUNIKORN-929 Project: Apache YuniKorn

[jira] [Resolved] (YUNIKORN-914) Prepare an abstract of talk for YuniKorn meetup in Nov 2021

2021-11-01 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-914. -- Fix Version/s: 1.0.0 Resolution: Fixed > Prepare an abstract of talk for YuniK

Re: Prepare for YuniKorn Nov 18th Meetup

2021-10-29 Thread Weiwei Yang
Awesome, thank you Chenya! On Fri, Oct 29, 2021 at 4:39 PM Chenya Zhang wrote: > + Our LinkedIn event posted: > https://www.linkedin.com/events/6859992516305932288/ > > On Fri, Oct 29, 2021 at 3:00 PM Weiwei Yang wrote: > > > Thanks. Info updated to: http://yunikorn

Re: Prepare for YuniKorn Nov 18th Meetup

2021-10-29 Thread Weiwei Yang
Thanks. Info updated to: http://yunikorn.apache.org/community/sessions Please spread this out via twitter, linkedin, etc. On Fri, Oct 29, 2021 at 8:53 AM Chenya Zhang wrote: > Hey devs, > > This is the blurb for our meetup. Thanks to Wilfred to provide the details >

[jira] [Resolved] (YUNIKORN-917) Update website to include YuniKorn Meetup contents

2021-10-29 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-917. -- Fix Version/s: 1.0.0 Resolution: Fixed > Update website to include YuniKorn Mee

[jira] [Resolved] (YUNIKORN-920) Fix scheduling latency metrics

2021-10-26 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-920. -- Target Version: 1.0.0 Assignee: Chen Yu Teng Resolution: Duplicate >

[jira] [Created] (YUNIKORN-926) Scheduling 10 app * 5000 pod is faster than 1 app *50000 pod

2021-10-26 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-926: Summary: Scheduling 10 app * 5000 pod is faster than 1 app *5 pod Key: YUNIKORN-926 URL: https://issues.apache.org/jira/browse/YUNIKORN-926 Project: Apache

[jira] [Created] (YUNIKORN-925) Add document to explain existing yunikorn metrics

2021-10-26 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-925: Summary: Add document to explain existing yunikorn metrics Key: YUNIKORN-925 URL: https://issues.apache.org/jira/browse/YUNIKORN-925 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-920) Fix scheduling latency metrics

2021-10-25 Thread Weiwei Yang (Jira)
Weiwei Yang created YUNIKORN-920: Summary: Fix scheduling latency metrics Key: YUNIKORN-920 URL: https://issues.apache.org/jira/browse/YUNIKORN-920 Project: Apache YuniKorn Issue Type: Sub

[jira] [Resolved] (YUNIKORN-909) Add 1.21 to the e2e test support matrix

2021-10-24 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YUNIKORN-909. -- Resolution: Fixed > Add 1.21 to the e2e test support mat

Re: [DISCUSS] release v1.0.0 planning

2021-10-24 Thread Weiwei Yang
1> is the > umbrella JIRA for the upcoming release work that I’ll take on in about a > month. > > > > > On Oct 22, 2021, at 17:10, Weiwei Yang wrote: > > > > Hi Chaoran/Sunil > > > > I don't think we have the wiki sort of thing. > > For

Re: [DISCUSS] release v1.0.0 planning

2021-10-22 Thread Weiwei Yang
0 release! > > > > > > I could help Chaoran and shadow this release. Would be interested in > > > becoming our next release manager but happy to take a fight when it > > comes. > > > :D > > > > > > Will follow up on this thread for v1.0.0. &

Re: Broadcast YuniKorn to the Industry!

2021-10-22 Thread Weiwei Yang
ur website? > > Thanks, > Chenya > > On Fri, Oct 22, 2021 at 11:42 AM Weiwei Yang wrote: > > > ACK'd, sounds great. > > We need to have a sharable message to adv this. @Wilfred Spiegelenburg > > , could you pls share a short description of the > > session

Re: Broadcast YuniKorn to the Industry!

2021-10-22 Thread Weiwei Yang
e could also find if there are > > > other > > > > highly popular meetups in the industry and do a joint talk or > > discussion. > > > > > > > > Thoughts? > > > > > > > > Cheers, > > > > Chenya >

<    1   2   3   4   5   6   7   8   9   >