[jira] [Resolved] (YUNIKORN-1279) create design document

2022-08-22 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1279. - Fix Version/s: 1.2.0 Resolution: Fixed doc added, re-resolving

[jira] [Resolved] (YUNIKORN-1287) fix go.mod references from YUNIKORN-1122

2022-08-21 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1287. - Resolution: Fixed changes committed to master and cherry-picked

[jira] [Created] (YUNIKORN-1288) Add check for pseudo version

2022-08-21 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1288: --- Summary: Add check for pseudo version Key: YUNIKORN-1288 URL: https://issues.apache.org/jira/browse/YUNIKORN-1288 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-1287) fix go.mod references from YUNIKORN-1122

2022-08-21 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1287: --- Summary: fix go.mod references from YUNIKORN-1122 Key: YUNIKORN-1287 URL: https://issues.apache.org/jira/browse/YUNIKORN-1287 Project: Apache

[jira] [Reopened] (YUNIKORN-1279) create design document

2022-08-18 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reopened YUNIKORN-1279: - using the same Jira to add the design doc to the documentation

[jira] [Resolved] (YUNIKORN-702) Add doc to explain yunikorn can support any K8s workload

2022-08-18 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-702. Fix Version/s: 1.1.0 Resolution: Fixed page added, works in both

[jira] [Resolved] (YUNIKORN-1282) Resource metrics are not tracked correctly for all queue types

2022-08-18 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1282. - Resolution: Fixed metrics are generated for all queue types

[jira] [Created] (YUNIKORN-1284) upgrade zap logger to a recent version

2022-08-17 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1284: --- Summary: upgrade zap logger to a recent version Key: YUNIKORN-1284 URL: https://issues.apache.org/jira/browse/YUNIKORN-1284 Project: Apache

[jira] [Created] (YUNIKORN-1283) upgrade go dependencies

2022-08-17 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1283: --- Summary: upgrade go dependencies Key: YUNIKORN-1283 URL: https://issues.apache.org/jira/browse/YUNIKORN-1283 Project: Apache YuniKorn

[jira] [Resolved] (YUNIKORN-1270) Removal of unused queue field in Allocation

2022-08-10 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1270. - Fix Version/s: 1.1.0 Resolution: Fixed changes committed

[jira] [Resolved] (YUNIKORN-1256) License issue with deployments examples

2022-08-10 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1256. - Fix Version/s: 1.1.0 Resolution: Fixed changes in all repos

Re: [DISCUSSION] Replacing the namespace quota annotations

2022-08-09 Thread Wilfred Spiegelenburg
, 2022 at 12:12 AM Wilfred Spiegelenburg > wrote: > > > I would like to propose a replacement of the current namespace quota > > annotation in an upcoming release. The current annotation only allows > > specifying cpu and or memory. It does not allow the same flexibility

[jira] [Resolved] (YUNIKORN-1240) Document changes required for RM multi-arch release builds

2022-08-08 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1240. - Fix Version/s: 1.1.0 Resolution: Fixed release procedure

Re: [DISCUSSION] Yunikorn release 1.1.0

2022-08-08 Thread Wilfred Spiegelenburg
Sounds like a good plan. Wilfred On Tue, 9 Aug 2022 at 09:05, Craig Condit wrote: > > Hi Peter, > > Thanks for taking on the 1.1.0 release. I think this plan looks good. > > - Craig > > > > On Aug 8, 2022, at 7:30 AM, Peter Bacsko wrote: > > > > Hi all, > > > > we've been discussing the next

[jira] [Resolved] (YUNIKORN-1085) DaemonSet pods may fail to be scheduled on new nodes added during autoscaling

2022-08-08 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1085. - Fix Version/s: 1.1.0 Resolution: Fixed daemon sets can ow

[jira] [Resolved] (YUNIKORN-751) [Umbrella] Improve the e2e tests coverage

2022-08-08 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-751. Resolution: Implemented all sub tasks are done > [Umbrella] Impr

[jira] [Resolved] (YUNIKORN-752) Add scheduler restart test coverage

2022-08-08 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-752. Fix Version/s: 1.1.0 Resolution: Duplicate recovery tests were

[jira] [Resolved] (YUNIKORN-753) Call healthcheck REST API to verify the scheduler correctness in e2e test

2022-08-08 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-753. Fix Version/s: 1.1.0 Resolution: Duplicate recovery tests call

[jira] [Resolved] (YUNIKORN-1277) Simplify command line processing code

2022-08-08 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1277. - Fix Version/s: 1.1.0 Resolution: Fixed nice cleanup

[ANNOUNCE] removal of latest tagged images from docker hub (done)

2022-08-07 Thread Wilfred Spiegelenburg
Earlier today I finalised the removal of the images with the latest tag from docker hub under the apache/yunikorn location. This was a little later than expected due to some access issues on my side. I have left a remark in the README [1] that mentioned this fact also. I did see that the last

[jira] [Resolved] (YUNIKORN-1265) fix shellcheck issues in our shell scripts

2022-08-07 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1265. - Fix Version/s: 1.1.0 Resolution: Fixed all changes committed

[DISCUSSION] usage tracking for users

2022-08-04 Thread Wilfred Spiegelenburg
As a first step for implementing quotas around users and groups we have looked at tracking usage inside YuniKorn for a user and group. The design document referenced [1] sets out a design for tracking this usage. The usage tracking is based on the existing user propagation from the k8shim into

[jira] [Resolved] (YUNIKORN-705) [Umbrella] Gang Scheduling stabilization

2022-08-04 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-705. Fix Version/s: 1.1.0 Resolution: Fixed all subtask have been done

[jira] [Resolved] (YUNIKORN-648) Update the gang scheduling design to reflect some design changes

2022-08-04 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-648. Resolution: Won't Fix The design document shows what was the thought

[jira] [Resolved] (YUNIKORN-1234) Add unit test for GetPreemptionFromTag

2022-08-04 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1234. - Fix Version/s: 1.1.0 Resolution: Fixed Resolving

[DISCUSSION] Replacing the namespace quota annotations

2022-08-04 Thread Wilfred Spiegelenburg
I would like to propose a replacement of the current namespace quota annotation in an upcoming release. The current annotation only allows specifying cpu and or memory. It does not allow the same flexibility as we allow for quotas in the queue configuration, or what can be specified in the gang

[jira] [Created] (YUNIKORN-1275) Support arbitrary resources in namespace annotation

2022-08-04 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1275: --- Summary: Support arbitrary resources in namespace annotation Key: YUNIKORN-1275 URL: https://issues.apache.org/jira/browse/YUNIKORN-1275 Project

[jira] [Resolved] (YUNIKORN-1250) add .asf.yaml to release repo

2022-08-03 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1250. - Fix Version/s: 1.1.0 Resolution: Fixed new .asf.yaml file

[jira] [Resolved] (YUNIKORN-1271) update people page on website

2022-08-01 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1271. - Fix Version/s: 1.1.0 Resolution: Fixed added all PMC members

[jira] [Resolved] (YUNIKORN-1268) Document placeholder REST changes

2022-07-31 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1268. - Fix Version/s: 1.1.0 Resolution: Fixed changes committed, site

[jira] [Created] (YUNIKORN-1271) update people page on website

2022-07-29 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1271: --- Summary: update people page on website Key: YUNIKORN-1271 URL: https://issues.apache.org/jira/browse/YUNIKORN-1271 Project: Apache YuniKorn

[jira] [Resolved] (YUNIKORN-1260) remove logos from core repo

2022-07-28 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1260. - Fix Version/s: 1.1.0 Resolution: Fixed thank you Ryan, changes

[jira] [Created] (YUNIKORN-1270) Removal of unused queue field in Allocation

2022-07-28 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1270: --- Summary: Removal of unused queue field in Allocation Key: YUNIKORN-1270 URL: https://issues.apache.org/jira/browse/YUNIKORN-1270 Project: Apache

[ANNOUNCE] removal of images with latest tag from DockerHub

2022-07-27 Thread Wilfred Spiegelenburg
As in the earlier discussion the images with the latest tag in the docker hub do not align with the Apache release policy [1]. The images with a tag of latest also do not correspond with the real latest release as they are pushed manually at an ad-hoc basis. We have removed the usage of the latest

[ANNOUNCE] New PMC member: Peter Bacsko

2022-07-25 Thread Wilfred Spiegelenburg
The Project Management Committee (PMC) for Apache YuniKorn has invited Peter Bacsko to become a PMC member and we are pleased to announce that he has accepted. On behalf of the Apache YuniKorn PMC Wilfred - To unsubscribe,

[jira] [Created] (YUNIKORN-1268) Document placeholder REST changes

2022-07-21 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1268: --- Summary: Document placeholder REST changes Key: YUNIKORN-1268 URL: https://issues.apache.org/jira/browse/YUNIKORN-1268 Project: Apache YuniKorn

[jira] [Resolved] (YUNIKORN-1263) Add pending requests to application object in REST API

2022-07-18 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1263. - Fix Version/s: 1.1.0 Resolution: Fixed change committed

[jira] [Resolved] (YUNIKORN-1259) Remove "How to contribute" doc from web repo

2022-07-18 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1259. - Fix Version/s: 1.1.0 Resolution: Fixed thank you

[jira] [Resolved] (YUNIKORN-1262) stash local changes in merge_perge.sh

2022-07-18 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1262. - Fix Version/s: 1.1.0 Resolution: Fixed update merged: changes

[jira] [Created] (YUNIKORN-1265) fix shellcheck issues in our shell scripts

2022-07-18 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1265: --- Summary: fix shellcheck issues in our shell scripts Key: YUNIKORN-1265 URL: https://issues.apache.org/jira/browse/YUNIKORN-1265 Project: Apache

[jira] [Resolved] (YUNIKORN-1257) Docker build improvements

2022-07-18 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1257. - Fix Version/s: 1.1.0 Resolution: Fixed changes in both repos

[jira] [Resolved] (YUNIKORN-1252) expose timed out placeholders count in application REST info

2022-07-15 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1252. - Fix Version/s: 1.1.0 Resolution: Fixed was a bit of a delay

[jira] [Resolved] (YUNIKORN-1225) pin docusaurus version for website

2022-07-15 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1225. - Fix Version/s: 1.1.0 Resolution: Fixed moved to latest

[jira] [Created] (YUNIKORN-1262) stash local changes in merge_perge.sh

2022-07-15 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1262: --- Summary: stash local changes in merge_perge.sh Key: YUNIKORN-1262 URL: https://issues.apache.org/jira/browse/YUNIKORN-1262 Project: Apache

[jira] [Resolved] (YUNIKORN-1258) Move github actions to latest versions

2022-07-15 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1258. - Fix Version/s: 1.1.0 Resolution: Fixed all changes committed

[jira] [Created] (YUNIKORN-1260) remove logos from core repo

2022-07-14 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1260: --- Summary: remove logos from core repo Key: YUNIKORN-1260 URL: https://issues.apache.org/jira/browse/YUNIKORN-1260 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-1259) Remove "How to contribute" doc from web repo

2022-07-14 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1259: --- Summary: Remove "How to contribute" doc from web repo Key: YUNIKORN-1259 URL: https://issues.apache.org/jira/browse/YUNIKORN-1259

[jira] [Created] (YUNIKORN-1258) Move github actions to latest versions

2022-07-13 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1258: --- Summary: Move github actions to latest versions Key: YUNIKORN-1258 URL: https://issues.apache.org/jira/browse/YUNIKORN-1258 Project: Apache

[jira] [Created] (YUNIKORN-1257) Docker build improvements

2022-07-13 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1257: --- Summary: Docker build improvements Key: YUNIKORN-1257 URL: https://issues.apache.org/jira/browse/YUNIKORN-1257 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-1256) License issue with deployments examples

2022-07-13 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1256: --- Summary: License issue with deployments examples Key: YUNIKORN-1256 URL: https://issues.apache.org/jira/browse/YUNIKORN-1256 Project: Apache

[jira] [Resolved] (YUNIKORN-1254) Update image version of node in the run command in the local_run.sh

2022-07-11 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1254. - Fix Version/s: 1.1.0 Resolution: Fixed committed the change

[jira] [Resolved] (YUNIKORN-1241) remove RequiredNode from PlaceholderData

2022-07-02 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1241. - Fix Version/s: 1.1.0 Resolution: Fixed thanks [~steinsgateted

[jira] [Resolved] (YUNIKORN-1248) Fix arch issue for Mac M1

2022-07-02 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1248. - Fix Version/s: 1.1.0 Resolution: Fixed > Fix arch is

[jira] [Created] (YUNIKORN-1251) update validation script to handle multi architecture images

2022-06-30 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1251: --- Summary: update validation script to handle multi architecture images Key: YUNIKORN-1251 URL: https://issues.apache.org/jira/browse/YUNIKORN-1251

[jira] [Resolved] (YUNIKORN-229) shim sends the same remove request twice for a remove allocation

2022-06-30 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-229. Resolution: Cannot Reproduce The communication between the shim

[DISCUSS] upgrade build tools and actions

2022-06-28 Thread Wilfred Spiegelenburg
As part of the github actions we install go and golangci-lint as tools. These have not been updated in a while. We should upgrade to a later version now that we are in between releases. The actions we are using (setup-go and checkout) have also moved onto new major versions. Proposal is to

[jira] [Created] (YUNIKORN-1250) add .asf.yaml to release repo

2022-06-23 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1250: --- Summary: add .asf.yaml to release repo Key: YUNIKORN-1250 URL: https://issues.apache.org/jira/browse/YUNIKORN-1250 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-1246) tryAllocate:

2022-06-21 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1246: --- Summary: tryAllocate: Key: YUNIKORN-1246 URL: https://issues.apache.org/jira/browse/YUNIKORN-1246 Project: Apache YuniKorn Issue Type

[jira] [Created] (YUNIKORN-1245) Clean up cache GetNodesInfoMap

2022-06-21 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1245: --- Summary: Clean up cache GetNodesInfoMap Key: YUNIKORN-1245 URL: https://issues.apache.org/jira/browse/YUNIKORN-1245 Project: Apache YuniKorn

[jira] [Created] (YUNIKORN-1243) Build replacement web UI image for e2e tests

2022-06-21 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1243: --- Summary: Build replacement web UI image for e2e tests Key: YUNIKORN-1243 URL: https://issues.apache.org/jira/browse/YUNIKORN-1243 Project

Re: [DISCUSS] removal of latest tag from docker hub

2022-06-21 Thread Wilfred Spiegelenburg
breakage. Off > >> the top of my head, e2e tests for the shim will definitely break, as they > >> will be unable to deploy the web UI successfully if the web:latest tag goes > >> away. There may be others as well… > >> > >> - Craig > >> > &g

[jira] [Created] (YUNIKORN-1242) gang: delay in scheduling with real alloc larger than placeholders

2022-06-20 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1242: --- Summary: gang: delay in scheduling with real alloc larger than placeholders Key: YUNIKORN-1242 URL: https://issues.apache.org/jira/browse/YUNIKORN-1242

[jira] [Created] (YUNIKORN-1241) remove RequiredNode from PlaceholderData

2022-06-19 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1241: --- Summary: remove RequiredNode from PlaceholderData Key: YUNIKORN-1241 URL: https://issues.apache.org/jira/browse/YUNIKORN-1241 Project: Apache

[DISCUSS] removal of latest tag from docker hub

2022-06-19 Thread Wilfred Spiegelenburg
On docker hub we publish images with the tag "latest". According to the Apache release policy we can release compiled packages as part of our release. The artifacts have to comply with a couple of simple rules [1]. An image with the "latest" tag does not comply with these rules as it does not have

Re: [DISCUSS] Building multi architecture images

2022-06-17 Thread Wilfred Spiegelenburg
Thank you for the feedback. I'll raise the PRs for the affected repos today. Wilfred On Fri, 17 Jun 2022 at 17:08, Sunil Govindan wrote: > > Thank you. > This is a great addition to 1.1.0.  > > Sunil > > On Thu, Jun 16, 2022 at 8:31 PM Wilfred Spiegelenburg

[jira] [Created] (YUNIKORN-1239) error handling in release script

2022-06-17 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1239: --- Summary: error handling in release script Key: YUNIKORN-1239 URL: https://issues.apache.org/jira/browse/YUNIKORN-1239 Project: Apache YuniKorn

Re: [DISCUSS] Building multi architecture images

2022-06-16 Thread Wilfred Spiegelenburg
I know it’s > possible, and probably mostly there, but I think it’s important to limit the > third-party requirements for an RM as much as possible. > > Thanks for working on this. > > - Craig > > > > On Jun 15, 2022, at 8:01 PM, Wilfred Spiegelenburg > > wrote

[ANNOUNCE] helm chart 1.0.0 availability

2022-06-15 Thread Wilfred Spiegelenburg
After the move from helm hub to artifactory the YuniKorn project was not officially the owner of the charts published at [1]. A complicating factor was our graduation that happened which caused the GIT repo URL to change and break our chart publishing. All this has been rectified now. We are

[DISCUSS] Building multi architecture images

2022-06-15 Thread Wilfred Spiegelenburg
Hi, By default we only publish images with the AMD64 architecture. YUNIKORN-725 was implemented to allow builds to at least succeed on both AMD64 and ARM architectures. Building images is a bit more involved and it was briefly discussed as part of YUNIKORN-725, and then moved to YUNIKORN-1215

[jira] [Created] (YUNIKORN-1236) add artifacthub-repo.yml file for helm

2022-06-13 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1236: --- Summary: add artifacthub-repo.yml file for helm Key: YUNIKORN-1236 URL: https://issues.apache.org/jira/browse/YUNIKORN-1236 Project: Apache

[jira] [Resolved] (YUNIKORN-1217) Ensure that Spark driver pod is processed before executor pods during recovery

2022-06-09 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1217. - Resolution: Fixed pod sorting is implemented. I ran a couple

[jira] [Resolved] (YUNIKORN-1184) [Core] preempt pods based on the priorities

2022-06-09 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1184. - Fix Version/s: 1.1.0 Resolution: Fixed Changes have been

[jira] [Created] (YUNIKORN-1234) Add unit test for GetPreemptionFromTag

2022-06-08 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1234: --- Summary: Add unit test for GetPreemptionFromTag Key: YUNIKORN-1234 URL: https://issues.apache.org/jira/browse/YUNIKORN-1234 Project: Apache

[jira] [Created] (YUNIKORN-1233) REST api shows negative request time for some allocations

2022-06-08 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1233: --- Summary: REST api shows negative request time for some allocations Key: YUNIKORN-1233 URL: https://issues.apache.org/jira/browse/YUNIKORN-1233

[jira] [Resolved] (YUNIKORN-1222) [SI] preempt pods based on the priorities

2022-06-02 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1222. - Fix Version/s: 1.1.0 Resolution: Fixed SI changes

[jira] [Created] (YUNIKORN-1225) pin docusaurus version for website

2022-05-29 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1225: --- Summary: pin docusaurus version for website Key: YUNIKORN-1225 URL: https://issues.apache.org/jira/browse/YUNIKORN-1225 Project: Apache YuniKorn

Re: Renaming *_test.go as *test.go

2022-05-26 Thread Wilfred Spiegelenburg
I agree with Craig. The *_test.go files are specifically defined in the specification for tests. Some details on how and what is here [1] with even more details in [2]. We do not want to pollute the production code with test code unless we really need to expose some detail that we cannot

[ANNOUNCE] helm update for 1.0.0

2022-05-05 Thread Wilfred Spiegelenburg
Due to the changes in the GIT repository URL when YuniKorn became a TLP, artifactory will not pick up the newly released helm charts for 1.0.0. The helm reference in the documentation does work and should be used. It has all helm charts for all releases: helm repo add yunikorn

[jira] [Resolved] (YUNIKORN-991) [UMBRELLA] YuniKorn 1.0 release efforts

2022-05-04 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-991. Resolution: Fixed all sub tasks done > [UMBRELLA] YuniKorn 1.0 rele

[jira] [Resolved] (YUNIKORN-993) helm chart release v1.0

2022-05-04 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-993. Resolution: Fixed gh-pages updated  > helm chart release v

[ANNOUNCE] Apache YuniKorn v1.0.0 release

2022-05-04 Thread Wilfred Spiegelenburg
Hi all, It gives me great pleasure to announce that the Apache YuniKorn community has voted to release Apache YuniKorn v1.0.0. Apache YuniKorn v1.0.0 is the first release for the project as an Apache top level project. It also marks a major milestone as the first major release. It contains 173

[jira] [Created] (YUNIKORN-1200) update release steps

2022-05-04 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1200: --- Summary: update release steps Key: YUNIKORN-1200 URL: https://issues.apache.org/jira/browse/YUNIKORN-1200 Project: Apache YuniKorn

[jira] [Resolved] (YUNIKORN-992) Update website for v1.0 release

2022-05-04 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-992. Resolution: Fixed website changes committed > Update website for v

Re: [VOTE] Release Apache YuniKorn 1.0.0 RC1

2022-05-02 Thread Wilfred Spiegelenburg
, Wilfred On Mon, 2 May 2022 at 23:07, Wilfred Spiegelenburg wrote: > > +1 (binding) from myself: > - Checked signatures & checksum > - Built from source > - started a kind cluster using validate_cluster.sh script. > - checked web UI and REST response > - checked sche

Re: [VOTE] Release Apache YuniKorn 1.0.0 RC1

2022-05-02 Thread Wilfred Spiegelenburg
+1 (binding) from myself: - Checked signatures & checksum - Built from source - started a kind cluster using validate_cluster.sh script. - checked web UI and REST response - checked scheduler restart Wilfred On Wed, 27 Apr 2022 at 13:30, Wilfred Spiegelenburg wrote: > > Hello every

[jira] [Created] (YUNIKORN-1196) [UMBRELLA] Upgrade K8s build dependency

2022-04-28 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1196: --- Summary: [UMBRELLA] Upgrade K8s build dependency Key: YUNIKORN-1196 URL: https://issues.apache.org/jira/browse/YUNIKORN-1196 Project: Apache

Re: [VOTE] Release Apache YuniKorn 1.0.0 RC1

2022-04-27 Thread Wilfred Spiegelenburg
- ws/v1/partition/{partitionName}/nodes > - ws/v1/partition/{partitionName}/queues/{queueName}/application >- Run sleep pods and nginx pod examples. > > > Wilfred Spiegelenburg 於 2022年4月27日 週三 上午11:31寫道: > > > Hello everyone, > > > > I w

Re: [VOTE] Release Apache YuniKorn 1.0.0 RC1

2022-04-27 Thread Wilfred Spiegelenburg
standard and plugin modes > > Craig > > > > On Apr 26, 2022, at 10:30 PM, Wilfred Spiegelenburg > > wrote: > > > > Hello everyone, > > > > I would like to call a vote for releasing Apache YuniKorn 1.0.0 RC1. > > The first release for Apache Yuni

[jira] [Created] (YUNIKORN-1192) Update exclude list in release build

2022-04-27 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1192: --- Summary: Update exclude list in release build Key: YUNIKORN-1192 URL: https://issues.apache.org/jira/browse/YUNIKORN-1192 Project: Apache

[VOTE] Release Apache YuniKorn 1.0.0 RC1

2022-04-26 Thread Wilfred Spiegelenburg
Hello everyone, I would like to call a vote for releasing Apache YuniKorn 1.0.0 RC1. The first release for Apache YuniKorn as a top level project. Please note that the location of artefacts and the KEYS file has changed as we are now a top level project. The release artefacts have been uploaded

[jira] [Resolved] (YUNIKORN-1190) Shim needs to account for usage of pods without app ID

2022-04-26 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1190. - Fix Version/s: 1.0.0 Resolution: Fixed pushed this into 1.0

[jira] [Resolved] (YUNIKORN-1189) Release validation script should support plugin mode

2022-04-26 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1189. - Resolution: Fixed Good addition, allows validating both modes easily

[jira] [Created] (YUNIKORN-1181) Privacy policy update

2022-04-21 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-1181: --- Summary: Privacy policy update Key: YUNIKORN-1181 URL: https://issues.apache.org/jira/browse/YUNIKORN-1181 Project: Apache YuniKorn

Re: [ANNOUNCE] Branching for v1.0.0

2022-04-15 Thread Wilfred Spiegelenburg
a locking issue. As soon as they are in I will tag and create the RC. Wilfred On Wed, 13 Apr 2022 at 13:45, Wilfred Spiegelenburg wrote: > > We 're getting close to the v1.0.0 release. We have been working our > way through the jiras and the PRs. At the moment we think we need > another day o

[jira] [Resolved] (YUNIKORN-601) KubeClient mock does not allow failure tests

2022-04-13 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-601. Fix Version/s: 1.0.0 Resolution: Fixed New client can return

[jira] [Resolved] (YUNIKORN-1155) Placeholder timeout should not be initialized to the default value during recovery

2022-04-13 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1155. - Fix Version/s: 1.0.0 Resolution: Fixed thank you [~pbacsko

[jira] [Resolved] (YUNIKORN-1005) [Umbrella] Prepare graduation from ASF incubator

2022-04-12 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-1005. - Fix Version/s: 1.0.0 Resolution: Delivered > [Umbre

[ANNOUNCE] Branching for v1.0.0

2022-04-12 Thread Wilfred Spiegelenburg
We 're getting close to the v1.0.0 release. We have been working our way through the jiras and the PRs. At the moment we think we need another day or two to get the last couple of changes in. We are currently in a state where we can proceed with branching. Planning is to have the new branch

[jira] [Reopened] (YUNIKORN-1155) Placeholder timeout should not be initialized to the default value during recovery

2022-04-11 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reopened YUNIKORN-1155: - See the PR: default timeout handling is not working for this case

[jira] [Resolved] (YUNIKORN-384) [webUI] UI doesn't parse partition info correctly with more than one partition

2022-04-06 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YUNIKORN-384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YUNIKORN-384. Fix Version/s: 1.0.0 Resolution: Fixed With the move to the new

<    3   4   5   6   7   8   9   10   11   12   >