[jira] [Resolved] (YUNIKORN-2115) [Umbrella] YuniKorn application traceability - phase II

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg resolved YUNIKORN-2115.
-
Fix Version/s: 1.5.0
   Resolution: Fixed

> [Umbrella] YuniKorn application traceability - phase II
> ---
>
> Key: YUNIKORN-2115
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2115
> Project: Apache YuniKorn
>  Issue Type: New Feature
>  Components: core - scheduler
>Reporter: Peter Bacsko
>Assignee: Peter Bacsko
>Priority: Major
> Fix For: 1.5.0
>
>
> This is a follow-up on YUNIKORN-1628.
> This ticket focuses on streaming and user/group events.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-2116) Track user/group events

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg resolved YUNIKORN-2116.
-
Fix Version/s: 1.5.0
   Resolution: Fixed

Core changes committed. The changes to the SI have been committed last week.

Both PRs are done, closing.

> Track user/group events
> ---
>
> Key: YUNIKORN-2116
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2116
> Project: Apache YuniKorn
>  Issue Type: Sub-task
>  Components: core - scheduler
>Reporter: Peter Bacsko
>Assignee: Peter Bacsko
>Priority: Major
>  Labels: pull-request-available
> Fix For: 1.5.0
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-2441) Wildcard limits are not applied to the root tracker during creation

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg resolved YUNIKORN-2441.
-
Fix Version/s: 1.5.0
   Resolution: Fixed

Change committed

> Wildcard limits are not applied to the root tracker during creation
> ---
>
> Key: YUNIKORN-2441
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2441
> Project: Apache YuniKorn
>  Issue Type: Bug
>  Components: core - scheduler
>Reporter: Peter Bacsko
>Assignee: Peter Bacsko
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 1.5.0
>
>
> When a queue tracker is created with {{newQueueTracker()}}, the appropriate 
> wildcard limits are applied if the tracking type is "user".
> The problem is this call:
> {noformat}
>   if trackType == user {
>   if config := m.getUserWildCardLimitsConfig(queuePath + "." + 
> queueName); config != nil {
> {noformat}
> For "root", we'll call "root." (with a dot at the end) instead of "root".



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2445) Add comments around locking setup in tracker code

2024-02-21 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-2445:
---

 Summary: Add comments around locking setup in tracker code
 Key: YUNIKORN-2445
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2445
 Project: Apache YuniKorn
  Issue Type: Task
  Components: core - scheduler
Reporter: Wilfred Spiegelenburg


The QueueTracker code is lock free and should stay lock free. Each queue 
tracker object is always only linked to one UserTracker or GroupTracker. 
Locking is thus handled from those objects.

This does mean that calls to the user or group trackers that can modify the 
underlying queue tracker structure must take a write lock. 

This specifically impacts the {{canRunApp()}} and {{headroom()}} calls as they 
add new entries in the queue hierarchy.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2444) Create user guide for the event system

2024-02-21 Thread Peter Bacsko (Jira)
Peter Bacsko created YUNIKORN-2444:
--

 Summary: Create user guide for the event system
 Key: YUNIKORN-2444
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2444
 Project: Apache YuniKorn
  Issue Type: Sub-task
  Components: documentation
Reporter: Peter Bacsko






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2443) Update the features page with the event system

2024-02-21 Thread Peter Bacsko (Jira)
Peter Bacsko created YUNIKORN-2443:
--

 Summary: Update the features page with the event system
 Key: YUNIKORN-2443
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2443
 Project: Apache YuniKorn
  Issue Type: Sub-task
  Components: documentation
Reporter: Peter Bacsko






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2442) Documentation update about the event system

2024-02-21 Thread Peter Bacsko (Jira)
Peter Bacsko created YUNIKORN-2442:
--

 Summary: Documentation update about the event system
 Key: YUNIKORN-2442
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2442
 Project: Apache YuniKorn
  Issue Type: Task
  Components: documentation
Reporter: Peter Bacsko


We need to update the existing documentation about the event system.

* Features list
* User guide



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2441) Wildcard limits are not applied to the root tracker during creation

2024-02-21 Thread Peter Bacsko (Jira)
Peter Bacsko created YUNIKORN-2441:
--

 Summary: Wildcard limits are not applied to the root tracker 
during creation
 Key: YUNIKORN-2441
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2441
 Project: Apache YuniKorn
  Issue Type: Bug
  Components: core - scheduler
Reporter: Peter Bacsko
Assignee: Peter Bacsko


When a queue tracker is created with {{newQueueTracker()}}, the appropriate 
wildcard limits are applied if the tracking type is "user".

The problem is this call:
{noformat}
if trackType == user {
if config := m.getUserWildCardLimitsConfig(queuePath + "." + 
queueName); config != nil {
{noformat}

For "root", we'll call "root." (with a dot at the end) instead of "root".




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2440) [UMBRELLA] Remove stateaware scheduling

2024-02-21 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-2440:
---

 Summary: [UMBRELLA] Remove stateaware scheduling
 Key: YUNIKORN-2440
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2440
 Project: Apache YuniKorn
  Issue Type: Task
  Components: core - scheduler
Reporter: Wilfred Spiegelenburg


Umbrella jira to track all the work to remove state ware scheduling:
* remove scheduling code
* remove documentation
* remove configuration options
* document way to achieve similar behaviour (FIFO with max applications)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2439) Announce deprecation of state aware scheduling

2024-02-21 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created YUNIKORN-2439:
---

 Summary: Announce deprecation of state aware scheduling
 Key: YUNIKORN-2439
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2439
 Project: Apache YuniKorn
  Issue Type: Task
  Components: release-notes
Reporter: Wilfred Spiegelenburg
Assignee: Wilfred Spiegelenburg


State aware scheduling was a simple scheduling algorithm that provided a stop 
gap until gang scheduling was implemented. Gang scheduling and state aware do 
not work together. Gang scheduling is a more generic way of achieving almost 
the same behaviour.

State aware scheduling has a number of drawbacks and could be used as an attack 
vector to slow down overall scheduling performance.

We should deprecate it and remove in an upcoming release.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-2026) Update features document in Chinese translation

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg closed YUNIKORN-2026.
---

> Update features document in Chinese translation
> ---
>
> Key: YUNIKORN-2026
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2026
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: documentation
>Reporter: JiaChi Wang
>Assignee: JiaChi Wang
>Priority: Minor
>  Labels: pull-request-available
>
> Some parts are missing in the Chinese translation of the features document.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-1511) Adding Chinese translation of Deploy to Kubernetes

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg closed YUNIKORN-1511.
---

> Adding Chinese translation of Deploy to Kubernetes
> --
>
> Key: YUNIKORN-1511
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1511
> Project: Apache YuniKorn
>  Issue Type: Task
>Reporter: Chen Yu Teng
>Assignee: Chenchen Lai
>Priority: Major
>  Labels: pull-request-available
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-2220) pod.DeepCopy() is called twice in Task

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg closed YUNIKORN-2220.
---

> pod.DeepCopy() is called twice in Task
> --
>
> Key: YUNIKORN-2220
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2220
> Project: Apache YuniKorn
>  Issue Type: Sub-task
>  Components: shim - kubernetes
>Reporter: Peter Bacsko
>Assignee: Peter Bacsko
>Priority: Minor
>
> A small improvement is possible in {{task.go}}.
> In {{handleSubmitTaskEvent()}} and {{{}postTaskAllocated(){}}}, we call 
> {{pod.DeepCopy()}} twice to avoid possible race conditions, but a single copy 
> is enough. Once we have a copy, it's local to the method.
> {noformat}
> events.GetRecorder().Eventf(task.pod.DeepCopy(), nil, v1.EventTypeNormal, 
> "Scheduling", "Scheduling",
>   "%s is queued and waiting for allocation", task.alias)
>   // if this task belongs to a task group, that means the app has gang 
> scheduling enabled
>   // in this case, post an event to indicate the task is being gang 
> scheduled
>   if !task.placeholder && task.taskGroupName != "" {
>   events.GetRecorder().Eventf(task.pod.DeepCopy(), nil,
>   v1.EventTypeNormal, "GangScheduling", "GangScheduling",
>   "Pod belongs to the taskGroup %s, it will be scheduled 
> as a gang member", task.taskGroupName) <-- second copy if GS is used
>   }
> {noformat}
> {noformat}
> events.GetRecorder().Eventf(task.pod.DeepCopy(),
>   nil, v1.EventTypeNormal, "Scheduled", "Scheduled",
>   "Successfully assigned %s to node %s", task.alias, task.nodeName)
> ...
> events.GetRecorder().Eventf(task.pod.DeepCopy(), nil,
>   v1.EventTypeNormal, "PodBindSuccessful", "PodBindSuccessful",
>   "Pod %s is successfully bound to node %s", task.alias, task.nodeName)
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-803) Improve coverage of partition.go

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg closed YUNIKORN-803.
--

> Improve coverage of partition.go
> 
>
> Key: YUNIKORN-803
> URL: https://issues.apache.org/jira/browse/YUNIKORN-803
> Project: Apache YuniKorn
>  Issue Type: Improvement
>  Components: core - scheduler
>Reporter: Chen Yu Teng
>Assignee: Cliff Su
>Priority: Minor
> Attachments: list.png, partition.go coverage.png
>
>
> According to feedback of coverage file, add test to improve coverage of 
> partition.go



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-1691) Adding Chinese translation of User Based Resource Usage Tracking

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg closed YUNIKORN-1691.
---

>  Adding Chinese translation of User Based Resource Usage Tracking
> -
>
> Key: YUNIKORN-1691
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1691
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: website
>Reporter: Chen Yu Teng
>Assignee: Chenchen Lai
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-1692) Adding Chinese translation of User Based Resource Usage Tracking

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg closed YUNIKORN-1692.
---

> Adding Chinese translation of User Based Resource Usage Tracking
> 
>
> Key: YUNIKORN-1692
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1692
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: website
>Reporter: Chen Yu Teng
>Assignee: Huang Guan Hao
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-2223) Eliminate separate mutex variables

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg closed YUNIKORN-2223.
---

> Eliminate separate mutex variables
> --
>
> Key: YUNIKORN-2223
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2223
> Project: Apache YuniKorn
>  Issue Type: Improvement
>  Components: shim - kubernetes
>Reporter: Peter Bacsko
>Priority: Minor
>
> In {{{}cache.Task{}}}, the lock variable is defined as:
> {noformat}
> type Task struct {
> ...
> schedulingState TaskSchedulingState
> sm  *fsm.FSM
> lock*sync.RWMutex
> } {noformat}
> This also applies to {{cache.Application}} and {{cache.Context}}.
> In other parts of the code, we simply embed {{sync.RWMutex}}. There's no need 
> to have a separate variable. Locking and unlocking become simpler.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-1033) Add Chinese translation for developer guide documents

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg resolved YUNIKORN-1033.
-
Resolution: Won't Do

With the changes from YUNIKORN-2411 this is no longer relevant.

> Add Chinese translation for developer guide documents
> -
>
> Key: YUNIKORN-1033
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1033
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: documentation
>Reporter: cdmikechen
>Assignee: Chen Yu Teng
>Priority: Major
>
> Add Chinese translation for developer guide documents, this is a sub task on 
> https://issues.apache.org/jira/browse/YUNIKORN-1029
> This issue include YuniKorn site developer guide documents.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-1691) Adding Chinese translation of User Based Resource Usage Tracking

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg resolved YUNIKORN-1691.
-
Resolution: Won't Do

With the changes from YUNIKORN-2411 this is no longer relevant.

>  Adding Chinese translation of User Based Resource Usage Tracking
> -
>
> Key: YUNIKORN-1691
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1691
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: website
>Reporter: Chen Yu Teng
>Assignee: Chenchen Lai
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-1692) Adding Chinese translation of User Based Resource Usage Tracking

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg resolved YUNIKORN-1692.
-
Resolution: Won't Do

With the changes from YUNIKORN-2411 this is no longer relevant.

> Adding Chinese translation of User Based Resource Usage Tracking
> 
>
> Key: YUNIKORN-1692
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1692
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: website
>Reporter: Chen Yu Teng
>Assignee: Huang Guan Hao
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-1511) Adding Chinese translation of Deploy to Kubernetes

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg resolved YUNIKORN-1511.
-
Resolution: Won't Do

With the changes from YUNIKORN-2411 this is no longer relevant.

> Adding Chinese translation of Deploy to Kubernetes
> --
>
> Key: YUNIKORN-1511
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1511
> Project: Apache YuniKorn
>  Issue Type: Task
>Reporter: Chen Yu Teng
>Assignee: Chenchen Lai
>Priority: Major
>  Labels: pull-request-available
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-2026) Update features document in Chinese translation

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg resolved YUNIKORN-2026.
-
Resolution: Won't Do

With the changes from YUNIKORN-2411 this is no longer relevant.

> Update features document in Chinese translation
> ---
>
> Key: YUNIKORN-2026
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2026
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: documentation
>Reporter: JiaChi Wang
>Assignee: JiaChi Wang
>Priority: Minor
>  Labels: pull-request-available
>
> Some parts are missing in the Chinese translation of the features document.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-2337) Update documentation about event streaming

2024-02-21 Thread Wilfred Spiegelenburg (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wilfred Spiegelenburg resolved YUNIKORN-2337.
-
Fix Version/s: 1.5.0
   Resolution: Fixed

New REST API end point added to the docs

> Update documentation about event streaming
> --
>
> Key: YUNIKORN-2337
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2337
> Project: Apache YuniKorn
>  Issue Type: Sub-task
>Reporter: Peter Bacsko
>Assignee: Peter Bacsko
>Priority: Major
>  Labels: pull-request-available
> Fix For: 1.5.0
>
>
> Update the docs about the new REST endpoint and possible config entries 
> (concurrent streaming limits).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2438) Bundle third-party licenses into yunikorn-k8shim Docker images

2024-02-21 Thread Craig Condit (Jira)
Craig Condit created YUNIKORN-2438:
--

 Summary: Bundle third-party licenses into yunikorn-k8shim Docker 
images
 Key: YUNIKORN-2438
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2438
 Project: Apache YuniKorn
  Issue Type: Sub-task
  Components: shim - kubernetes
Reporter: Craig Condit
Assignee: Craig Condit






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2437) Bundle third-party licenses into yunikorn-web Docker image

2024-02-21 Thread Craig Condit (Jira)
Craig Condit created YUNIKORN-2437:
--

 Summary: Bundle third-party licenses into yunikorn-web Docker image
 Key: YUNIKORN-2437
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2437
 Project: Apache YuniKorn
  Issue Type: Sub-task
  Components: webapp
Reporter: Craig Condit
Assignee: Craig Condit






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2436) Add third-party license information for yunikorn-web (js)

2024-02-21 Thread Craig Condit (Jira)
Craig Condit created YUNIKORN-2436:
--

 Summary: Add third-party license information for yunikorn-web (js)
 Key: YUNIKORN-2436
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2436
 Project: Apache YuniKorn
  Issue Type: Sub-task
  Components: webapp
Reporter: Craig Condit
Assignee: Craig Condit






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2435) Add third-party license information for yunikorn-web (go)

2024-02-21 Thread Craig Condit (Jira)
Craig Condit created YUNIKORN-2435:
--

 Summary: Add third-party license information for yunikorn-web (go)
 Key: YUNIKORN-2435
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2435
 Project: Apache YuniKorn
  Issue Type: Sub-task
Reporter: Craig Condit
Assignee: Craig Condit






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2434) Add third-party license information for yunikorn-k8shim

2024-02-21 Thread Craig Condit (Jira)
Craig Condit created YUNIKORN-2434:
--

 Summary: Add third-party license information for yunikorn-k8shim
 Key: YUNIKORN-2434
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2434
 Project: Apache YuniKorn
  Issue Type: Sub-task
Reporter: Craig Condit






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2433) Add third-party license information for yunikorn-core

2024-02-21 Thread Craig Condit (Jira)
Craig Condit created YUNIKORN-2433:
--

 Summary: Add third-party license information for yunikorn-core
 Key: YUNIKORN-2433
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2433
 Project: Apache YuniKorn
  Issue Type: Sub-task
Reporter: Craig Condit
Assignee: Craig Condit






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2432) Add unit test coverage for UserTracker/GroupTracker/QueueTracker.canRunApp()

2024-02-21 Thread Peter Bacsko (Jira)
Peter Bacsko created YUNIKORN-2432:
--

 Summary: Add unit test coverage for 
UserTracker/GroupTracker/QueueTracker.canRunApp()
 Key: YUNIKORN-2432
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2432
 Project: Apache YuniKorn
  Issue Type: Sub-task
  Components: core - scheduler
Reporter: Peter Bacsko
Assignee: Peter Bacsko


Currently, there is no direct coverage of {{QueueTracker.canRunApp()}}. 
Although the method is tested indirectly from {{manager_test.go}}, it's 
desirable to provide proper coverage directly from {{queue_tracker_test.go}}.

User/GroupTracker code can be expanded with smaller tests too, which validate 
that the proper arguments are passed to the underlying QueueTracker object.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2431) Add third-party license information for yunikorn-scheduler-interface

2024-02-21 Thread Craig Condit (Jira)
Craig Condit created YUNIKORN-2431:
--

 Summary: Add third-party license information for 
yunikorn-scheduler-interface
 Key: YUNIKORN-2431
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2431
 Project: Apache YuniKorn
  Issue Type: Sub-task
  Components: scheduler-interface
Reporter: Craig Condit






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2430) [UMBRELLA] Third-party license attribution

2024-02-21 Thread Craig Condit (Jira)
Craig Condit created YUNIKORN-2430:
--

 Summary: [UMBRELLA] Third-party license attribution
 Key: YUNIKORN-2430
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2430
 Project: Apache YuniKorn
  Issue Type: Improvement
  Components: core - common, scheduler-interface, shim - kubernetes, 
webapp
Reporter: Craig Condit
Assignee: Craig Condit


Currently, we do not include license files from third-party components. As some 
licenses require attribution, we should include the correct license files from 
components we depend on.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2429) Enhance UGM Manager test coverage

2024-02-21 Thread Peter Bacsko (Jira)
Peter Bacsko created YUNIKORN-2429:
--

 Summary: Enhance UGM Manager test coverage
 Key: YUNIKORN-2429
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2429
 Project: Apache YuniKorn
  Issue Type: Sub-task
  Components: core - scheduler
Reporter: Peter Bacsko


During the review of YUNIKORN-2116, we noticed that a certain mistake was made 
in {{clearEarlierSetUserWildCardLimits()}}, but it was not caught by the unit 
tests.

Ensure proper coverage to verify configuration update.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-2403) Update golang.org/x/net and golang.org/x/time

2024-02-21 Thread Chia-Ping Tsai (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chia-Ping Tsai resolved YUNIKORN-2403.
--
Resolution: Fixed

resolve it again since https://issues.apache.org/jira/browse/YUNIKORN-2416 will 
be the following-up :)

> Update golang.org/x/net and golang.org/x/time
> -
>
> Key: YUNIKORN-2403
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2403
> Project: Apache YuniKorn
>  Issue Type: Improvement
>Reporter: Chia-Ping Tsai
>Assignee: Kuan-Po Tseng
>Priority: Major
>  Labels: core, pull-request-available
> Fix For: 1.5.0
>
>
> golang.org/x/net v0.20.0 -> v0.21.0
> golang.org/x/time v0.3.0 -> v0.5.0



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-2427) Use r-lock instead of rw-lock in user_tracker.go#getGroupForApp

2024-02-21 Thread Manikandan R (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Manikandan R resolved YUNIKORN-2427.

Fix Version/s: 1.5.0
   Resolution: Fixed

Merged to master

> Use r-lock instead of rw-lock in user_tracker.go#getGroupForApp 
> 
>
> Key: YUNIKORN-2427
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2427
> Project: Apache YuniKorn
>  Issue Type: Improvement
>Reporter: Chia-Ping Tsai
>Assignee: Yu-Lin Chen
>Priority: Minor
>  Labels: pull-request-available
> Fix For: 1.5.0
>
>
> see 
> https://github.com/apache/yunikorn-core/blob/master/pkg/scheduler/ugm/user_tracker.go#L103
> The function mutate nothing, so it is safe to use r-lock.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-2412) Avoid returning potential nil in handlers.go

2024-02-21 Thread Chia-Ping Tsai (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chia-Ping Tsai resolved YUNIKORN-2412.
--
Fix Version/s: 1.5.0
   Resolution: Fixed

> Avoid returning potential nil in handlers.go
> 
>
> Key: YUNIKORN-2412
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2412
> Project: Apache YuniKorn
>  Issue Type: Improvement
>Reporter: Ryan Lo
>Assignee: Ryan Lo
>Priority: Major
>  Labels: pull-request-available
> Fix For: 1.5.0
>
>
> Issue split from YUNIKORN-2404
> Check if there are still API endpoints return null, and replace it with an 
> empty collection.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-1544) [Umbrella] User and group quota enforcement - Phase 2

2024-02-21 Thread Manikandan R (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Manikandan R resolved YUNIKORN-1544.

Resolution: Fixed

> [Umbrella] User and group quota enforcement - Phase 2
> -
>
> Key: YUNIKORN-1544
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1544
> Project: Apache YuniKorn
>  Issue Type: Improvement
>Reporter: Manikandan R
>Assignee: Manikandan R
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-2428) [Umbrella] User and group quota enforcement - Phase 3

2024-02-21 Thread Manikandan R (Jira)
Manikandan R created YUNIKORN-2428:
--

 Summary: [Umbrella] User and group quota enforcement - Phase 3
 Key: YUNIKORN-2428
 URL: https://issues.apache.org/jira/browse/YUNIKORN-2428
 Project: Apache YuniKorn
  Issue Type: Improvement
  Components: core - scheduler
Reporter: Manikandan R
Assignee: Manikandan R






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org