[jira] [Resolved] (YUNIKORN-1083) Doc step for deploying admission controller in manual process

2022-03-31 Thread Anuraag Nalluri (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anuraag Nalluri resolved YUNIKORN-1083.
---
Resolution: Fixed

> Doc step for deploying admission controller in manual process
> -
>
> Key: YUNIKORN-1083
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1083
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: documentation
>Reporter: Anuraag Nalluri
>Assignee: Anuraag Nalluri
>Priority: Minor
>  Labels: pull-request-available
>
> We don't currently have documentation for deploying the admission controller 
> in the [manual 
> process|https://yunikorn.apache.org/docs/0.12.1/developer_guide/deployment/]. 
> We need to add this step so this process has parity with deploying YK via 
> helm. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-1083) Doc step for deploying admission controller in manual process

2022-02-17 Thread Anuraag Nalluri (Jira)
Anuraag Nalluri created YUNIKORN-1083:
-

 Summary: Doc step for deploying admission controller in manual 
process
 Key: YUNIKORN-1083
 URL: https://issues.apache.org/jira/browse/YUNIKORN-1083
 Project: Apache YuniKorn
  Issue Type: Task
  Components: documentation
Reporter: Anuraag Nalluri
Assignee: Anuraag Nalluri


We don't currently have documentation for deploying the admission controller in 
the [manual 
process|https://yunikorn.apache.org/docs/0.12.1/developer_guide/deployment/]. 
We need to add this step so this process has parity with deploying YK via helm. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-946) Accounting resources for deleted executor pods

2022-02-17 Thread Anuraag Nalluri (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anuraag Nalluri resolved YUNIKORN-946.
--
Resolution: Fixed

> Accounting resources for deleted executor pods
> --
>
> Key: YUNIKORN-946
> URL: https://issues.apache.org/jira/browse/YUNIKORN-946
> Project: Apache YuniKorn
>  Issue Type: Bug
>  Components: core - scheduler
>Affects Versions: 0.11
>Reporter: Ashutosh Singh
>Assignee: Anuraag Nalluri
>Priority: Critical
> Attachments: after-yunikorn-776.png, before-yunikorn-776.png, 
> image-2021-11-16-23-17-42-819.png, image-2021-11-16-23-18-28-349.png
>
>
> Even when executors are deleted, YK UI shows that resources are consumed by 
> the pod (the one which is already deleted). _kubectl get pods_  does not show 
> the executor but YK UI shows the information of a deleted pod consuming 
> resources even after few hours. 
> It results into leaking cluster resources.
> Steps:
>  # Run a spark application using k8s spark operator
>  # Wait for executors to be in running state.
>  # Delete the application using `kubectl delete sparkapplications ` 
> OR `kubectl delete {-}{{-}}f `
>  # All the driver and executor pods would be deleted. check `kubectl get pods`
>  # However, YK UI still shows some of the executors running and consuming 
> resources. It leads to leak of the resource as they are considered as used 
> and could not be used by pending pods.
> More details: 
> [https://yunikornworkspace.slack.com/archives/CLNUW68MU/p1637126093006900]
> !image-2021-11-16-23-18-28-349.png|width=534,height=323!
>  
> !image-2021-11-16-23-17-42-819.png|width=583,height=353!



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-1069) Make the state dump file's log rotation parameters configurable

2022-02-02 Thread Anuraag Nalluri (Jira)
Anuraag Nalluri created YUNIKORN-1069:
-

 Summary: Make the state dump file's log rotation parameters 
configurable
 Key: YUNIKORN-1069
 URL: https://issues.apache.org/jira/browse/YUNIKORN-1069
 Project: Apache YuniKorn
  Issue Type: Task
Reporter: Anuraag Nalluri


We need to make the state dump file's log rotation parameters (max file size, # 
of backups) configurable. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-1068) Doc changes for YUNIKORN-949

2022-02-02 Thread Anuraag Nalluri (Jira)
Anuraag Nalluri created YUNIKORN-1068:
-

 Summary: Doc changes for YUNIKORN-949
 Key: YUNIKORN-1068
 URL: https://issues.apache.org/jira/browse/YUNIKORN-1068
 Project: Apache YuniKorn
  Issue Type: Task
Reporter: Anuraag Nalluri
Assignee: Anuraag Nalluri


Need to document changes for YUNIKORN-949. Specifically, we need to document 
the new partition-level config that can be set to change the output location of 
periodic state dump. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-1030) Delay in UI "Application History" graph for running applications

2022-01-16 Thread Anuraag Nalluri (Jira)
Anuraag Nalluri created YUNIKORN-1030:
-

 Summary: Delay in UI "Application History" graph for running 
applications
 Key: YUNIKORN-1030
 URL: https://issues.apache.org/jira/browse/YUNIKORN-1030
 Project: Apache YuniKorn
  Issue Type: Bug
  Components: webapp
Reporter: Anuraag Nalluri
 Fix For: 1.0.0
 Attachments: Screen Shot 2022-01-13 at 6.59.04 PM.png

"Application History" graph in the Yunikorn UI has approximately 4-5 min. delay 
in displaying running applications compared to the "Container History" graph. 
Configuration used is in queues.yaml specified 
[here|https://yunikorn.apache.org/docs/0.8.0/setup/deployment#create-the-configmap].
  Slack conversation is 
[here|https://yunikornworkspace.slack.com/archives/CLNUW68MU/p1641612673012600].

Deploy the example sleep job (3 applications) with the above queues.yaml 
configuration to reproduce. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Created] (YUNIKORN-995) Helm installation of Yunikorn fails on Kubernetes 1.22

2022-01-05 Thread Anuraag Nalluri (Jira)
Anuraag Nalluri created YUNIKORN-995:


 Summary: Helm installation of Yunikorn fails on Kubernetes 1.22
 Key: YUNIKORN-995
 URL: https://issues.apache.org/jira/browse/YUNIKORN-995
 Project: Apache YuniKorn
  Issue Type: Bug
Reporter: Anuraag Nalluri


Here's the following kubernetes client/server info on my local machine:
{code:java}
➜  incubator-yunikorn-k8shim git:(master) ✗ kubectl version
Client Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.4", 
GitCommit:"b695d79d4f967c403a96986f1750a35eb75e75f1", GitTreeState:"clean", 
BuildDate:"2021-11-17T15:48:33Z", GoVersion:"go1.16.10", Compiler:"gc", 
Platform:"darwin/arm64"}
Server Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.4", 
GitCommit:"b695d79d4f967c403a96986f1750a35eb75e75f1", GitTreeState:"clean", 
BuildDate:"2021-11-17T15:42:41Z", GoVersion:"go1.16.10", Compiler:"gc", 
Platform:"linux/arm64"} {code}
This results in the following error when running the `helm install` command 
from the docs:
{code:java}
➜  incubator-yunikorn-k8shim git:(master) ✗ helm install yunikorn 
yunikorn/yunikorn --namespace yunikornError: INSTALLATION FAILED: failed 
pre-install: unable to build kubernetes object for deleting hook 
yunikorn/templates/rbac.yaml: unable to recognize "": no matches for kind 
"ClusterRoleBinding" in version "rbac.authorization.k8s.io/v1beta1"{code}
I believe this is because `ClusterRoleBinding` is removed from 
`rbac.authorization.k8s.io/v1beta1` as of version 1.22 of Kubernetes. We should 
instead use the following `apiVersion` for this resource in the yaml: 
`rbac.authorization.k8s.io/v1`. 

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org