[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.002.patch > Capacity Scheduler Intra-queue Preemption should be configurable for each

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16357353#comment-16357353 ] Eric Payne commented on YARN-7813: -- Thanks @jlowe for the comments! I'm attaching a new p

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.002.branch-3.0.patch > Capacity Scheduler Intra-queue Preemption should be configurab

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16362674#comment-16362674 ] Eric Payne commented on YARN-7813: -- Thanks [~jlowe]. I committed to trunk and branch-3.1.

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.003.branch-3.0.patch > Capacity Scheduler Intra-queue Preemption should be configurab

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16363207#comment-16363207 ] Eric Payne commented on YARN-7813: -- I was checking failed unit tests for {{YARN-7813.002.b

[jira] [Created] (YARN-7927) YARN-7813 caused test failure in TestRMWebServicesSchedulerActivities

Eric Payne created YARN-7927: Summary: YARN-7813 caused test failure in TestRMWebServicesSchedulerActivities Key: YARN-7927 URL: https://issues.apache.org/jira/browse/YARN-7927 Project: Hadoop YARN

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.003.branch-2.patch > Capacity Scheduler Intra-queue Preemption should be configurable

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364217#comment-16364217 ] Eric Payne commented on YARN-7813: -- {code:java} Removing intermediate container 0bc484afac

[jira] [Updated] (YARN-7927) TestRMWebServicesSchedulerActivities is failing

[ https://issues.apache.org/jira/browse/YARN-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7927: - Attachment: YARN-7927.001.patch > TestRMWebServicesSchedulerActivities is failing > ---

[jira] [Commented] (YARN-7927) TestRMWebServicesSchedulerActivities is failing

[ https://issues.apache.org/jira/browse/YARN-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364556#comment-16364556 ] Eric Payne commented on YARN-7927: -- {{TestCapacitySchedulerAutoCreatedQueuePreemption}} ma

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364766#comment-16364766 ] Eric Payne commented on YARN-7813: -- I reverted the checkins for trunk, branch-3.1, and bra

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.004.patch > Capacity Scheduler Intra-queue Preemption should be configurable for each

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365044#comment-16365044 ] Eric Payne commented on YARN-7813: -- {{YARN-7813.004.patch}} should address the failures.

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.005.patch > Capacity Scheduler Intra-queue Preemption should be configurable for each

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16366151#comment-16366151 ] Eric Payne commented on YARN-7813: -- Attached {{YARN-7813.005.patch}}. If the pre-commit pa

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.005.branch-3.0.patch > Capacity Scheduler Intra-queue Preemption should be configurab

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.005.branch-2.8.patch > Capacity Scheduler Intra-queue Preemption should be configurab

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367867#comment-16367867 ] Eric Payne commented on YARN-7813: -- {{YARN-7813.005.patch}} - This patch backports to 3.1

[jira] [Created] (YARN-7947) Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps

Eric Payne created YARN-7947: Summary: Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps Key: YARN-7947 URL: https://issues.apache.org/jira/browse/YARN-7947 Project: Hadoop YARN

[jira] [Commented] (YARN-7947) Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps

[ https://issues.apache.org/jira/browse/YARN-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369531#comment-16369531 ] Eric Payne commented on YARN-7947: -- YARN-7051 added the following code. Instead of passing

[jira] [Comment Edited] (YARN-7947) Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps

[ https://issues.apache.org/jira/browse/YARN-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369531#comment-16369531 ] Eric Payne edited comment on YARN-7947 at 2/19/18 9:29 PM: --- YARN-

[jira] [Assigned] (YARN-7947) Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps

[ https://issues.apache.org/jira/browse/YARN-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-7947: Assignee: Eric Payne > Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps >

[jira] [Updated] (YARN-7947) Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps

[ https://issues.apache.org/jira/browse/YARN-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7947: - Attachment: YARN-7947.001.patch > Capacity Scheduler intra-queue preemption can NPE for non-schedulable app

[jira] [Commented] (YARN-7947) Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps

[ https://issues.apache.org/jira/browse/YARN-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371520#comment-16371520 ] Eric Payne commented on YARN-7947: -- Great! Thanks a lot, [~sunilg] > Capacity Scheduler i

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371523#comment-16371523 ] Eric Payne commented on YARN-7813: -- Awesome! Thanks [~jlowe] > Capacity Scheduler Intra-q

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16382847#comment-16382847 ] Eric Payne commented on YARN-4781: -- A lot has happened since this JIRA was opened, but I t

[jira] [Comment Edited] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16382847#comment-16382847 ] Eric Payne edited comment on YARN-4781 at 3/1/18 11:24 PM: --- A lot

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383904#comment-16383904 ] Eric Payne commented on YARN-4781: -- My thinking on a solution to this would be to check in

[jira] [Updated] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4781: - Attachment: YARN-4781.001.patch > Support intra-queue preemption for fairness ordering policy. > --

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388701#comment-16388701 ] Eric Payne commented on YARN-4781: -- bq.I have a patch coded up if you would be interested.

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389649#comment-16389649 ] Eric Payne commented on YARN-4781: -- Thanks a lot for the review [~sunilg]. {quote} my conc

[jira] [Commented] (YARN-8009) YARN limit number of simultaneously running containers in the application level

[ https://issues.apache.org/jira/browse/YARN-8009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391504#comment-16391504 ] Eric Payne commented on YARN-8009: -- [~sachinjose2...@gmail.com], this property is a per-fr

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391802#comment-16391802 ] Eric Payne commented on YARN-4606: -- [~maniraj...@gmail.com], thank you for the patch. The

[jira] [Updated] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8025: - Description: UsersManangers#getComputedResourceLimitForActiveUsers throws NPE when I run SLS. *preComputed

[jira] [Updated] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8025: - Environment: (was: UsersManangers#getComputedResourceLimitForActiveUsers throws NPE when I run SLS. *

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396094#comment-16396094 ] Eric Payne commented on YARN-4606: -- bq. resources are not assigned to the second app when

[jira] [Commented] (YARN-8020) when DRF is used, preemption does not trigger due to incorrect idealAssigned

[ https://issues.apache.org/jira/browse/YARN-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16397262#comment-16397262 ] Eric Payne commented on YARN-8020: -- [~kyungwan nam], on what version of YARN are you seein

[jira] [Commented] (YARN-8020) when DRF is used, preemption does not trigger due to incorrect idealAssigned

[ https://issues.apache.org/jira/browse/YARN-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398575#comment-16398575 ] Eric Payne commented on YARN-8020: -- bq. explain why preemption doesn't happen for the case

[jira] [Updated] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4781: - Attachment: YARN-4781.002.patch > Support intra-queue preemption for fairness ordering policy. > --

[jira] [Commented] (YARN-8020) when DRF is used, preemption does not trigger due to incorrect idealAssigned

[ https://issues.apache.org/jira/browse/YARN-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405166#comment-16405166 ] Eric Payne commented on YARN-8020: -- [~leftnoteasy], sorry for the delay. {quote}explain wh

[jira] [Commented] (YARN-5973) TestCapacitySchedulerSurgicalPreemption sometimes fails

[ https://issues.apache.org/jira/browse/YARN-5973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16407979#comment-16407979 ] Eric Payne commented on YARN-5973: -- Thanks [~dibyendu_hadoop] for working on the patch for

[jira] [Commented] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16414654#comment-16414654 ] Eric Payne commented on YARN-7249: -- {quote}we hit this issue on branch-2.7. Can we cherry-

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16422631#comment-16422631 ] Eric Payne commented on YARN-4606: -- {quote}AM container is being allocated to App2 only af

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16423059#comment-16423059 ] Eric Payne commented on YARN-4606: -- {code:title=AppSchedulingInfo#updatePendingResources}

[jira] [Updated] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4781: - Attachment: YARN-4781.003.patch > Support intra-queue preemption for fairness ordering policy. > --

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424281#comment-16424281 ] Eric Payne commented on YARN-4781: -- Thanks very much [~sunilg] for the review. {quote}Fair

[jira] [Updated] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5889: - Attachment: YARN-5889.0001.suggested.patchnotes Thanks [~sunilg] for providing this work. I am concerned a

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812128#comment-15812128 ] Eric Payne commented on YARN-5889: -- bq. Since number of active users are changed, we need

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812251#comment-15812251 ] Eric Payne commented on YARN-5889: -- Thanks [~leftnoteasy] for your review and comments. b

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812737#comment-15812737 ] Eric Payne commented on YARN-5889: -- [~sunilg], bq. However, I do think {{reComputeUserLimi

[jira] [Commented] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15819338#comment-15819338 ] Eric Payne commented on YARN-6081: -- Thanks [~leftnoteasy] for fixing this. I am reviewing

[jira] [Commented] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15819452#comment-15819452 ] Eric Payne commented on YARN-6081: -- +1 LGTM. The failed test ({{TestRMRestart}}) is not re

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15819482#comment-15819482 ] Eric Payne commented on YARN-5889: -- [~sunilg], - Shoule {{resetUserAddedOrRemoved}} just b

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829005#comment-15829005 ] Eric Payne commented on YARN-5889: -- [~leftnoteasy] and [~sunilg], I'm sorry for coming bac

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830149#comment-15830149 ] Eric Payne commented on YARN-5889: -- [~leftnoteasy], the crux of the problem is that if MUL

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830384#comment-15830384 ] Eric Payne commented on YARN-5889: -- bq. the user limit resource is never calculated to be

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832068#comment-15832068 ] Eric Payne commented on YARN-5889: -- bq. it never gets above {{queue-capacity * MULP}} [~su

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836712#comment-15836712 ] Eric Payne commented on YARN-5889: -- bq. LQ#allocateResource will invoke UM#User#assignCont

[jira] [Assigned] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-5892: Assignee: Eric Payne > Capacity Scheduler: Support user-specific minimum user limit percent > --

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15852243#comment-15852243 ] Eric Payne commented on YARN-5889: -- Thanks [~sunilg] and [~leftnoteasy] for your work on t

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15852845#comment-15852845 ] Eric Payne commented on YARN-5889: -- bq. resources are not recorded for that user about hal

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15854640#comment-15854640 ] Eric Payne commented on YARN-5889: -- [~sunilg], Thanks for running those manual tests. Thos

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15855123#comment-15855123 ] Eric Payne commented on YARN-5889: -- OK. Latest patch looks good. [~sunilg], [~leftnoteasy

[jira] [Commented] (YARN-6152) Used queue percentage not accurate in UI for 2.7 and below when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-6152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856203#comment-15856203 ] Eric Payne commented on YARN-6152: -- Thanks [~jhung], I will review today. > Used queue pe

[jira] [Commented] (YARN-6152) Used queue percentage not accurate in UI for 2.7 and below when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-6152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856365#comment-15856365 ] Eric Payne commented on YARN-6152: -- The patch LGTM. +1 The unit test failures are unrelat

[jira] [Updated] (YARN-6152) Used queue percentage not accurate in UI for 2.7 and below when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-6152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6152: - Fix Version/s: 2.7.4 > Used queue percentage not accurate in UI for 2.7 and below when using > DominantRes

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856400#comment-15856400 ] Eric Payne commented on YARN-5889: -- [~leftnoteasy] bq. Since we're close to 2.8 release no

[jira] [Created] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

Eric Payne created YARN-6165: Summary: Intra-queue preemption occurs even when preemption is turned off for a specific queue. Key: YARN-6165 URL: https://issues.apache.org/jira/browse/YARN-6165 Project: H

[jira] [Commented] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859987#comment-15859987 ] Eric Payne commented on YARN-6165: -- Use Case: - Configure queues with cluster-wide preempt

[jira] [Assigned] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-6165: Assignee: Eric Payne > Intra-queue preemption occurs even when preemption is turned off for a > spe

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.001.patch Attaching first draft of the patch. I still need to make the user-specific

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.002.patch Uploading new patch to address the javadoc and findbug warnings. I also mo

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15882720#comment-15882720 ] Eric Payne commented on YARN-5892: -- Thanks, [~leftnoteasy], for your feedback. I really va

[jira] [Created] (YARN-6248) Killing an app with pending container requests leaves the user in UsersManager

Eric Payne created YARN-6248: Summary: Killing an app with pending container requests leaves the user in UsersManager Key: YARN-6248 URL: https://issues.apache.org/jira/browse/YARN-6248 Project: Hadoop YA

[jira] [Updated] (YARN-6248) Killing an app with pending container requests leaves the user in UsersManager

[ https://issues.apache.org/jira/browse/YARN-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6248: - Attachment: User Left Over.jpg > Killing an app with pending container requests leaves the user in UsersMan

[jira] [Updated] (YARN-6248) Killing an app with pending container requests leaves the user in UsersManager

[ https://issues.apache.org/jira/browse/YARN-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6248: - Attachment: YARN-6248.001.patch Uploading patch. [~sunilg] and [~leftnoteasy], can you please have a look?

[jira] [Commented] (YARN-6248) Killing an app with pending container requests leaves the user in UsersManager

[ https://issues.apache.org/jira/browse/YARN-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15890386#comment-15890386 ] Eric Payne commented on YARN-6248: -- The above Unit tests ({{TestLeaderElectorService,Test

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891256#comment-15891256 ] Eric Payne commented on YARN-5892: -- {quote} So I preferred to keep the semantic more simil

[jira] [Commented] (YARN-6248) Killing an app with pending container requests leaves the user in UsersManager

[ https://issues.apache.org/jira/browse/YARN-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15894464#comment-15894464 ] Eric Payne commented on YARN-6248: -- bq. yes. looks fine. if there are no other major conce

[jira] [Updated] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6165: - Attachment: YARN-6165.001.patch {{IntraQueueCandidatesSelector#selectCandidates}} was not checking the ena

[jira] [Commented] (YARN-6248) user is not removed from UsersManager’s when app is killed with pending container requests.

[ https://issues.apache.org/jira/browse/YARN-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896002#comment-15896002 ] Eric Payne commented on YARN-6248: -- Thank you [~sunilg] > user is not removed from UsersM

[jira] [Commented] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901886#comment-15901886 ] Eric Payne commented on YARN-6165: -- bq. I think patch looks fine for me. Thanks [~sunilg]

[jira] [Commented] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901921#comment-15901921 ] Eric Payne commented on YARN-6165: -- bq. this needs a Jenkins run anyway Thanks [~jlowe]. I

[jira] [Commented] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903349#comment-15903349 ] Eric Payne commented on YARN-6165: -- Thanks Jason and Sunil. > Intra-queue preemption occu

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: Active users highlighted.jpg > Capacity Scheduler: Support user-specific minimum user limit per

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.003.patch Thanks [~leftnoteasy] and [~sunilg] for the reviews and valuable feedback.

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925012#comment-15925012 ] Eric Payne commented on YARN-5892: -- Thanks a lot, [~leftnoteasy], for your comments. bq. 1

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.004.patch Attaching new patch to address findbugs/checkstyle/compile/mvnsite issues.

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.005.patch The previous patch ({{004}}) only updated users' weights when each user was

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930339#comment-15930339 ] Eric Payne commented on YARN-2113: -- Hi [~sunilg]. Thanks for this patch. I'm excited to lo

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939235#comment-15939235 ] Eric Payne commented on YARN-5892: -- Thanks for your comments, [~sunilg]. bq. Is it possibl

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.006.patch Thanks for your helpful comments [~leftnoteasy] and [~sunilg]. I am attachi

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941759#comment-15941759 ] Eric Payne commented on YARN-2113: -- bq. as of now, YARN doesn't calculate UL for different

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951222#comment-15951222 ] Eric Payne commented on YARN-2113: -- Thanks [~sunilg] for the updated patch. It looks good

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: TestNoIntraQueuePreemptionIfBelowUserLimitAndDifferentPrioritiesWithExtraUsers.txt > Add cross

[jira] [Commented] (YARN-6354) LeveldbRMStateStore can parse invalid keys when recovering reservations

[ https://issues.apache.org/jira/browse/YARN-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951352#comment-15951352 ] Eric Payne commented on YARN-6354: -- +1. Thanks [~jlowe]. I will merge to trunk, branch-2,

[jira] [Commented] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621254#comment-16621254 ] Eric Payne commented on YARN-8774: -- Thanks [~Tao Yang] for reporting this issue and provi

[jira] [Commented] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622323#comment-16622323 ] Eric Payne commented on YARN-8774: -- [~Tao Yang], The patch and UT look good to me. Howeve

[jira] [Commented] (YARN-7225) Add queue and partition info to RM audit log

[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622458#comment-16622458 ] Eric Payne commented on YARN-7225: -- Thanks [~jhung] for raising this issue. This came up

<    7   8   9   10   11   12   13   14   15   16   >