[jira] [Created] (YARN-7619) Max AM Resource value in CS UI is different for every user

Eric Payne created YARN-7619: Summary: Max AM Resource value in CS UI is different for every user Key: YARN-7619 URL: https://issues.apache.org/jira/browse/YARN-7619 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-7619) Max AM Resource value in CS UI is different for every user

[ https://issues.apache.org/jira/browse/YARN-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7619: - Attachment: Max AM Resources is Different for Each User.png > Max AM Resource value in CS UI is different

[jira] [Commented] (YARN-7370) Preemption properties should be refreshable

[ https://issues.apache.org/jira/browse/YARN-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218617#comment-16218617 ] Eric Payne commented on YARN-7370: -- Thanks [~leftnoteasy] for the further design specifications. bq.

[jira] [Commented] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216867#comment-16216867 ] Eric Payne commented on YARN-6124: -- Yes, I agree that these should be part of the scheduler. That makes a

[jira] [Commented] (YARN-7370) Preemption properties should be refreshable

[ https://issues.apache.org/jira/browse/YARN-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227276#comment-16227276 ] Eric Payne commented on YARN-7370: -- [~GergelyNovak], Thanks for the updated patch. Just a couple of

[jira] [Commented] (YARN-7424) Capacity Scheduler Intra-queue preemption: add property to only preempt up to configured MULP

[ https://issues.apache.org/jira/browse/YARN-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227528#comment-16227528 ] Eric Payne commented on YARN-7424: -- In a large, multi-tenant queue with MULP of 1%, after instrumenting

[jira] [Assigned] (YARN-7424) Capacity Scheduler Intra-queue preemption: add property to only preempt up to configured MULP

[ https://issues.apache.org/jira/browse/YARN-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-7424: Assignee: Eric Payne > Capacity Scheduler Intra-queue preemption: add property to only preempt up

[jira] [Updated] (YARN-7424) Capacity Scheduler Intra-queue preemption: add property to only preempt up to configured MULP

[ https://issues.apache.org/jira/browse/YARN-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7424: - Description: If the queue's configured minimum user limit percent (MULP) is something small like 1%, all

[jira] [Created] (YARN-7424) Capacity Scheduler Intra-queue preemption: add property to only preempt up to configured MULP

Eric Payne created YARN-7424: Summary: Capacity Scheduler Intra-queue preemption: add property to only preempt up to configured MULP Key: YARN-7424 URL: https://issues.apache.org/jira/browse/YARN-7424

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466541#comment-16466541 ] Eric Payne commented on YARN-4606: -- {code:title=AppSchedulingInfo#updatePendingResources} if(!

[jira] [Commented] (YARN-8004) Add unit tests for inter queue preemption for dominant resource calculator

[ https://issues.apache.org/jira/browse/YARN-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456369#comment-16456369 ] Eric Payne commented on YARN-8004: -- bq. could i backport this to branch-2.9/2.8 as well? [~sunilg], sure

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456511#comment-16456511 ] Eric Payne commented on YARN-4781: -- bq. Sorry for the delay here Eric Payne. I will check and share my

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466136#comment-16466136 ] Eric Payne commented on YARN-4606: -- Thanks [~maniraj...@gmail.com] for your consistent and continuing

[jira] [Updated] (YARN-8248) Job hangs when queue is specified and that queue has 0 capability of a resource

[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8248: - Component/s: yarn fairscheduler > Job hangs when queue is specified and that queue has 0

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16477674#comment-16477674 ] Eric Payne commented on YARN-8292: -- Thanks [~ssath...@hortonworks.com] and [~leftnoteasy].

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482689#comment-16482689 ] Eric Payne commented on YARN-8292: -- Thanks [~leftnoteasy] for your work on this issue. - I don't think

[jira] [Commented] (YARN-8179) Preemption does not happen due to natural_termination_factor when DRF is used

[ https://issues.apache.org/jira/browse/YARN-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482841#comment-16482841 ] Eric Payne commented on YARN-8179: -- [~kyungwan nam], I am really sorry for the long delay, and I'm also

[jira] [Commented] (YARN-8179) Preemption does not happen due to natural_termination_factor when DRF is used

[ https://issues.apache.org/jira/browse/YARN-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482855#comment-16482855 ] Eric Payne commented on YARN-8179: -- {quote}Can we please change the {{newInstance}} call to

[jira] [Comment Edited] (YARN-8179) Preemption does not happen due to natural_termination_factor when DRF is used

[ https://issues.apache.org/jira/browse/YARN-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482841#comment-16482841 ] Eric Payne edited comment on YARN-8179 at 5/21/18 6:22 PM: --- [~kyungwan nam]-, I

[jira] [Commented] (YARN-8179) Preemption does not happen due to natural_termination_factor when DRF is used

[ https://issues.apache.org/jira/browse/YARN-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483046#comment-16483046 ] Eric Payne commented on YARN-8179: -- Committed to trunk, branch-3.1, and branch-3.0. Thanks for the good

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16484257#comment-16484257 ] Eric Payne commented on YARN-8292: -- {quote}Actually this is required after the change. {quote} Yes, I see

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487902#comment-16487902 ] Eric Payne commented on YARN-4781: -- bq. FairOrdering policy could be used with weights? [~sunilg], the

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490886#comment-16490886 ] Eric Payne commented on YARN-8292: -- +1. Unless there are addition comments, I[ll commit today. > Fix the

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489070#comment-16489070 ] Eric Payne commented on YARN-8292: -- [~leftnoteasy], thanks for the new patch. - In the following

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479599#comment-16479599 ] Eric Payne commented on YARN-8292: -- Thanks for the updated patch, [~leftnoteasy]. The changes seem to be

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16478157#comment-16478157 ] Eric Payne commented on YARN-8292: -- bq. you can check

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16478184#comment-16478184 ] Eric Payne commented on YARN-4781: -- Hi [~sunilg]. Will you have an opportunity to review the latest patch?

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16478000#comment-16478000 ] Eric Payne commented on YARN-8292: -- {quote} ||Queue||Guaranteed||Used ||Pending|| |A|<20, 10>|<20,30>| |

[jira] [Commented] (YARN-8379) Add an option to allow Capacity Scheduler preemption to balance satisfied queues

[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503282#comment-16503282 ] Eric Payne commented on YARN-8379: -- Thanks [~Zian Chen] for working on this and providing an initial

[jira] [Commented] (YARN-8379) Add an option to allow Capacity Scheduler preemption to balance satisfied queues

[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504630#comment-16504630 ] Eric Payne commented on YARN-8379: -- {quote} Why is this a preemption only concept? To avoid unnecessary

[jira] [Commented] (YARN-8379) Add an option to allow Capacity Scheduler preemption to balance satisfied queues

[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509992#comment-16509992 ] Eric Payne commented on YARN-8379: -- [~Zian Chen], I will review the patch but it may take a couple of

[jira] [Commented] (YARN-8379) Add an option to allow Capacity Scheduler preemption to balance satisfied queues

[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511469#comment-16511469 ] Eric Payne commented on YARN-8379: -- [~Zian Chen], thank you for the work on this issue and for the new

[jira] [Updated] (YARN-8379) Add an option to allow Capacity Scheduler preemption to balance satisfied queues

[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8379: - Attachment: ericpayne.confs.tgz > Add an option to allow Capacity Scheduler preemption to balance

[jira] [Commented] (YARN-8379) Add an option to allow Capacity Scheduler preemption to balance satisfied queues

[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511694#comment-16511694 ] Eric Payne commented on YARN-8379: -- [~Zian Chen], I attached the confs I used to create my pseudo

[jira] [Resolved] (YARN-8425) Yarn container getting killed due to running beyond physical memory limits

[ https://issues.apache.org/jira/browse/YARN-8425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-8425. -- Resolution: Not A Bug > Yarn container getting killed due to running beyond physical memory limits >

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517557#comment-16517557 ] Eric Payne commented on YARN-4606: -- I put this Jira into PATCH AVAILABLE mode so that it would kick the

[jira] [Commented] (YARN-8377) Javadoc build failed in hadoop-yarn-server-nodemanager

[ https://issues.apache.org/jira/browse/YARN-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16495410#comment-16495410 ] Eric Payne commented on YARN-8377: -- Thanks a lot, [~tasanuma0829] for tracking this all down and

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16495656#comment-16495656 ] Eric Payne commented on YARN-4606: -- [~maniraj...@gmail.com], do you have a status on updating this patch?

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497232#comment-16497232 ] Eric Payne commented on YARN-4606: -- Thanks [~maniraj...@gmail.com] for the updated patch. Here are my

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498517#comment-16498517 ] Eric Payne commented on YARN-4781: -- bq. Thank you. I ll commit this to branch-2 shortly. Thanks

[jira] [Updated] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4781: - Attachment: YARN-4781.005.branch-2.patch > Support intra-queue preemption for fairness ordering policy. >

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493761#comment-16493761 ] Eric Payne commented on YARN-4781: -- Thanks a lot [~sunilg]! I attached patch

[jira] [Commented] (YARN-8379) Add an option to allow Capacity Scheduler preemption to balance satisfied queues

[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496715#comment-16496715 ] Eric Payne commented on YARN-8379: -- Thanks [~leftnoteasy] for bringing this up. Yes, our use case would

[jira] [Commented] (YARN-8444) NodeResourceMonitor crashes on bad swapFree value

[ https://issues.apache.org/jira/browse/YARN-8444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520597#comment-16520597 ] Eric Payne commented on YARN-8444: -- Thanks [~Jim_Brennan] for the work on this JIRA. +1. I will commit

[jira] [Updated] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4606: - Attachment: YARN-4606.POC.3.patch > CapacityScheduler: applications could get starved because computation

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520822#comment-16520822 ] Eric Payne commented on YARN-4606: -- [~maniraj...@gmail.com], we can fix the queue application starvation

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522811#comment-16522811 ] Eric Payne commented on YARN-4606: -- {quote}At the same time, this patch is less "strict" in terms of

[jira] [Commented] (YARN-8379) Add an option to allow Capacity Scheduler preemption to balance satisfied queues

[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523691#comment-16523691 ] Eric Payne commented on YARN-8379: -- [~Zian Chen] , I probably won't be able to get to this for a couple

[jira] [Updated] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4781: - Attachment: YARN-4781.005.patch > Support intra-queue preemption for fairness ordering policy. >

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459919#comment-16459919 ] Eric Payne commented on YARN-4781: -- I missed one of the two places that needed a check for

[jira] [Comment Edited] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459919#comment-16459919 ] Eric Payne edited comment on YARN-4781 at 5/1/18 6:04 PM: -- I missed one of the two

[jira] [Commented] (YARN-8179) Preemption does not happen due to natural_termination_factor when DRF is used

[ https://issues.apache.org/jira/browse/YARN-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458804#comment-16458804 ] Eric Payne commented on YARN-8179: -- [~kyungwan nam], thanks for the new patch. +1 > Preemption does not

[jira] [Commented] (YARN-8179) Preemption does not happen due to natural_termination_factor when DRF is used

[ https://issues.apache.org/jira/browse/YARN-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463041#comment-16463041 ] Eric Payne commented on YARN-8179: -- [~sunilg], if there is no objection, I'll commit this tomorrow. >

[jira] [Commented] (YARN-7370) Intra-queue preemption properties should be refreshable

[ https://issues.apache.org/jira/browse/YARN-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212646#comment-16212646 ] Eric Payne commented on YARN-7370: -- [~GergelyNovak], thank you for your interest. Please go ahead and take

[jira] [Commented] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220844#comment-16220844 ] Eric Payne commented on YARN-6124: -- Thanks [~leftnoteasy]. The proof of concept looks good, but in this

[jira] [Commented] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221064#comment-16221064 ] Eric Payne commented on YARN-6124: -- Thanks [~leftnoteasy]. I will document my findings and you can work on

[jira] [Commented] (YARN-4163) Audit getQueueInfo and getApplications calls

[ https://issues.apache.org/jira/browse/YARN-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215426#comment-16215426 ] Eric Payne commented on YARN-4163: -- Thanks [~jlowe] and [~lichangleo]. I will commit this to trunk,

[jira] [Updated] (YARN-4163) Audit getQueueInfo and getApplications calls

[ https://issues.apache.org/jira/browse/YARN-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4163: - Attachment: YARN-4163.007.branch-2.8.patch Attach branch-2.8 specific patch > Audit getQueueInfo and

[jira] [Commented] (YARN-7370) Preemption properties should be refreshable

[ https://issues.apache.org/jira/browse/YARN-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222830#comment-16222830 ] Eric Payne commented on YARN-7370: -- Thanks [~GergelyNovak] for the work on this patch. I just have a

[jira] [Commented] (YARN-7619) Max AM Resource value in CS UI is different for every user

[ https://issues.apache.org/jira/browse/YARN-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16312057#comment-16312057 ] Eric Payne commented on YARN-7619: -- Hi [~sunilg]. Thanks again for the reviews and suggestions. FYI, These

[jira] [Commented] (YARN-7619) Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user

[ https://issues.apache.org/jira/browse/YARN-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313197#comment-16313197 ] Eric Payne commented on YARN-7619: -- Thanks very much [~sunilg]. > Max AM Resource value in Capacity

[jira] [Created] (YARN-7728) Expose and expand container preemptions in Capacity Scheduler queue metrics

Eric Payne created YARN-7728: Summary: Expose and expand container preemptions in Capacity Scheduler queue metrics Key: YARN-7728 URL: https://issues.apache.org/jira/browse/YARN-7728 Project: Hadoop YARN

[jira] [Resolved] (YARN-7424) Capacity Scheduler Intra-queue preemption: add property to only preempt up to configured MULP

[ https://issues.apache.org/jira/browse/YARN-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-7424. -- Resolution: Invalid bq. In order to create the "desired" behavior, we would have to fundamentally

[jira] [Commented] (YARN-7728) Expose and expand container preemptions in Capacity Scheduler queue metrics

[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16327877#comment-16327877 ] Eric Payne commented on YARN-7728: -- Hi [~sunilg]. Did you have a chance to review my comments and the new

[jira] [Commented] (YARN-7728) Expose and expand container preemptions in Capacity Scheduler queue metrics

[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338202#comment-16338202 ] Eric Payne commented on YARN-7728: -- {quote}I am fine with latest patch. If no issues, I could commit this

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338321#comment-16338321 ] Eric Payne commented on YARN-7813: -- A grid administrator should be able to configure queues as follows.

[jira] [Created] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

Eric Payne created YARN-7813: Summary: Capacity Scheduler Intra-queue Preemption should be configurable for each queue Key: YARN-7813 URL: https://issues.apache.org/jira/browse/YARN-7813 Project: Hadoop

[jira] [Commented] (YARN-7728) Expose container preemptions related information in Capacity Scheduler queue metrics

[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341223#comment-16341223 ] Eric Payne commented on YARN-7728: -- Regarding test failures: {{TestRMWebServiceAppsNodelabel}} fails in

[jira] [Updated] (YARN-7728) Expose container preemptions related information in Capacity Scheduler queue metrics

[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7728: - Attachment: YARN-7728.branch-2.8.002.patch > Expose container preemptions related information in Capacity

[jira] [Commented] (YARN-7728) Expose and expand container preemptions in Capacity Scheduler queue metrics

[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324165#comment-16324165 ] Eric Payne commented on YARN-7728: -- Thanks a lot for the comments, [~sunilg]. bq. n 3.0, we support

[jira] [Updated] (YARN-7728) Expose and expand container preemptions in Capacity Scheduler queue metrics

[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7728: - Attachment: YARN-7728.002.patch > Expose and expand container preemptions in Capacity Scheduler queue

[jira] [Updated] (YARN-7728) Expose and expand container preemptions in Capacity Scheduler queue metrics

[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7728: - Attachment: YARN-7728.001.patch > Expose and expand container preemptions in Capacity Scheduler queue

[jira] [Commented] (YARN-7728) Expose container preemptions related information in Capacity Scheduler queue metrics

[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345383#comment-16345383 ] Eric Payne commented on YARN-7728: -- Hi [~sunilg]. Will you have a chance to look at the 2.8 backport in

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347209#comment-16347209 ] Eric Payne commented on YARN-4606: -- Thanks everyone for the thoughtful analysis. I am still analyzing in

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347329#comment-16347329 ] Eric Payne commented on YARN-4606: -- My understanding is that user limit would use {{activeUsers}} and

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.002.patch > Capacity Scheduler Intra-queue Preemption should be configurable for

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357353#comment-16357353 ] Eric Payne commented on YARN-7813: -- Thanks @jlowe for the comments! I'm attaching a new patch that

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.001.patch > Capacity Scheduler Intra-queue Preemption should be configurable for

[jira] [Commented] (YARN-7728) Expose container preemptions related information in Capacity Scheduler queue metrics

[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353988#comment-16353988 ] Eric Payne commented on YARN-7728: -- [~sunilg], Are you okay with the branch-2.8 patch? If you are okay

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362674#comment-16362674 ] Eric Payne commented on YARN-7813: -- Thanks [~jlowe]. I committed to trunk and branch-3.1. The patch does

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.002.branch-3.0.patch > Capacity Scheduler Intra-queue Preemption should be

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.003.branch-2.patch > Capacity Scheduler Intra-queue Preemption should be

[jira] [Created] (YARN-7927) YARN-7813 caused test failure in TestRMWebServicesSchedulerActivities

Eric Payne created YARN-7927: Summary: YARN-7813 caused test failure in TestRMWebServicesSchedulerActivities Key: YARN-7927 URL: https://issues.apache.org/jira/browse/YARN-7927 Project: Hadoop YARN

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.003.branch-3.0.patch > Capacity Scheduler Intra-queue Preemption should be

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363207#comment-16363207 ] Eric Payne commented on YARN-7813: -- I was checking failed unit tests for

[jira] [Updated] (YARN-7927) TestRMWebServicesSchedulerActivities is failing

[ https://issues.apache.org/jira/browse/YARN-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7927: - Attachment: YARN-7927.001.patch > TestRMWebServicesSchedulerActivities is failing >

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364217#comment-16364217 ] Eric Payne commented on YARN-7813: -- {code:java} Removing intermediate container 0bc484afac12 Step 14/33 :

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364766#comment-16364766 ] Eric Payne commented on YARN-7813: -- I reverted the checkins for trunk, branch-3.1, and branch-3.0 because

[jira] [Commented] (YARN-7927) TestRMWebServicesSchedulerActivities is failing

[ https://issues.apache.org/jira/browse/YARN-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364556#comment-16364556 ] Eric Payne commented on YARN-7927: -- {{TestCapacitySchedulerAutoCreatedQueuePreemption}} may also be

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.004.patch > Capacity Scheduler Intra-queue Preemption should be configurable for

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365044#comment-16365044 ] Eric Payne commented on YARN-7813: -- {{YARN-7813.004.patch}} should address the failures. > Capacity

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.005.patch > Capacity Scheduler Intra-queue Preemption should be configurable for

[jira] [Commented] (YARN-7947) Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps

[ https://issues.apache.org/jira/browse/YARN-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371520#comment-16371520 ] Eric Payne commented on YARN-7947: -- Great! Thanks a lot, [~sunilg] > Capacity Scheduler intra-queue

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371523#comment-16371523 ] Eric Payne commented on YARN-7813: -- Awesome! Thanks [~jlowe] > Capacity Scheduler Intra-queue Preemption

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.005.branch-3.0.patch > Capacity Scheduler Intra-queue Preemption should be

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366151#comment-16366151 ] Eric Payne commented on YARN-7813: -- Attached {{YARN-7813.005.patch}}. If the pre-commit passes, this

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16367867#comment-16367867 ] Eric Payne commented on YARN-7813: -- {{YARN-7813.005.patch}} - This patch backports to 3.1 cleanly -

[jira] [Updated] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7813: - Attachment: YARN-7813.005.branch-2.8.patch > Capacity Scheduler Intra-queue Preemption should be

[jira] [Comment Edited] (YARN-7947) Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps

[ https://issues.apache.org/jira/browse/YARN-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369531#comment-16369531 ] Eric Payne edited comment on YARN-7947 at 2/19/18 9:29 PM: --- YARN-7051 added the

[jira] [Assigned] (YARN-7947) Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps

[ https://issues.apache.org/jira/browse/YARN-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-7947: Assignee: Eric Payne > Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps >

<    3   4   5   6   7   8   9   10   11   12   >