[jira] [Created] (YARN-2719) Windows: Wildcard classpath variables not expanded against resources contained in archives

Craig Welch created YARN-2719: - Summary: Windows: Wildcard classpath variables not expanded against resources contained in archives Key: YARN-2719 URL: https://issues.apache.org/jira/browse/YARN-2719 Proj

[jira] [Commented] (YARN-2505) Support get/add/remove/change labels in RM REST API

[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174508#comment-14174508 ] Craig Welch commented on YARN-2505: --- So, suggesting a slight modification to achieve grea

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14170063#comment-14170063 ] Craig Welch commented on YARN-1680: --- Hi [~airbots], did the newly-discovered concern with

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169843#comment-14169843 ] Craig Welch commented on YARN-2308: --- The unit test failure does not appear to be related

[jira] [Updated] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2308: -- Attachment: YARN-2308.1.patch Add explicit logging before exception throw, just in case the exception mes

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167622#comment-14167622 ] Craig Welch commented on YARN-2308: --- The release audit is not related to this change, it

[jira] [Updated] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2308: -- Attachment: YARN-2308.0.patch Here's a patch which does what I believe the consensus was - detects the c

[jira] [Updated] (YARN-2660) Tarball as local resource type archive fails to localize on Windows

[ https://issues.apache.org/jira/browse/YARN-2660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2660: -- Attachment: YARN-2660.2.patch Modify test to exercise problem condition (on windows) > Tarball as local

[jira] [Assigned] (YARN-2660) Tarball as local resource type archive fails to localize on Windows

[ https://issues.apache.org/jira/browse/YARN-2660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch reassigned YARN-2660: - Assignee: Craig Welch > Tarball as local resource type archive fails to localize on Windows > ---

[jira] [Updated] (YARN-2660) Tarball as local resource type archive fails to localize on Windows

[ https://issues.apache.org/jira/browse/YARN-2660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2660: -- Attachment: YARN-2660.1.patch Some tar files do not have directory entries before files contained in that

[jira] [Updated] (YARN-1857) CapacityScheduler headroom doesn't account for other AM's running

[ https://issues.apache.org/jira/browse/YARN-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1857: -- Attachment: YARN-1857.7.patch I see it now - uploading newer patch with simplified final headroom calcul

[jira] [Commented] (YARN-1857) CapacityScheduler headroom doesn't account for other AM's running

[ https://issues.apache.org/jira/browse/YARN-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14162170#comment-14162170 ] Craig Welch commented on YARN-1857: --- This is an interesting question - that logic predate

[jira] [Commented] (YARN-1857) CapacityScheduler headroom doesn't account for other AM's running

[ https://issues.apache.org/jira/browse/YARN-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161220#comment-14161220 ] Craig Welch commented on YARN-1857: --- [~john.jian.fang] - uploaded .6 on [YARN-2644], upda

[jira] [Updated] (YARN-1857) CapacityScheduler headroom doesn't account for other AM's running

[ https://issues.apache.org/jira/browse/YARN-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1857: -- Attachment: YARN-1857.6.patch > CapacityScheduler headroom doesn't account for other AM's running > -

[jira] [Updated] (YARN-2644) Recalculate headroom more frequently to keep it accurate

[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2644: -- Attachment: YARN-2644.15.patch Reupload to see if jenkins can apply the patch now > Recalculate headroom

[jira] [Updated] (YARN-1857) CapacityScheduler headroom doesn't account for other AM's running

[ https://issues.apache.org/jira/browse/YARN-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1857: -- Attachment: YARN-1857.5.patch Updating to current trunk on new(er) repo > CapacityScheduler headroom doe

[jira] [Updated] (YARN-2644) Recalculate headroom more frequently to keep it accurate

[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2644: -- Attachment: YARN-2644.15.patch Update patch against latest trunk in new(er) git repo > Recalculate headr

[jira] [Updated] (YARN-2644) Recalculate headroom more frequently to keep it accurate

[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2644: -- Attachment: YARN-2644.14.patch Ok, uploading patch 14 with long lines fixed in new code. > Recalculate h

[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate

[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14158781#comment-14158781 ] Craig Welch commented on YARN-2644: --- Just putting our offline discussion here - the headR

[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate

[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14158696#comment-14158696 ] Craig Welch commented on YARN-2644: --- Right, I replied on 1198, if there is more we can co

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14158699#comment-14158699 ] Craig Welch commented on YARN-1198: --- Opened [YARN-2644] Will fix the long lines. The Qu

[jira] [Assigned] (YARN-2644) Recalculate headroom more frequently to keep it accurate

[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch reassigned YARN-2644: - Assignee: Craig Welch > Recalculate headroom more frequently to keep it accurate > ---

[jira] [Updated] (YARN-2644) Recalculate headroom more frequently to keep it accurate

[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2644: -- Attachment: YARN-2644.11.patch This is the [YARN-1198] .11 patch migrated to a subjira, to enable complet

[jira] [Updated] (YARN-2644) Recalculate headroom more frequently to keep it accurate

[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2644: -- Description: See parent (1198) for more detail - this specifically covers calculating the headroom more f

[jira] [Created] (YARN-2644) Recalculate headroom more frequently to keep it accurate

Craig Welch created YARN-2644: - Summary: Recalculate headroom more frequently to keep it accurate Key: YARN-2644 URL: https://issues.apache.org/jira/browse/YARN-2644 Project: Hadoop YARN Issue Ty

[jira] [Updated] (YARN-1857) CapacityScheduler headroom doesn't account for other AM's running

[ https://issues.apache.org/jira/browse/YARN-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1857: -- Attachment: YARN-1857.4.patch [~john.jian.fang] I've attached a .4 patch with the additional checks you

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.12-with-1857.patch An updated version of the 11-with-1857 patch, the only differenc

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157524#comment-14157524 ] Craig Welch commented on YARN-1198: --- FYI, it's not possible to call the getAndCalculateHe

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157286#comment-14157286 ] Craig Welch commented on YARN-1680: --- This does bring up what I think could be an issue, I

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157275#comment-14157275 ] Craig Welch commented on YARN-1680: --- Blacklisting a node could happen because, for whatev

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157271#comment-14157271 ] Craig Welch commented on YARN-1680: --- [~john.jian.fang] I should probably not have referre

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157248#comment-14157248 ] Craig Welch commented on YARN-1680: --- [~airbots] thanks for your updated WIP patch - I've

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.11-with-1857.patch Patch combining the last .11 with the latest 1857 patch, to make

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157083#comment-14157083 ] Craig Welch commented on YARN-1198: --- And, again, I think something is up with Jenkins, th

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.11.patch Attaching patch .11, this is based on .10 (nee .7), the preferred approach

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14155764#comment-14155764 ] Craig Welch commented on YARN-1198: --- [~john.jian.fang] I look a look at implementing the

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14155767#comment-14155767 ] Craig Welch commented on YARN-1198: --- The Jenkins failures do not actually seem to have an

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.10.patch And again, this time, with the additional files, .10 (nee .9, .7) > Capac

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.9.patch Updated version of .7 patch to current trunk (as .7 now fails to fully appl

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14155360#comment-14155360 ] Craig Welch commented on YARN-1680: --- There are different kinds of blacklisting, the one a

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14155295#comment-14155295 ] Craig Welch commented on YARN-1680: --- As I recall, blacklisted nodes are application level

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14154057#comment-14154057 ] Craig Welch commented on YARN-1198: --- Sorry, the above was off - the conversation happened

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153983#comment-14153983 ] Craig Welch commented on YARN-2198: --- there are a number of changes which impact common mu

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153982#comment-14153982 ] Craig Welch commented on YARN-2198: --- -re pom.xml - maybe I'm just confused, I saw a refer

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153512#comment-14153512 ] Craig Welch commented on YARN-1198: --- [~leftnoteasy] [~john.jian.fang] it sounds like the

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153499#comment-14153499 ] Craig Welch commented on YARN-1198: --- That's not intentional - I think it's just a side ef

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153494#comment-14153494 ] Craig Welch commented on YARN-2198: --- Bringing over some comments from [YARN-1063] When l

[jira] [Commented] (YARN-1063) Winutils needs ability to create task as domain user

[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153490#comment-14153490 ] Craig Welch commented on YARN-1063: --- [~rusanu] [~vinodkv], we can go ahead and address th

[jira] [Commented] (YARN-1972) Implement secure Windows Container Executor

[ https://issues.apache.org/jira/browse/YARN-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153491#comment-14153491 ] Craig Welch commented on YARN-1972: --- [~rusanu] [~vinodkv], as on [YARN-1063], we can go a

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152523#comment-14152523 ] Craig Welch commented on YARN-2198: --- pom.xml - don’t see a /etc/hadoop or a wsce-site.xml

[jira] [Commented] (YARN-1972) Implement secure Windows Container Executor

[ https://issues.apache.org/jira/browse/YARN-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152507#comment-14152507 ] Craig Welch commented on YARN-1972: --- ContainerLaunch launchContainer - nit, why "userName

[jira] [Commented] (YARN-1063) Winutils needs ability to create task as domain user

[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152504#comment-14152504 ] Craig Welch commented on YARN-1063: --- When looking this over to pickup context for 2198, I

[jira] [Commented] (YARN-2494) [YARN-796] Node label manager API and storage implementations

[ https://issues.apache.org/jira/browse/YARN-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152078#comment-14152078 ] Craig Welch commented on YARN-2494: --- Not to dither about names - but "Collection" is stil

[jira] [Commented] (YARN-2494) [YARN-796] Node label manager API and storage implementations

[ https://issues.apache.org/jira/browse/YARN-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14148095#comment-14148095 ] Craig Welch commented on YARN-2494: --- ...other kinds of labels..., rather > [YARN-796] No

[jira] [Commented] (YARN-2494) [YARN-796] Node label manager API and storage implementations

[ https://issues.apache.org/jira/browse/YARN-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14148094#comment-14148094 ] Craig Welch commented on YARN-2494: --- -re I suggest to change addLabels to addNodeLabels b

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147034#comment-14147034 ] Craig Welch commented on YARN-796: -- Some additional info regarding the headroom problem - o

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144437#comment-14144437 ] Craig Welch commented on YARN-2198: --- Looks good to me on the whole, a nit - : ICommandExe

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144090#comment-14144090 ] Craig Welch commented on YARN-796: -- It looks like the FileSystemNodeLabelManager will just

[jira] [Commented] (YARN-2496) [YARN-796] Changes for capacity scheduler to support allocate resource respect labels

[ https://issues.apache.org/jira/browse/YARN-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143993#comment-14143993 ] Craig Welch commented on YARN-2496: --- So, re the headroom issue (2) - the short version -

[jira] [Updated] (YARN-2505) [YARN-796] Support get/add/remove/change labels in RM REST API

[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2505: -- Attachment: YARN-2505.1.patch > [YARN-796] Support get/add/remove/change labels in RM REST API >

[jira] [Commented] (YARN-2505) [YARN-796] Support get/add/remove/change labels in RM REST API

[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143855#comment-14143855 ] Craig Welch commented on YARN-2505: --- 1) -re rename all-nodes-to-lables to nodes-to-label

[jira] [Commented] (YARN-2494) [YARN-796] Node label manager API and storage implementations

[ https://issues.apache.org/jira/browse/YARN-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143665#comment-14143665 ] Craig Welch commented on YARN-2494: --- The other day [~vinodkv] suggested changing the addL

[jira] [Commented] (YARN-2496) [YARN-796] Changes for capacity scheduler to support allocate resource respect labels

[ https://issues.apache.org/jira/browse/YARN-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141736#comment-14141736 ] Craig Welch commented on YARN-2496: --- ach, not finished - anyway, re 2 - a particular job

[jira] [Commented] (YARN-2496) [YARN-796] Changes for capacity scheduler to support allocate resource respect labels

[ https://issues.apache.org/jira/browse/YARN-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141724#comment-14141724 ] Craig Welch commented on YARN-2496: --- Ok, so it sounds like 1, 3 and 4 are ok. I think

[jira] [Commented] (YARN-2496) [YARN-796] Changes for capacity scheduler to support allocate resource respect labels

[ https://issues.apache.org/jira/browse/YARN-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141508#comment-14141508 ] Craig Welch commented on YARN-2496: --- SchedulerUtils.checkNodeLabelExpression - I think t

[jira] [Commented] (YARN-2496) [YARN-796] Changes for capacity scheduler to support allocate resource respect labels

[ https://issues.apache.org/jira/browse/YARN-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141369#comment-14141369 ] Craig Welch commented on YARN-2496: --- CSQueueUtils - just removing a line, should revert

[jira] [Commented] (YARN-2496) [YARN-796] Changes for capacity scheduler to support allocate resource respect labels

[ https://issues.apache.org/jira/browse/YARN-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141367#comment-14141367 ] Craig Welch commented on YARN-2496: --- On the parent/leaf refactor to share AbstractCSQueue

[jira] [Commented] (YARN-2496) [YARN-796] Changes for capacity scheduler to support allocate resource respect labels

[ https://issues.apache.org/jira/browse/YARN-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141355#comment-14141355 ] Craig Welch commented on YARN-2496: --- I'm also concerned about this: Resource maxCapacity

[jira] [Commented] (YARN-2496) [YARN-796] Changes for capacity scheduler to support allocate resource respect labels

[ https://issues.apache.org/jira/browse/YARN-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141342#comment-14141342 ] Craig Welch commented on YARN-2496: --- Let's say user UserU is running two jobs, JobA and J

[jira] [Updated] (YARN-1857) CapacityScheduler headroom doesn't account for other AM's running

[ https://issues.apache.org/jira/browse/YARN-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1857: -- Attachment: YARN-1857.3.patch re attaching patch to get the javac warnings > CapacityScheduler headroom

[jira] [Updated] (YARN-2505) [YARN-796] Support get/add/remove/change labels in RM REST API

[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2505: -- Attachment: YARN-2505.patch > [YARN-796] Support get/add/remove/change labels in RM REST API > --

[jira] [Commented] (YARN-2494) [YARN-796] Node label manager API and storage implementations

[ https://issues.apache.org/jira/browse/YARN-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135774#comment-14135774 ] Craig Welch commented on YARN-2494: --- UpdateNodeResourceRequestPBImple.java: the only chan

[jira] [Commented] (YARN-2496) [YARN-796] Changes for capacity scheduler to support allocate resource respect labels

[ https://issues.apache.org/jira/browse/YARN-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135772#comment-14135772 ] Craig Welch commented on YARN-2496: --- LeafQueue.java I think there’s a bug in the way a u

[jira] [Updated] (YARN-1857) CapacityScheduler headroom doesn't account for other AM's running

[ https://issues.apache.org/jira/browse/YARN-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1857: -- Attachment: YARN-1857.2.patch I went ahead and put in a comment wrt a headroom value in the test and chan

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129480#comment-14129480 ] Craig Welch commented on YARN-796: -- Good, what you describe wrt the cli is what I was tryin

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129024#comment-14129024 ] Craig Welch commented on YARN-796: -- So, I'm adding code to check whether a user should be a

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127329#comment-14127329 ] Craig Welch commented on YARN-796: -- This is a bit of a detail, but the current version of t

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122188#comment-14122188 ] Craig Welch commented on YARN-1198: --- [~jianhe], have a look at patch 7, it takes that sor

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.8.patch Patch based on my last comment which iterates/calculates headroom at the u

[jira] [Commented] (YARN-1857) CapacityScheduler headroom doesn't account for other AM's running

[ https://issues.apache.org/jira/browse/YARN-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14109798#comment-14109798 ] Craig Welch commented on YARN-1857: --- [~jianhe] [~wangda] could you have a look at this pa

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14109738#comment-14109738 ] Craig Welch commented on YARN-1198: --- I initially considered an approach like this one, bu

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.7.patch Can't repro test failure - uploading (better formatted) patch to trigger n

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.6.patch Fix for findbug finds > Capacity Scheduler headroom calculation does not

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.5.patch Patch with a slightly different approach - calculates final headroom on de

[jira] [Updated] (YARN-1857) CapacityScheduler headroom doesn't account for other AM's running

[ https://issues.apache.org/jira/browse/YARN-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1857: -- Attachment: YARN-1857.1.patch Just updating to a patch which applies against current trunk, otherwise u

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14097275#comment-14097275 ] Craig Welch commented on YARN-1198: --- So, it's possible to avoid iterating the application

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094997#comment-14094997 ] Craig Welch commented on YARN-1198: --- So, looking at this a bit more holistically - it app

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.4.patch redo-patch against current trunk, trigger rebuild b/c something went wrong

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.3.patch Update broken test to reflect intentional change in behavior > Capacity S

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.2.patch Patch for most items in this jira not covered in subtasks, including updat

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093216#comment-14093216 ] Craig Welch commented on YARN-1198: --- So, I'm in the process of putting together a patch t

[jira] [Updated] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2008: -- Attachment: YARN-2008.9.patch Add specific tests for invalid divisor for both default and dominant calcu

[jira] [Commented] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14088488#comment-14088488 ] Craig Welch commented on YARN-2008: --- TestAMRestart passes on my box with the changes, bui

[jira] [Updated] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2008: -- Attachment: YARN-2008.8.patch Make ResourceCalculator.isInvalidDivisor abstract, move (correct) impls in

[jira] [Updated] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2008: -- Attachment: YARN-2008.7.patch and, this time with the change... > CapacityScheduler may report incorrec

[jira] [Updated] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2008: -- Attachment: YARN-2008.6.patch add small epsilon to assertions > CapacityScheduler may report incorrect

[jira] [Updated] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2008: -- Attachment: YARN-2008.5.patch This time, actually with the additional tests :-) > CapacityScheduler ma

[jira] [Updated] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1994: -- Attachment: YARN-1994.15-branch2.patch Adding a version of the patch for branch-2, because the one from

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14081207#comment-14081207 ] Craig Welch commented on YARN-1994: --- [~mipoto] Can you take a look at the latest patch?

[jira] [Updated] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2008: -- Attachment: YARN-2008.4.patch Some additional tests for direct siblings > CapacityScheduler may report

<    1   2   3   4   5   >