[jira] [Commented] (YARN-6428) Queue AM limit is not honored in CS always

2017-04-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956362#comment-15956362 ] Varun Saxena commented on YARN-6428: You are right about changing it to double will be

[jira] [Updated] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-04-04 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5548: --- Attachment: YARN-5548.0015.patch > Use MockRMMemoryStateStore to reduce test failures > ---

[jira] [Commented] (YARN-6420) RM startup failure due to wrong order in nodelabel editlog

2017-04-04 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956326#comment-15956326 ] Bibin A Chundatt commented on YARN-6420: Thank you [~naganarasimha...@apache.org] f

[jira] [Commented] (YARN-6443) Allow for Priority order relaxing in favor of improved node/rack locality

2017-04-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956325#comment-15956325 ] Wangda Tan commented on YARN-6443: -- [~arun.sur...@gmail.com], I was thinking about simila

[jira] [Commented] (YARN-6443) Allow for Priority order relaxing in favor of improved node/rack locality

2017-04-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956309#comment-15956309 ] Arun Suresh commented on YARN-6443: --- My initial though was: instead of simply iterating o

[jira] [Updated] (YARN-6443) Allow for Priority order relaxing in favor of improved node/rack locality

2017-04-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6443: -- Summary: Allow for Priority order relaxing in favor of improved node/rack locality (was: Allow for Prio

[jira] [Created] (YARN-6443) Allow for Priority order relaxing in favor of node locality

2017-04-04 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-6443: - Summary: Allow for Priority order relaxing in favor of node locality Key: YARN-6443 URL: https://issues.apache.org/jira/browse/YARN-6443 Project: Hadoop YARN Iss

[jira] [Commented] (YARN-6420) RM startup failure due to wrong order in nodelabel editlog

2017-04-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956302#comment-15956302 ] Hudson commented on YARN-6420: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1152

[jira] [Commented] (YARN-6420) RM startup failure due to wrong order in nodelabel editlog

2017-04-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956283#comment-15956283 ] Varun Saxena commented on YARN-6420: Committed to trunk, branch-2 and branch-2.8 Thanks

[jira] [Commented] (YARN-6428) Queue AM limit is not honored in CS always

2017-04-04 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956273#comment-15956273 ] Bibin A Chundatt commented on YARN-6428: cc/ [~leftnoteasy] thoughts?? > Queue AM

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956223#comment-15956223 ] Wangda Tan commented on YARN-5892: -- Thanks [~eepayne], Haven't reviewed your latest patc

[jira] [Updated] (YARN-6199) Support for listing flows with filter userid

2017-04-04 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6199: Labels: (was: yarn-5355-merge-blocker) > Support for listing flows with filter userid > ---

[jira] [Updated] (YARN-6058) Support for listing all applications i.e /apps

2017-04-04 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6058: Labels: (was: yarn-5355-merge-blocker) > Support for listing all applications i.e /apps > -

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-04-04 Thread dengkai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956178#comment-15956178 ] dengkai commented on YARN-6384: --- Yes, I think it should be useful. > Add configuratin to set

[jira] [Created] (YARN-6442) Inaccurate javadoc in NodeManagerHardwareUtils.getContainerMemoryMB

2017-04-04 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6442: Summary: Inaccurate javadoc in NodeManagerHardwareUtils.getContainerMemoryMB Key: YARN-6442 URL: https://issues.apache.org/jira/browse/YARN-6442 Project: Hadoop YARN

[jira] [Commented] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956163#comment-15956163 ] Hadoop QA commented on YARN-6423: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-04 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956153#comment-15956153 ] Yufei Gu commented on YARN-6438: Thanks for the patch, [~miklos.szeg...@cloudera.com]! Some

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956151#comment-15956151 ] Hadoop QA commented on YARN-5892: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6432) FS preemption should reserve a node before considering containers on it for preemption

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956146#comment-15956146 ] Hadoop QA commented on YARN-6432: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956144#comment-15956144 ] Hudson commented on YARN-6004: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1152

[jira] [Updated] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-04 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6423: --- Attachment: YARN-6423.002.patch Thanks [~miklos.szeg...@cloudera.com] for the review. Uploaded patch v2 for all

[jira] [Commented] (YARN-6436) TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low

2017-04-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956115#comment-15956115 ] Hudson commented on YARN-6436: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1152

[jira] [Commented] (YARN-6440) re-visit handling QUEUE-STOP process

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956104#comment-15956104 ] Hadoop QA commented on YARN-6440: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956103#comment-15956103 ] Chris Trezzo commented on YARN-6004: These unit tests fail locally on branch-2 without

[jira] [Updated] (YARN-6432) FS preemption should reserve a node before considering containers on it for preemption

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6432: - Attachment: YARN-6432.002.patch > FS preemption should reserve a node before considering containers

[jira] [Commented] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2017-04-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956086#comment-15956086 ] Karthik Kambatla commented on YARN-5531: Barely skimmed through the patch. Some hig

[jira] [Commented] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956080#comment-15956080 ] Hadoop QA commented on YARN-6004: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6298) Metric preemptCall is not used in new preemption.

2017-04-04 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956064#comment-15956064 ] Yufei Gu commented on YARN-6298: Not necessary to add tests and the test failure is unrelat

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.007.patch [~leftnoteasy], Attaching a YARN-5892.007.patch, that addresses all of the

[jira] [Commented] (YARN-6298) Metric preemptCall is not used in new preemption.

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956056#comment-15956056 ] Hadoop QA commented on YARN-6298: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956054#comment-15956054 ] Carlo Curino commented on YARN-6439: The v0 patch was failing in FairScheduler version

[jira] [Updated] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6439: --- Attachment: YARN-6439.v1.patch > Fix ReservationSystem creation of default ReservationQueue > -

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956049#comment-15956049 ] Chris Trezzo commented on YARN-5797: As soon as the patch for YARN-6004 is in, I will r

[jira] [Commented] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956023#comment-15956023 ] Hadoop QA commented on YARN-6403: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956021#comment-15956021 ] Carlo Curino commented on YARN-6363: Moving some of this patch changes to YARN-6439, he

[jira] [Updated] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6439: --- Attachment: YARN-6439.v0.patch Simple patch anticipating the creation of the "default" ReservationQueue

[jira] [Commented] (YARN-6431) make DELETE/STOP/CONVERT queues work in reservation system

2017-04-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956015#comment-15956015 ] Xuan Gong commented on YARN-6431: - For convert queue: I think that we could simple disable

[jira] [Updated] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-04-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6403: - Attachment: YARN-6403.branch-2.8.004.patch Thanks for updating the patch! Looks good to me. Posting the s

[jira] [Updated] (YARN-6440) re-visit handling QUEUE-STOP process

2017-04-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6440: Attachment: YARN-6440.1.patch > re-visit handling QUEUE-STOP process > >

[jira] [Commented] (YARN-6440) re-visit handling QUEUE-STOP process

2017-04-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956010#comment-15956010 ] Xuan Gong commented on YARN-6440: - No new test cases included and make sure we could pass a

[jira] [Commented] (YARN-6440) re-visit handling QUEUE-STOP process

2017-04-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956008#comment-15956008 ] Xuan Gong commented on YARN-6440: - To fix the issue, we need to change the process a little

[jira] [Updated] (YARN-6440) re-visit handling QUEUE-STOP process

2017-04-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6440: Description: Currently, when we stop the parent queue, we would do the following: 1) check the number of acti

[jira] [Created] (YARN-6441) Improve UI error message while trying to sort running DAGs with Auto Refresh enabled

2017-04-04 Thread Eric Badger (JIRA)
Eric Badger created YARN-6441: - Summary: Improve UI error message while trying to sort running DAGs with Auto Refresh enabled Key: YARN-6441 URL: https://issues.apache.org/jira/browse/YARN-6441 Project: H

[jira] [Created] (YARN-6440) re-visit handling QUEUE-STOP process

2017-04-04 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-6440: --- Summary: re-visit handling QUEUE-STOP process Key: YARN-6440 URL: https://issues.apache.org/jira/browse/YARN-6440 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-6004: --- Attachment: YARN-6004-branch-2.001.patch Thanks [~mingma]! Attached is a branch-2 v1 patch. Note that

[jira] [Updated] (YARN-6298) Metric preemptCall is not used in new preemption.

2017-04-04 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6298: --- Attachment: YARN-6298.001.patch Patch v1 removed metric {{preemptCall}} since preempt operations are distribut

[jira] [Assigned] (YARN-6431) make DELETE/STOP/CONVERT queues work in reservation system

2017-04-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-6431: --- Assignee: (was: Xuan Gong) > make DELETE/STOP/CONVERT queues work in reservation system >

[jira] [Commented] (YARN-6368) Decommissioning an NM results in a -1 exit code

2017-04-04 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955985#comment-15955985 ] Robert Kanter commented on YARN-6368: - +1 > Decommissioning an NM results in a -1 exit

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-04-04 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955981#comment-15955981 ] Jonathan Hung commented on YARN-1492: - Got it, thanks! This sounds very useful :) > tr

[jira] [Commented] (YARN-6430) Better unit test coverage required for SLS

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955978#comment-15955978 ] Carlo Curino commented on YARN-6430: [~leftnoteasy], I think I found and fixed the issu

[jira] [Resolved] (YARN-6418) Reduce Resource object creation and overhead in Capacity scheduler inner loop

2017-04-04 Thread Roni Burd (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roni Burd resolved YARN-6418. - Resolution: Duplicate > Reduce Resource object creation and overhead in Capacity scheduler inner loop > ---

[jira] [Comment Edited] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955933#comment-15955933 ] Miklos Szegedi edited comment on YARN-6423 at 4/4/17 10:25 PM: --

[jira] [Comment Edited] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955933#comment-15955933 ] Miklos Szegedi edited comment on YARN-6423 at 4/4/17 10:15 PM: --

[jira] [Comment Edited] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955933#comment-15955933 ] Miklos Szegedi edited comment on YARN-6423 at 4/4/17 10:13 PM: --

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-04 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955955#comment-15955955 ] Konstantinos Karanasos commented on YARN-6344: -- Of course, I'll wait for your

[jira] [Comment Edited] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955933#comment-15955933 ] Miklos Szegedi edited comment on YARN-6423 at 4/4/17 10:08 PM: --

[jira] [Commented] (YARN-6109) Add an ability to convert ChildQueue to ParentQueue

2017-04-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955943#comment-15955943 ] Hudson commented on YARN-6109: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1152

[jira] [Commented] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955939#comment-15955939 ] Hadoop QA commented on YARN-6438: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955933#comment-15955933 ] Miklos Szegedi commented on YARN-6423: -- Thank you for the patch [~yufeigu]. I have a f

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955930#comment-15955930 ] Chris Trezzo commented on YARN-1492: Hi [~jhung], thanks for the question! bq. will th

[jira] [Updated] (YARN-6406) Remove SchedulerRequestKeys when no more pending ResourceRequest

2017-04-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6406: - Summary: Remove SchedulerRequestKeys when no more pending ResourceRequest (was: Garbage Collect unused Sch

[jira] [Commented] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955906#comment-15955906 ] Miklos Szegedi commented on YARN-3760: -- Thank you for the patch [~haibochen]. Is there

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955890#comment-15955890 ] Wangda Tan commented on YARN-6344: -- [~kkaranasos], thanks for update the patch, could you

[jira] [Updated] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated YARN-6004: -- Fix Version/s: (was: 3.0.0-alpha3) (was: 2.9.0) > Refactor TestResourceLocalizationSer

[jira] [Reopened] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reopened YARN-6004: --- > Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer > so that it is less than 150 lines

[jira] [Commented] (YARN-6109) Add an ability to convert ChildQueue to ParentQueue

2017-04-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955876#comment-15955876 ] Wangda Tan commented on YARN-6109: -- Committing it now. > Add an ability to convert ChildQ

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-04 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955874#comment-15955874 ] Konstantinos Karanasos commented on YARN-6344: -- There is a failing test that s

[jira] [Commented] (YARN-6430) Better unit test coverage required for SLS

2017-04-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955873#comment-15955873 ] Wangda Tan commented on YARN-6430: -- [~curino], sounds good. And from the test report there

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-04-04 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955869#comment-15955869 ] Jonathan Hung commented on YARN-1492: - Hi [~ctrezzo], question - will this feature save

[jira] [Commented] (YARN-6430) Better unit test coverage required for SLS

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955868#comment-15955868 ] Carlo Curino commented on YARN-6430: [~wangda] please checkout what I am doing in YARN-

[jira] [Assigned] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-6438: Assignee: Miklos Szegedi > Code can be improved in ContainersMonitorImpl.java >

[jira] [Updated] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6438: - Attachment: YARN-6438.000.patch > Code can be improved in ContainersMonitorImpl.java >

[jira] [Created] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-04 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-6439: -- Summary: Fix ReservationSystem creation of default ReservationQueue Key: YARN-6439 URL: https://issues.apache.org/jira/browse/YARN-6439 Project: Hadoop YARN Issu

[jira] [Commented] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955818#comment-15955818 ] Hadoop QA commented on YARN-5531: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6430) Better unit test coverage required for SLS

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955816#comment-15955816 ] Hadoop QA commented on YARN-6430: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6245) Add FinalResource object to reduce overhead of Resource class instancing

2017-04-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955811#comment-15955811 ] Wangda Tan commented on YARN-6245: -- [~roniburd], for patch submission, I agree with [~kash

[jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-04-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955794#comment-15955794 ] Wangda Tan commented on YARN-6195: -- [~jlowe]/[~benson.qiu], Sorry for jumping in late, sin

[jira] [Commented] (YARN-6436) TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low

2017-04-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955783#comment-15955783 ] Karthik Kambatla commented on YARN-6436: +1, checking this in. > TestSchedulingPo

[jira] [Comment Edited] (YARN-6245) Add FinalResource object to reduce overhead of Resource class instancing

2017-04-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955780#comment-15955780 ] Karthik Kambatla edited comment on YARN-6245 at 4/4/17 8:47 PM: -

[jira] [Commented] (YARN-6245) Add FinalResource object to reduce overhead of Resource class instancing

2017-04-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955780#comment-15955780 ] Karthik Kambatla commented on YARN-6245: bq. It works very well so I think we may n

[jira] [Updated] (YARN-6430) Better unit test coverage required for SLS

2017-04-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6430: - Attachment: YARN-6430.001.patch Attached ver.1 patch for view. While working on the patch, I found there're

[jira] [Created] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-04 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6438: Summary: Code can be improved in ContainersMonitorImpl.java Key: YARN-6438 URL: https://issues.apache.org/jira/browse/YARN-6438 Project: Hadoop YARN Issue Ty

[jira] [Commented] (YARN-6433) Only accessible cgroup mount directories should be selected for a controller

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955748#comment-15955748 ] Miklos Szegedi commented on YARN-6433: -- Thank you, [~haibochen] for the review. > Onl

[jira] [Updated] (YARN-5602) Utils for Federation State and Policy Store

2017-04-04 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-5602: --- Attachment: YARN-5602-YARN-2915.v6.patch > Utils for Federation State and Polic

[jira] [Commented] (YARN-6435) [ATSv2] Can't retrieve more than 1000 versions of metrics in time series

2017-04-04 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955723#comment-15955723 ] Vrushali C commented on YARN-6435: -- Yes, the 1000 was put in as a default to restrict the

[jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-04-04 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955716#comment-15955716 ] Naganarasimha G R commented on YARN-6195: - Hi [~benson.qiu] & [~jlowe], Sorry for p

[jira] [Commented] (YARN-6437) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955703#comment-15955703 ] Hadoop QA commented on YARN-6437: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-6436) TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955694#comment-15955694 ] Hadoop QA commented on YARN-6436: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Comment Edited] (YARN-6245) Add FinalResource object to reduce overhead of Resource class instancing

2017-04-04 Thread Roni Burd (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955593#comment-15955593 ] Roni Burd edited comment on YARN-6245 at 4/4/17 7:02 PM: - I agree.

[jira] [Commented] (YARN-6432) FS preemption should reserve a node before considering containers on it for preemption

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955619#comment-15955619 ] Hadoop QA commented on YARN-6432: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (YARN-6245) Add FinalResource object to reduce overhead of Resource class instancing

2017-04-04 Thread Roni Burd (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955593#comment-15955593 ] Roni Burd edited comment on YARN-6245 at 4/4/17 6:41 PM: - I agree.

[jira] [Commented] (YARN-6245) Add FinalResource object to reduce overhead of Resource class instancing

2017-04-04 Thread Roni Burd (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955593#comment-15955593 ] Roni Burd commented on YARN-6245: - I agree. The scheduler should use only LightResource onl

[jira] [Updated] (YARN-6436) TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low

2017-04-04 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6436: -- Attachment: YARN-6436.002.patch Getting rid of the timeout > TestSchedulingPolicy#testParseSchedulingPol

[jira] [Commented] (YARN-2960) Add documentation for the YARN shared cache

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1597#comment-1597 ] Chris Trezzo commented on YARN-2960: Circling back and taking a look at this now. > Ad

[jira] [Commented] (YARN-6436) TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low

2017-04-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1594#comment-1594 ] Jason Lowe commented on YARN-6436: -- Do we even need a timeout for this test? > TestSchedu

[jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-04-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1592#comment-1592 ] Jason Lowe commented on YARN-6195: -- This seems like a reasonable approach to take until th

[jira] [Updated] (YARN-6436) TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low

2017-04-04 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6436: -- Attachment: YARN-6436.001.patch Updating timeout to 30 seconds > TestSchedulingPolicy#testParseSchedulin

[jira] [Updated] (YARN-6437) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently

2017-04-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6437: - Attachment: YARN-6437.001.patch Patch that accumulates the received containers across all the allocate call

[jira] [Commented] (YARN-5602) Utils for Federation State and Policy Store

2017-04-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955537#comment-15955537 ] Hadoop QA commented on YARN-5602: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (YARN-6437) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently

2017-04-04 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-6437: Summary: TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently Key: YARN-6437 URL: https://issues.apache.org/jira/browse/YARN-6437 Project: Hadoop YARN

  1   2   >