[jira] [Resolved] (YARN-1963) Support priorities across applications within the same queue

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-1963. --- Resolution: Fixed Closing this issue as all sub-items are done. > Support priorities across applications

[jira] [Updated] (YARN-2099) Preemption in fair scheduler should consider app priorities

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2099: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1963) > Preemption in fair scheduler should

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223854#comment-16223854 ] Sunil G commented on YARN-2098: --- linking to YARN-1963 > App priority support in Fair Scheduler >

[jira] [Updated] (YARN-2098) App priority support in Fair Scheduler

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2098: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1963) > App priority support in Fair Scheduler >

[jira] [Assigned] (YARN-7414) FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight()

2017-10-28 Thread Soumabrata Chakraborty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Soumabrata Chakraborty reassigned YARN-7414: Assignee: Soumabrata Chakraborty > FairScheduler#getAppWeight() should be

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223840#comment-16223840 ] Arun Suresh commented on YARN-4511: --- Thanks for updating the patch [~haibochen]. I am able to follow this

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223839#comment-16223839 ] Sunil G commented on YARN-7119: --- Thanks [~maniraj...@gmail.com] Few comments #

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223838#comment-16223838 ] Sunil G commented on YARN-7159: --- Thanks [~maniraj...@gmail.com]. Some more comments # In

[jira] [Commented] (YARN-6984) DominantResourceCalculator.isAnyMajorResourceZero() should test all resources

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223826#comment-16223826 ] Sunil G commented on YARN-6984: --- Thanks [~templedf]! Appreciate the same. >

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223824#comment-16223824 ] Wangda Tan commented on YARN-4511: -- [~haibo.chen], Haven't reviewed all details of the patch, but the

[jira] [Commented] (YARN-7224) Support GPU isolation for docker container

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223823#comment-16223823 ] Sunil G commented on YARN-7224: --- Committing shortly. > Support GPU isolation for docker container >

[jira] [Commented] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-10-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223818#comment-16223818 ] Wangda Tan commented on YARN-7410: -- Ran the perf test (TestCapacitySchedulerPerf) several more times. It

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2017-10-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223804#comment-16223804 ] Wangda Tan commented on YARN-6594: -- Thanks [~kkaranasos] for updating the JIRA. +1, will commit the patch

[jira] [Created] (YARN-7415) RM Rest API Submit application documentation not easy to understand

2017-10-28 Thread Atul Kulkarni (JIRA)
Atul Kulkarni created YARN-7415: --- Summary: RM Rest API Submit application documentation not easy to understand Key: YARN-7415 URL: https://issues.apache.org/jira/browse/YARN-7415 Project: Hadoop YARN

[jira] [Updated] (YARN-7380) Check findbugs in timeline service branch-2

2017-10-28 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7380: - Target Version/s: 2.9.0 Description: Some findbugs warnings have been noticed in the branch-2

[jira] [Updated] (YARN-7380) Check findbugs in timeline service branch-2

2017-10-28 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7380: - Attachment: YARN-7380-branch-2.0001.patch Upload v0001 > Check findbugs in timeline service branch-2 >

[jira] [Commented] (YARN-7380) Check findbugs in timeline service branch-2

2017-10-28 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223689#comment-16223689 ] Vrushali C commented on YARN-7380: -- The findbugs warning that I see is {code}

[jira] [Comment Edited] (YARN-7380) Check findbugs in timeline service branch-2

2017-10-28 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223689#comment-16223689 ] Vrushali C edited comment on YARN-7380 at 10/28/17 6:16 PM: The findbugs

[jira] [Updated] (YARN-7276) Federation Router Web Service fixes

2017-10-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7276: -- Attachment: (was: YARN-7276-branch-2.005.patch) > Federation Router Web Service fixes >

[jira] [Updated] (YARN-7276) Federation Router Web Service fixes

2017-10-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7276: -- Attachment: YARN-7276-branch-2.005.patch Not sure the warnings are correct (i.e., checkstyle), I'm

[jira] [Commented] (YARN-7397) Reduce lock contention in FairScheduler#getAppWeight()

2017-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223635#comment-16223635 ] Hudson commented on YARN-7397: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13156 (See

[jira] [Updated] (YARN-7397) Reduce lock contention in FairScheduler#getAppWeight()

2017-10-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7397: --- Affects Version/s: (was: 3.0.0-beta1) 3.1.0 > Reduce lock

[jira] [Created] (YARN-7414) FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight()

2017-10-28 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7414: -- Summary: FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight() Key: YARN-7414 URL: https://issues.apache.org/jira/browse/YARN-7414 Project:

[jira] [Commented] (YARN-7397) Reduce lock contention in FairScheduler#getAppWeight()

2017-10-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223624#comment-16223624 ] Daniel Templeton commented on YARN-7397: It's not exactly straightforward to untangle that because

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223621#comment-16223621 ] Sunil G commented on YARN-7369: --- bq.but they won't be new anymore. Yes. The existing statement to put them in

[jira] [Updated] (YARN-7369) Improve the resource types docs

2017-10-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7369: --- Attachment: YARN-7369.002.patch See if this works better for you. > Improve the resource

[jira] [Comment Edited] (YARN-7369) Improve the resource types docs

2017-10-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223560#comment-16223560 ] Daniel Templeton edited comment on YARN-7369 at 10/28/17 3:34 PM: -- Thanks

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-10-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223560#comment-16223560 ] Daniel Templeton commented on YARN-7369: Thanks for the review, @sunil! # There's this line:

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223522#comment-16223522 ] Hadoop QA commented on YARN-7159: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223493#comment-16223493 ] Hadoop QA commented on YARN-7119: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-28 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7159: --- Attachment: YARN-7159.005.patch > Normalize unit of resource objects in RM and avoid to do unit

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-28 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223466#comment-16223466 ] Manikandan R commented on YARN-7159: Rebased. Attached new patch. > Normalize unit of resource objects

[jira] [Assigned] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-28 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R reassigned YARN-7159: -- Assignee: Manikandan R (was: Wangda Tan) > Normalize unit of resource objects in RM and avoid

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-10-28 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223450#comment-16223450 ] Manikandan R commented on YARN-7119: [~sunilg] [~leftnoteasy] Thanks for working on YARN-7307. Had an

[jira] [Updated] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-10-28 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7119: --- Attachment: YARN-7119.002.patch > yarn rmadmin -updateNodeResource should be updated for resource

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223433#comment-16223433 ] Hadoop QA commented on YARN-7159: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-28 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7159: --- Attachment: YARN-7159.004.patch > Normalize unit of resource objects in RM and avoid to do unit

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-28 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223431#comment-16223431 ] Manikandan R commented on YARN-7159: Fixed jnit failures, whitespace & checkstyle issues. > Normalize

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223344#comment-16223344 ] Eric Yang commented on YARN-7197: - Btw, docker doesn't support double mount like: {code} docker run -it -v

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223306#comment-16223306 ] Eric Yang commented on YARN-7197: - [~jlowe] I agree with everything you said that the current

[jira] [Commented] (YARN-6927) Add support for individual resource types requests in MapReduce

2017-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223299#comment-16223299 ] Hadoop QA commented on YARN-6927: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7412) test_docker_util.test_check_mount_permitted() is failing

2017-10-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223292#comment-16223292 ] Eric Yang commented on YARN-7412: - Different distros seem to link /usr/bin to /bin or vis-versa. Maybe it

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223288#comment-16223288 ] Sunil G commented on YARN-7369: --- Thank you [~templedf] for helping in this. Few quick comments. # I think

[jira] [Commented] (YARN-7299) Fix TestDistributedScheduler

2017-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223283#comment-16223283 ] Hudson commented on YARN-7299: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13155 (See

[jira] [Commented] (YARN-7178) Add documentation for Container Update API

2017-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223275#comment-16223275 ] Hudson commented on YARN-7178: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13154 (See

[jira] [Updated] (YARN-7299) Fix TestDistributedScheduler

2017-10-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7299: -- Summary: Fix TestDistributedScheduler (was: TestDistributedScheduler is failing) > Fix