[jira] [Commented] (YARN-7406) Moving logging APIs over to slf4j in hadoop-yarn-api

2017-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248340#comment-16248340 ] Hudson commented on YARN-7406: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13223 (See

[jira] [Commented] (YARN-7050) Post cleanup after YARN-6903, removal of org.apache.slider package

2017-11-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248336#comment-16248336 ] Jian He commented on YARN-7050: --- Are you running in a secure env ? Since it's a long running service, AM can

[jira] [Commented] (YARN-6595) [API] Add Placement Constraints at the application level

2017-11-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248326#comment-16248326 ] Wangda Tan commented on YARN-6595: -- Patch looks good, +1, thanks [~asuresh]! [~kkaranasos], do you want to

[jira] [Commented] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248323#comment-16248323 ] Wangda Tan commented on YARN-7438: -- [~asuresh], Thanks for reviewing the patch. bq. Am wondering if the

[jira] [Commented] (YARN-6078) Containers stuck in Localizing state

2017-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248322#comment-16248322 ] Hadoop QA commented on YARN-6078: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7406) Moving logging APIs over to slf4j in hadoop-yarn-api

2017-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248315#comment-16248315 ] Hadoop QA commented on YARN-7406: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248293#comment-16248293 ] Arun Suresh commented on YARN-7438: --- Thanks for working on this [~wangda], In general I think your

[jira] [Commented] (YARN-7050) Post cleanup after YARN-6903, removal of org.apache.slider package

2017-11-10 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248286#comment-16248286 ] Jonathan Hung commented on YARN-7050: - Hi [~jianhe], [~billie.rinaldi], was the

[jira] [Commented] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2017-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248277#comment-16248277 ] Hadoop QA commented on YARN-7411: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6595) [API] Add Placement Constraints at the application level

2017-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248246#comment-16248246 ] Hadoop QA commented on YARN-6595: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248230#comment-16248230 ] Hadoop QA commented on YARN-7419: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248219#comment-16248219 ] Hadoop QA commented on YARN-7438: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-11-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad reassigned YARN-7473: -- Assignee: Suma Shivaprasad > Implement Framework and policy for capacity management of

[jira] [Created] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-11-10 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-7473: -- Summary: Implement Framework and policy for capacity management of auto created queues Key: YARN-7473 URL: https://issues.apache.org/jira/browse/YARN-7473

[jira] [Updated] (YARN-6595) [API] Add Placement Constraints at the application level

2017-11-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6595: -- Attachment: YARN-6595-YARN-6592.005.patch Thanks for the rev [~leftnoteasy], I've Updated the patch with

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248147#comment-16248147 ] Eric Yang commented on YARN-7430: - {quote} I don't believe that is true? I'm referring to YARN containers,

[jira] [Commented] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-11-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248019#comment-16248019 ] Arun Suresh commented on YARN-6102: --- Thanks for the quick turnaround [~rohithsharma] ! +1 .. I ran the

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248017#comment-16248017 ] Hadoop QA commented on YARN-7337: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248006#comment-16248006 ] Hadoop QA commented on YARN-6102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7472) Inconsistent annotation and getter/setter method for Service data model

2017-11-10 Thread Eric Yang (JIRA)
Eric Yang created YARN-7472: --- Summary: Inconsistent annotation and getter/setter method for Service data model Key: YARN-7472 URL: https://issues.apache.org/jira/browse/YARN-7472 Project: Hadoop YARN

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247968#comment-16247968 ] Vinod Kumar Vavilapalli commented on YARN-7346: --- That is right - the mapreduce.tar.gz tarball

[jira] [Updated] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7438: - Attachment: YARN-7438.001.patch Attached ver.1 patch to be reviewed. Major changes: 1) Updated

[jira] [Updated] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7419: --- Attachment: YARN-7419.6.patch Fixed some more checkstyle issues > Implement Auto Queue

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247930#comment-16247930 ] Jian He commented on YARN-7218: --- Thanks Eric, I vote for changing the prefix to " /app/v1/services",

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247903#comment-16247903 ] Eric Badger commented on YARN-7430: --- bq. Eric Badger My understanding is the container stderr, stdout are

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247898#comment-16247898 ] Hadoop QA commented on YARN-7369: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2017-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247888#comment-16247888 ] Hadoop QA commented on YARN-7411: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247864#comment-16247864 ] Sunil G commented on YARN-7330: --- Thanks [~leftnoteasy] # It might better to use

[jira] [Commented] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247804#comment-16247804 ] Wangda Tan commented on YARN-7419: -- Thanks [~suma.shivaprasad] for updating the patch, in general patch

[jira] [Commented] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2017-11-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247802#comment-16247802 ] Wangda Tan commented on YARN-7411: -- +1 to latest patch, pending Jenkins. Thanks [~sunilg]. > Inter-Queue

[jira] [Commented] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247790#comment-16247790 ] Eric Payne commented on YARN-7469: -- When a queue is in the state as described above,

[jira] [Comment Edited] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247767#comment-16247767 ] Eric Yang edited comment on YARN-7218 at 11/10/17 4:58 PM: --- Service REST API was

[jira] [Reopened] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reopened YARN-7218: - Service REST API was written to use Jackson natural serialization format to serialize and deserialize

[jira] [Updated] (YARN-7369) Improve the resource types docs

2017-11-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7369: --- Attachment: YARN-7369.branch-3.0.002.patch And branch-3.0 again. > Improve the resource types

[jira] [Updated] (YARN-7369) Improve the resource types docs

2017-11-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7369: --- Attachment: YARN-7369.006.patch Let's try that again. > Improve the resource types docs >

[jira] [Updated] (YARN-7406) Moving logging APIs over to slf4j in hadoop-yarn-api

2017-11-10 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-7406: --- Attachment: YARN-7406.002.patch > Moving logging APIs over to slf4j in hadoop-yarn-api >

[jira] [Commented] (YARN-7406) Moving logging APIs over to slf4j in hadoop-yarn-api

2017-11-10 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247716#comment-16247716 ] Yeliang Cang commented on YARN-7406: [~bibinchundatt], [~ajisakaa], thank you for the kind review! I

[jira] [Updated] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-11-10 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6102: - Attachment: YARN-6102-branch-2.003-addendum.patch > RMActiveService context to be updated with new

[jira] [Reopened] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-11-10 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reopened YARN-6102: -- Reopening as [~rohithsharma] has another addendum patch due to ATSv2 merge to branch-2. >

[jira] [Updated] (YARN-6078) Containers stuck in Localizing state

2017-11-10 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6078: - Attachment: YARN-6078.003.patch Thanks for the review, [~bibinchundatt]! Those are good

[jira] [Updated] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2017-11-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5881: -- Attachment: (was: YARN-7411-YARN-5881.004.patch) > Enable configuration of queue capacity in terms of

[jira] [Updated] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2017-11-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5881: -- Attachment: YARN-7411-YARN-5881.004.patch Adding testcase. > Enable configuration of queue capacity in terms of

[jira] [Updated] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2017-11-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7411: -- Attachment: YARN-7411-YARN-5881.004.patch Adding a test case to check multi resources in preemption. Thanks

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247380#comment-16247380 ] Hadoop QA commented on YARN-7337: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7471) queueUsagePercentage is wrongly calculated for applications in zero-capacity queues

2017-11-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7471: --- Attachment: YARN-7471.001.patch > queueUsagePercentage is wrongly calculated for applications in zero-capacity

[jira] [Created] (YARN-7471) queueUsagePercentage is wrongly calculated for applications in zero-capacity queues

2017-11-10 Thread Tao Yang (JIRA)
Tao Yang created YARN-7471: -- Summary: queueUsagePercentage is wrongly calculated for applications in zero-capacity queues Key: YARN-7471 URL: https://issues.apache.org/jira/browse/YARN-7471 Project: Hadoop