[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243162#comment-16243162 ] Wangda Tan commented on YARN-7437: -- Thanks [~kkaranasos] for these comments, bq. AppPlacementAllocator:

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243474#comment-16243474 ] Hadoop QA commented on YARN-7159: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242921#comment-16242921 ] Wangda Tan commented on YARN-7442: -- Thanks [~templedf]! I will get an regex expression posted here soon.

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243142#comment-16243142 ] Hadoop QA commented on YARN-7330: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7459) Support RefreshNode API

2017-11-07 Thread darion yaphet (JIRA)
darion yaphet created YARN-7459: --- Summary: Support RefreshNode API Key: YARN-7459 URL: https://issues.apache.org/jira/browse/YARN-7459 Project: Hadoop YARN Issue Type: New Feature

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243436#comment-16243436 ] Hadoop QA commented on YARN-7119: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7437: - Attachment: YARN-7437.004.patch Attached ver.4 patch, [~kkaranasos], could you check again? > Give

[jira] [Commented] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243386#comment-16243386 ] Hadoop QA commented on YARN-7460: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-07 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243119#comment-16243119 ] Robert Kanter commented on YARN-7388: - Looks good overall. A few minor things: # Can you add Javadoc

[jira] [Created] (YARN-7457) Delay scheduling should be an individual policy instead of part of scheduler implementation

2017-11-07 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7457: Summary: Delay scheduling should be an individual policy instead of part of scheduler implementation Key: YARN-7457 URL: https://issues.apache.org/jira/browse/YARN-7457

[jira] [Updated] (YARN-7440) Optimization to AM recovery when the service record doesn't exist for a container

2017-11-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7440: Attachment: YARN-7440.002.patch > Optimization to AM recovery when the service record doesn't exist

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-11-07 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243375#comment-16243375 ] Manikandan R commented on YARN-7159: Fixed whitespace issues. > Normalize unit of resource objects in

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-07 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243371#comment-16243371 ] Manikandan R commented on YARN-7119: Fixed checkstyle errors, findbugs warnings. > yarn rmadmin

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243152#comment-16243152 ] Haibo Chen commented on YARN-7346: -- [~tedyu] How does the conflict arise? In branch-2, the hbase jars are

[jira] [Updated] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7460: - Attachment: YARN-7460-YARN-1011.00.patch > Exclude findbugs warnings on

[jira] [Updated] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7460: - Affects Version/s: YARN-1011 Target Version/s: YARN-1011 > Exclude findbugs warnings on

[jira] [Created] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-07 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7460: Summary: Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers Key: YARN-7460 URL: https://issues.apache.org/jira/browse/YARN-7460

[jira] [Updated] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7460: - Issue Type: Sub-task (was: Bug) Parent: YARN-1011 > Exclude findbugs warnings on

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243285#comment-16243285 ] Hadoop QA commented on YARN-7437: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243300#comment-16243300 ] Hadoop QA commented on YARN-1015: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243213#comment-16243213 ] Daniel Templeton commented on YARN-7413: Oh, whoops. There are whitespace issues. Mind cleaning

[jira] [Updated] (YARN-7413) Support resource type in SLS

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7413: --- Labels: (was: ready-to-commit) > Support resource type in SLS >

[jira] [Commented] (YARN-7447) Fix a couple of issues in services REST API

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243298#comment-16243298 ] Hadoop QA commented on YARN-7447: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243219#comment-16243219 ] Hadoop QA commented on YARN-6128: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7458) TestContainerManagerSecurity is still flakey

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243255#comment-16243255 ] Hadoop QA commented on YARN-7458: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7458) TestContainerManagerSecurity is still flakey

2017-11-07 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-7458: --- Summary: TestContainerManagerSecurity is still flakey Key: YARN-7458 URL: https://issues.apache.org/jira/browse/YARN-7458 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7440) Optimization to AM recovery when the service record doesn't exist for a container

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243206#comment-16243206 ] Hadoop QA commented on YARN-7440: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7458) TestContainerManagerSecurity is still flakey

2017-11-07 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-7458: Attachment: YARN-7458.001.patch There's a few problems here: # This will never fail. It checks that

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242889#comment-16242889 ] Daniel Templeton commented on YARN-7442: I just did. :) I had actually written a response earlier,

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243097#comment-16243097 ] Hadoop QA commented on YARN-6964: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7401) Reduce lock contention in ClusterNodeTracker#getClusterCapacity()

2017-11-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243093#comment-16243093 ] Hudson commented on YARN-7401: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13196 (See

[jira] [Commented] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243151#comment-16243151 ] Hadoop QA commented on YARN-7419: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7330: - Attachment: YARN-7330.004.patch Attached ver.4 patch which rebased to latest trunk. > Add support to show

[jira] [Updated] (YARN-7440) Optimization to AM recovery when the service record doesn't exist for a container

2017-11-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7440: Attachment: YARN-7440.001.patch Changes in patch 1: 1. During recovery if the service master

[jira] [Comment Edited] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243117#comment-16243117 ] Haibo Chen edited comment on YARN-1015 at 11/8/17 12:05 AM: bq. Could the

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243117#comment-16243117 ] Haibo Chen commented on YARN-1015: -- bq. Could the allowed resource for overallocation change later while

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-07 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243067#comment-16243067 ] Botong Huang commented on YARN-6128: V6 patch uploaded addressing [~subru]'s comments. bq. My

[jira] [Updated] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-1015: - Attachment: YARN-1015-YARN-1011.02.patch Upload a patch to address comments on the promotion TODO, space

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243098#comment-16243098 ] Ted Yu commented on YARN-7346: -- Have ATS v2 developers considered shading hbase jars ? With shading,

[jira] [Created] (YARN-7456) TestAMRMClient.testAMRMClientWithContainerResourceChange[0] failed

2017-11-07 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7456: Summary: TestAMRMClient.testAMRMClientWithContainerResourceChange[0] failed Key: YARN-7456 URL: https://issues.apache.org/jira/browse/YARN-7456 Project: Hadoop YARN

[jira] [Commented] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243008#comment-16243008 ] Wangda Tan commented on YARN-6909: -- [~sunilg], it looks the failed unit tests are related, could you

[jira] [Updated] (YARN-7456) TestAMRMClient.testAMRMClientWithContainerResourceChange[0] failed

2017-11-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7456: - Attachment: std.out Attached a log of the unit test failure. >

[jira] [Commented] (YARN-7401) Reduce lock contention in ClusterNodeTracker#getClusterCapacity()

2017-11-07 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243020#comment-16243020 ] Robert Kanter commented on YARN-7401: - +1 > Reduce lock contention in

[jira] [Comment Edited] (YARN-7401) Reduce lock contention in ClusterNodeTracker#getClusterCapacity()

2017-11-07 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243020#comment-16243020 ] Robert Kanter edited comment on YARN-7401 at 11/7/17 10:16 PM: --- +1 thanks

[jira] [Commented] (YARN-3091) [Umbrella] Improve and fix locks of RM scheduler

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243089#comment-16243089 ] Daniel Templeton commented on YARN-3091: I've been doing some performance testing lately as part of

[jira] [Updated] (YARN-6128) Add support for AMRMProxy HA

2017-11-07 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6128: --- Attachment: YARN-6128.v6.patch > Add support for AMRMProxy HA > > >

[jira] [Updated] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-07 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7419: --- Attachment: YARN-7419.2.patch Thanks for the review [~wangda] Attached patch with review

[jira] [Commented] (YARN-7440) Optimization to AM recovery when the service record doesn't exist for a container

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243077#comment-16243077 ] Hadoop QA commented on YARN-7440: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-07 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243047#comment-16243047 ] Konstantinos Karanasos commented on YARN-7437: -- Thanks for the patch, [~leftnoteasy]. Looks

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243031#comment-16243031 ] Eric Yang commented on YARN-7430: - [~shaneku...@gmail.com] {quote} Hey Eric Yang, I'm not sure that's the

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243038#comment-16243038 ] Wangda Tan commented on YARN-7442: -- [~templedf], I tried to make an regex: {code}

[jira] [Updated] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-07 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7419: --- Attachment: YARN-7419.3.patch Had missed removing sumOfChildCapacities from ParentQueue. Fixed

[jira] [Commented] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242924#comment-16242924 ] Hadoop QA commented on YARN-7411: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242878#comment-16242878 ] Hadoop QA commented on YARN-7437: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5591) Update web UIs to reflect multiple resource types

2017-11-07 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242922#comment-16242922 ] Grant Sohn commented on YARN-5591: -- The Applications page and the Scheduler page should include resource

[jira] [Assigned] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh reassigned YARN-6168: --- Assignee: Chandni Singh > Restarted RM may not inform AM about all existing containers >

[jira] [Commented] (YARN-7440) Optimization to AM recovery when the service record doesn't exist for a container

2017-11-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242995#comment-16242995 ] Chandni Singh commented on YARN-7440: - [~jianhe] [~billie.rinaldi] Can you please review the patch?

[jira] [Commented] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242992#comment-16242992 ] Hadoop QA commented on YARN-7143: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7447) Fix a couple of issues in services REST API

2017-11-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7447: Attachment: YARN-7447.002.patch - Removed reflection from the patch. - Ran unit tests manually, and I did

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242855#comment-16242855 ] Arun Suresh commented on YARN-7453: --- Verified it myself on a fresh cluster running 2.9.0 RC. Manual

[jira] [Commented] (YARN-7401) Reduce lock contention in ClusterNodeTracker#getClusterCapacity()

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242985#comment-16242985 ] Daniel Templeton commented on YARN-7401: Now we're clean. [~rkanter], wanna take a last look? >

[jira] [Commented] (YARN-7401) Reduce lock contention in ClusterNodeTracker#getClusterCapacity()

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242980#comment-16242980 ] Hadoop QA commented on YARN-7401: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6964) Fair scheduler misuses Resources operations

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6964: --- Attachment: YARN-6964.011.patch Rebased patch to latest trunk. > Fair scheduler misuses

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242885#comment-16242885 ] Wangda Tan commented on YARN-7442: -- [~templedf], could you share your thoughts on this so we can proceed?

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242883#comment-16242883 ] Daniel Templeton commented on YARN-7442: I would like to make the structure a little clearer. If

[jira] [Assigned] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-7442: Assignee: Wangda Tan > [YARN-7069] Limit format of resource type name >

[jira] [Comment Edited] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-07 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242862#comment-16242862 ] Shane Kumpf edited comment on YARN-7430 at 11/7/17 9:07 PM: {quote} Privileged

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-07 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242862#comment-16242862 ] Shane Kumpf commented on YARN-7430: --- {quote} Privileged container does not need to have --user flag. They

[jira] [Updated] (YARN-7413) Support resource type in SLS

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7413: --- Labels: ready-to-commit (was: ) > Support resource type in SLS >

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242859#comment-16242859 ] Daniel Templeton commented on YARN-7413: Works for me. +1 > Support resource type in SLS >

[jira] [Updated] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7143: --- Attachment: YARN-7143.002.patch Rebased to trunk and removed the return value from

[jira] [Comment Edited] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242852#comment-16242852 ] Daniel Templeton edited comment on YARN-7143 at 11/7/17 8:49 PM: - Rebased

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242782#comment-16242782 ] Jonathan Hung commented on YARN-7453: - Sure, thanks, switched to the RC, but still wasn't able to

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242805#comment-16242805 ] Íñigo Goiri commented on YARN-7453: --- >From the vote for 3.0.0-beta1 RC0, I can see [~rohithsharma] tested

[jira] [Updated] (YARN-7401) Reduce lock contention in ClusterNodeTracker#getClusterCapacity()

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7401: --- Attachment: YARN-7401.002.patch Whoopsee. Looks like the test failures were because of my

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242786#comment-16242786 ] Arun Suresh commented on YARN-7453: --- Thanks [~jhung] !! > RM fail to switch to active after first

[jira] [Updated] (YARN-4081) Add support for multiple resource types in the Resource class

2017-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4081: --- Fix Version/s: 3.0.0 > Add support for multiple resource types in the Resource class >

[jira] [Comment Edited] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242723#comment-16242723 ] Arun Suresh edited comment on YARN-7453 at 11/7/17 7:33 PM: Looks like that is

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242723#comment-16242723 ] Arun Suresh commented on YARN-7453: --- Looks like that is the last commit on *branch-2.9*. Everything else

[jira] [Commented] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242711#comment-16242711 ] Wangda Tan commented on YARN-6507: -- [~tangzhankun], thanks for uploading the patch. Could you update a

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242693#comment-16242693 ] Jonathan Hung commented on YARN-7453: - Hi [~asuresh], actually, I built this from source

[jira] [Updated] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-07 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7430: -- Issue Type: Sub-task (was: Bug) Parent: YARN-3611 > User and Group mapping are incorrect in

[jira] [Updated] (YARN-7446) Docker container privileged mode and --user flag contradict each other

2017-11-07 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7446: -- Issue Type: Sub-task (was: Bug) Parent: YARN-3611 > Docker container privileged mode and --user

[jira] [Updated] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7437: - Attachment: YARN-7437.003.patch Done, [~asuresh] / [~kkaranasos] please take a look when you get chance.

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242656#comment-16242656 ] Wangda Tan commented on YARN-7437: -- Hold on, I need to make few edits. Please give me a few mins. > Give

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242657#comment-16242657 ] Arun Suresh commented on YARN-7453: --- [~jhung], thanks for testing.. Were you testing this on trunk or the

[jira] [Comment Edited] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242591#comment-16242591 ] Jonathan Hung edited comment on YARN-7453 at 11/7/17 7:02 PM: -- Hmm, YARN-6840

[jira] [Updated] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7437: - Attachment: YARN-7437.002.patch Just renamed to -AppPlacementAllocator. [~asuresh]/[~kkaranasos], mind

[jira] [Assigned] (YARN-7197) Add support for a volume blacklist for docker containers

2017-11-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7197: --- Assignee: (was: Eric Yang) > Add support for a volume blacklist for docker containers >

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242634#comment-16242634 ] ASF GitHub Bot commented on YARN-6483: -- GitHub user juanrh opened a pull request:

[jira] [Commented] (YARN-7401) Reduce lock contention in ClusterNodeTracker#getClusterCapacity()

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242632#comment-16242632 ] Hadoop QA commented on YARN-7401: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-11-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242631#comment-16242631 ] Eric Yang commented on YARN-7197: - [~shaneku...@gmail.com] {quote} I'm aware of the differences between

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242625#comment-16242625 ] Arun Suresh commented on YARN-7437: --- Thanks for raising this [~wangda], I like AppPlacementAllocator. >

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242612#comment-16242612 ] Wangda Tan commented on YARN-7437: -- [~kkaranasos], I'm fine with both of AppPlacement or

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-11-07 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242605#comment-16242605 ] Shane Kumpf commented on YARN-7197: --- I'm aware of the differences between mounting the socket and true

[jira] [Commented] (YARN-7454) RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup

2017-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242602#comment-16242602 ] Hadoop QA commented on YARN-7454: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7446) Docker container privileged mode and --user flag contradict each other

2017-11-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7446: --- Assignee: Eric Yang > Docker container privileged mode and --user flag contradict each other >

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242591#comment-16242591 ] Jonathan Hung commented on YARN-7453: - Hmm, YARN-6840 shouldn't affect it, especially if you are not

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242590#comment-16242590 ] Eric Yang commented on YARN-7430: - Hi [~vvasudev], Privileged container does not need to have --user flag.

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-11-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242583#comment-16242583 ] Eric Yang commented on YARN-7197: - [~shaneku...@gmail.com] {quote} Unfortunately, I've recently encountered

  1   2   >