[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-11-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247143#comment-16247143 ] Tao Yang commented on YARN-7461: Thanks [~templedf] for your comments. I wrongly assumed that lhs is fit

[jira] [Commented] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247052#comment-16247052 ] Hadoop QA commented on YARN-7419: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247039#comment-16247039 ] Haibo Chen commented on YARN-7337: -- The unit tests are unrelated. Will update the patch to address

[jira] [Updated] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7337: - Attachment: YARN-7337-YARN-1011.03.patch > Expose per-node over-allocation info in Node Report >

[jira] [Commented] (YARN-6078) Containers stuck in Localizing state

2017-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247029#comment-16247029 ] Bibin A Chundatt commented on YARN-6078: Thank you [~billie.rinaldi] for explanation Some minor

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247017#comment-16247017 ] Hadoop QA commented on YARN-7337: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7445) Render filters on Applications and Services page

2017-11-09 Thread Vasudevan Skm (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasudevan Skm updated YARN-7445: Attachment: YARN-7445.004.patch > Render filters on Applications and Services page >

[jira] [Commented] (YARN-7470) TestYarnNativeServices testRecoverComponentsAfterRMRestart fails due to BindingException

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246952#comment-16246952 ] Hadoop QA commented on YARN-7470: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-09 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7419: --- Attachment: YARN-7419.5.patch Fixed some checkstyle issues and added missing return for

[jira] [Commented] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246912#comment-16246912 ] Hadoop QA commented on YARN-7419: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246880#comment-16246880 ] Haibo Chen commented on YARN-7337: -- Updated the patch to -depreciate exisiting getUsed api. -add

[jira] [Updated] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7337: - Attachment: YARN-7337-YARN-1011.02.patch > Expose per-node over-allocation info in Node Report >

[jira] [Comment Edited] (YARN-7369) Improve the resource types docs

2017-11-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246874#comment-16246874 ] Sunil G edited comment on YARN-7369 at 11/10/17 1:34 AM: - patch5 is missing

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-11-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246874#comment-16246874 ] Sunil G commented on YARN-7369: --- patch5 is missing ResourceModeal.md file changes > Improve the resource

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246818#comment-16246818 ] Hadoop QA commented on YARN-7369: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7470) TestYarnNativeServices testRecoverComponentsAfterRMRestart fails due to BindingException

2017-11-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246807#comment-16246807 ] Chandni Singh commented on YARN-7470: - For recovery test, the NM needs to connect to RM using RPC which

[jira] [Updated] (YARN-7470) TestYarnNativeServices testRecoverComponentsAfterRMRestart fails due to BindingException

2017-11-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7470: Attachment: YARN-7470.001.patch > TestYarnNativeServices testRecoverComponentsAfterRMRestart fails

[jira] [Commented] (YARN-6909) Use LightWeightedResource when number of resource types more than two

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246798#comment-16246798 ] Hudson commented on YARN-6909: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13214 (See

[jira] [Commented] (YARN-7465) start-yarn.sh fails to start ResourceManager unless running as root

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246797#comment-16246797 ] Hudson commented on YARN-7465: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13214 (See

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246789#comment-16246789 ] Haibo Chen commented on YARN-7337: -- That sounds good to me. Will address it in the next patch. > Expose

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246786#comment-16246786 ] Miklos Szegedi commented on YARN-7337: -- Why do not we create a getTotalNumContainers,

[jira] [Created] (YARN-7470) TestYarnNativeServices testRecoverComponentsAfterRMRestart fails due to BindingException

2017-11-09 Thread Chandni Singh (JIRA)
Chandni Singh created YARN-7470: --- Summary: TestYarnNativeServices testRecoverComponentsAfterRMRestart fails due to BindingException Key: YARN-7470 URL: https://issues.apache.org/jira/browse/YARN-7470

[jira] [Commented] (YARN-7468) Provide means for container network policy control

2017-11-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246778#comment-16246778 ] Allen Wittenauer commented on YARN-7468: bq. Ideally, I'd have all the external endpoints secured

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246751#comment-16246751 ] Daniel Templeton commented on YARN-7442: Findbugs is unrelated. > [YARN-7069] Limit format of

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246750#comment-16246750 ] Hadoop QA commented on YARN-7442: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246744#comment-16246744 ] Chandni Singh commented on YARN-6168: - The default value of {{nmExpiryInterval}} is 10 minutes. That

[jira] [Commented] (YARN-6078) Containers stuck in Localizing state

2017-11-09 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246741#comment-16246741 ] Billie Rinaldi commented on YARN-6078: -- Thanks for taking a look, [~djp]! This is a good question. As

[jira] [Updated] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-09 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7419: --- Attachment: YARN-7419.4.patch Thanks [~wangda] Fixed most of the review comments. >

[jira] [Commented] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-09 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246724#comment-16246724 ] Suma Shivaprasad commented on YARN-7419: Thanks Suma Shivaprasad for updating the patch, more

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246731#comment-16246731 ] Daniel Templeton commented on YARN-7119: I have just a few comments: # The new public methods in

[jira] [Updated] (YARN-6909) Use LightWeightedResource when number of resource types more than two

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6909: - Summary: Use LightWeightedResource when number of resource types more than two (was: The performance

[jira] [Commented] (YARN-6078) Containers stuck in Localizing state

2017-11-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246713#comment-16246713 ] Junping Du commented on YARN-6078: -- Thanks [~billie.rinaldi] for updating the patch! A quick question

[jira] [Updated] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7469: - Attachment: UnitTestToShowStarvedUser.patch Uploading a unit test that demonstrates this. > Capacity

[jira] [Updated] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7469: - Description: Queue Configuration: - Total Memory: 20GB - 2 Queues -- Queue1 --- Memory: 10GB --- MULP: 10%

[jira] [Updated] (YARN-7369) Improve the resource types docs

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7369: --- Attachment: YARN-7369.005.patch YARN-7369.branch-3.0.001.patch Darn it. I

[jira] [Created] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-09 Thread Eric Payne (JIRA)
Eric Payne created YARN-7469: Summary: Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit Key: YARN-7469 URL: https://issues.apache.org/jira/browse/YARN-7469

[jira] [Updated] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7413: --- Fix Version/s: 3.0.0 > Support resource type in SLS > > > Key:

[jira] [Commented] (YARN-5422) ContainerLocalizer log should be logged in separate log file.

2017-11-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1624#comment-1624 ] Junping Du commented on YARN-5422: -- CC [~suma.shivaprasad]. Suma, does your previous work of separating

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246647#comment-16246647 ] Daniel Templeton commented on YARN-7442: LGTM, +1 pending Jenkins. > [YARN-7069] Limit format of

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246651#comment-16246651 ] Daniel Templeton commented on YARN-7369: Thanks. I'll commit it along with YARN-7442. > Improve

[jira] [Created] (YARN-7468) Provide means for container network policy control

2017-11-09 Thread Clay B. (JIRA)
Clay B. created YARN-7468: - Summary: Provide means for container network policy control Key: YARN-7468 URL: https://issues.apache.org/jira/browse/YARN-7468 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7442: - Attachment: YARN-7442.003.patch Attached ver.3 patch. > [YARN-7069] Limit format of resource type name >

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246618#comment-16246618 ] Daniel Templeton commented on YARN-7413: The patch didn't apply for me on branch-3.0. How did you

[jira] [Commented] (YARN-7080) TestSubmitApplicationWithRMHA times out

2017-11-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246628#comment-16246628 ] Jason Lowe commented on YARN-7080: -- I think this may be essentially a duplicate of YARN-6647. I've seen

[jira] [Commented] (YARN-7437) Rename PlacementSet and SchedulingPlacementSet

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246614#comment-16246614 ] Wangda Tan commented on YARN-7437: -- Thanks [~kkaranasos]/[~asuresh]/[~subru] for review and commit! >

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246636#comment-16246636 ] Wangda Tan commented on YARN-7369: -- +1 for the latest patch. > Improve the resource types docs >

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246630#comment-16246630 ] Hadoop QA commented on YARN-7442: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246610#comment-16246610 ] Yufei Gu commented on YARN-7413: Committed to branch-3.0. > Support resource type in SLS >

[jira] [Commented] (YARN-7468) Provide means for container network policy control

2017-11-09 Thread Clay B. (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246626#comment-16246626 ] Clay B. commented on YARN-7468: --- For the driving use-case, I run secure clusters (secured on the inside to

[jira] [Commented] (YARN-6505) Define the strings used in SLS JSON input file format

2017-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246606#comment-16246606 ] Yufei Gu commented on YARN-6505: Committed to branch-3.0 > Define the strings used in SLS JSON input file

[jira] [Updated] (YARN-6505) Define the strings used in SLS JSON input file format

2017-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6505: --- Fix Version/s: 3.0.0 > Define the strings used in SLS JSON input file format >

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246580#comment-16246580 ] Daniel Templeton commented on YARN-7442: I updated YARN-7369. Wanna review it so we can get it

[jira] [Commented] (YARN-7437) Rename PlacementSet and SchedulingPlacementSet

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246588#comment-16246588 ] Hudson commented on YARN-7437: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13213 (See

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246586#comment-16246586 ] Hudson commented on YARN-7413: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13213 (See

[jira] [Commented] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246585#comment-16246585 ] Hudson commented on YARN-7143: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13213 (See

[jira] [Commented] (YARN-7386) Duplicate Strings in various places in Yarn memory

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246587#comment-16246587 ] Hudson commented on YARN-7386: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13213 (See

[jira] [Updated] (YARN-7369) Improve the resource types docs

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7369: --- Attachment: YARN-7369.004.patch Updated to reflect YARN-7442, > Improve the resource types

[jira] [Commented] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246574#comment-16246574 ] Haibo Chen commented on YARN-7460: -- This is so that read of the container numbers does not need to grab a

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246571#comment-16246571 ] Haibo Chen commented on YARN-7337: -- Thanks for the review, [~miklos.szeg...@cloudera.com]. bq. naming a

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246565#comment-16246565 ] Daniel Templeton commented on YARN-7442: Seems like a good enough reason. > [YARN-7069] Limit

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246561#comment-16246561 ] Wangda Tan commented on YARN-7442: -- Thanks [~templedf], Will address #1/#2. And regarding to the doc,

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246563#comment-16246563 ] Haibo Chen commented on YARN-7388: -- Sounds good. Thanks for the update! > TestAMRestart should be

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246529#comment-16246529 ] Yufei Gu commented on YARN-7413: Thanks for the review and commit, [~templedf]! > Support resource type in

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-11-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246522#comment-16246522 ] Subru Krishnan commented on YARN-7466: -- FWIW, +1 from my side too. Thanks [~csingh]/[~jianhe]. >

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246528#comment-16246528 ] Daniel Templeton commented on YARN-7442: Thanks, [~leftnoteasy]. Two comments: #

[jira] [Updated] (YARN-7437) Rename PlacementSet and SchedulingPlacementSet

2017-11-09 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-7437: - Summary: Rename PlacementSet and SchedulingPlacementSet (was: Give

[jira] [Commented] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246488#comment-16246488 ] Wangda Tan commented on YARN-6909: -- Patch looks good, will commit by end of today if no opposite opinions.

[jira] [Commented] (YARN-6595) [API] Add Placement Constraints at the application level

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246517#comment-16246517 ] Wangda Tan commented on YARN-6595: -- [~asuresh], thanks for the patch. Could you add javadocs with examples

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-09 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246500#comment-16246500 ] Konstantinos Karanasos commented on YARN-7437: -- Yeah, was checking it now, committing. > Give

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246485#comment-16246485 ] Wangda Tan commented on YARN-7437: -- The failed unit test is not related to the patch. > Give

[jira] [Updated] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7442: - Attachment: YARN-7442.002.patch Attached ver.2 patch using latest pattern from Daniel. > [YARN-7069]

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246483#comment-16246483 ] Hadoop QA commented on YARN-7437: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7205) Log improvements for the ResourceUtils

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7205: --- Fix Version/s: 3.0.0 Backported into branch-3.0 > Log improvements for the ResourceUtils >

[jira] [Commented] (YARN-7386) Duplicate Strings in various places in Yarn memory

2017-11-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246413#comment-16246413 ] Robert Kanter commented on YARN-7386: - {{TestSubmitApplicationWithRMHA}} time out is unrelated

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246410#comment-16246410 ] Subru Krishnan commented on YARN-6128: -- Thanks [~botong] for addressing my comments, the latest patch

[jira] [Commented] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246403#comment-16246403 ] Daniel Templeton commented on YARN-7143: Nevermind on the branch-3.0 patch. Backporting YARN-7205

[jira] [Updated] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7143: --- Attachment: YARN-7143.branch-3.0.002.patch Here's a functional branch-3.0 patch >

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246375#comment-16246375 ] Daniel Templeton commented on YARN-7442: Oh, crap, you're right. Redo:

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246376#comment-16246376 ] Subru Krishnan commented on YARN-7388: -- [~haibo.chen], thanks for fixing this and [~rkanter] for the

[jira] [Commented] (YARN-7453) Fix issue where RM fails to switch to active after first successful start

2017-11-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246371#comment-16246371 ] Subru Krishnan commented on YARN-7453: -- Thanks [~rohithsharma], [~jhung], [~asuresh], [~leftnoteasy],

[jira] [Commented] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246360#comment-16246360 ] Hadoop QA commented on YARN-7143: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7442: - Attachment: YARN-7442.001.patch Attached ver.1 patch, [~templedf] could u please review? > [YARN-7069]

[jira] [Commented] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246351#comment-16246351 ] Miklos Szegedi commented on YARN-7460: -- Thank you for the patch [~haibochen]. The callers are

[jira] [Commented] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246340#comment-16246340 ] Hadoop QA commented on YARN-6909: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7413: --- Labels: ready-to-commit (was: ) > Support resource type in SLS >

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246339#comment-16246339 ] Daniel Templeton commented on YARN-7413: LGTM +1 > Support resource type in SLS >

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246336#comment-16246336 ] Daniel Templeton commented on YARN-7461: Just noticed that this patch is assuming that if the rhs

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-11-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246329#comment-16246329 ] Jian He commented on YARN-7466: --- lgtm, committing soon > ResourceRequest has a different default for

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246323#comment-16246323 ] Wangda Tan commented on YARN-7442: -- [~templedf], I agree with the simplified version, except one minor

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246296#comment-16246296 ] Haibo Chen commented on YARN-7388: -- [~subru] Let me know if it is still ok to cherry-pick this into 2.9.0.

[jira] [Commented] (YARN-7465) start-yarn.sh fails to start ResourceManager unless running as root

2017-11-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246273#comment-16246273 ] Andrew Wang commented on YARN-7465: --- +1 thanks Sean! > start-yarn.sh fails to start ResourceManager

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246313#comment-16246313 ] Arun Suresh commented on YARN-1015: --- I am fine with approach of the patch - but do give me a day or so to

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246308#comment-16246308 ] Miklos Szegedi commented on YARN-7337: -- Thank you for the patch [~haibochen]. {code} 168* Get

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246310#comment-16246310 ] Hudson commented on YARN-7388: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13212 (See

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246305#comment-16246305 ] Daniel Templeton commented on YARN-7442: Seems a fine idea, [~andrew.wang]. I'm generally OK with

[jira] [Comment Edited] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246305#comment-16246305 ] Daniel Templeton edited comment on YARN-7442 at 11/9/17 7:10 PM: - Seems a

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246282#comment-16246282 ] Wangda Tan commented on YARN-7442: -- [~andrew.wang], I will start it now and hopefully finish it by this

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246270#comment-16246270 ] Miklos Szegedi commented on YARN-1015: -- [~asuresh], do you have more comments on this patch?

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246269#comment-16246269 ] Andrew Wang commented on YARN-7442: --- Hey, is this JIRA moving forwards? It's our last blocker for GA. Is

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246266#comment-16246266 ] Hadoop QA commented on YARN-7466: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >