[jira] [Commented] (YARN-8548) AllocationRespose proto setNMToken initBuilder not done

2018-07-20 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551533#comment-16551533 ] Bibin A Chundatt commented on YARN-8548: [~BilwaST] Thank you for the patch. Seems the assertions

[jira] [Comment Edited] (YARN-8548) AllocationRespose proto setNMToken initBuilder not done

2018-07-20 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551533#comment-16551533 ] Bibin A Chundatt edited comment on YARN-8548 at 7/21/18 4:55 AM: -

[jira] [Commented] (YARN-8270) Adding JMX Metrics for Timeline Collector and Reader

2018-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551518#comment-16551518 ] Vrushali C commented on YARN-8270: -- No worries, thanks for letting us know [~haibochen] ! > Adding JMX

[jira] [Commented] (YARN-8498) Yarn NodeManager OOM Listener Fails Compilation on Ubuntu 18.04

2018-07-20 Thread Jack Bearden (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551513#comment-16551513 ] Jack Bearden commented on YARN-8498: Hey [~haibochen]! I didn't get that set of errors unfortunately.

[jira] [Commented] (YARN-8561) Add submarine initial implementation: training job submission and job history retrieve.

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551511#comment-16551511 ] genericqa commented on YARN-8561: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8522) Application fails with InvalidResourceRequestException

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551499#comment-16551499 ] genericqa commented on YARN-8522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8135) Hadoop {Submarine} Project: Simple and scalable deployment of deep learning training / serving jobs on Hadoop

2018-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8135: - Attachment: (was: YARN-8135.poc.001.patch) > Hadoop {Submarine} Project: Simple and scalable

[jira] [Commented] (YARN-8135) Hadoop {Submarine} Project: Simple and scalable deployment of deep learning training / serving jobs on Hadoop

2018-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551490#comment-16551490 ] Wangda Tan commented on YARN-8135: -- Discussed with many folks, thanks inputs from: [~sunilg],

[jira] [Commented] (YARN-8561) Add submarine initial implementation: training job submission and job history retrieve.

2018-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551487#comment-16551487 ] Wangda Tan commented on YARN-8561: -- Attached initial patch to get some early feedbacks. Please refer to

[jira] [Updated] (YARN-8561) Add submarine initial implementation: training job submission and job history retrieve.

2018-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8561: - Attachment: YARN-8561.001.patch > Add submarine initial implementation: training job submission and job

[jira] [Created] (YARN-8561) Add submarine initial implementation: training job submission and job history retrieve.

2018-07-20 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8561: Summary: Add submarine initial implementation: training job submission and job history retrieve. Key: YARN-8561 URL: https://issues.apache.org/jira/browse/YARN-8561 Project:

[jira] [Commented] (YARN-8522) Application fails with InvalidResourceRequestException

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551473#comment-16551473 ] genericqa commented on YARN-8522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8498) Yarn NodeManager OOM Listener Fails Compilation on Ubuntu 18.04

2018-07-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551471#comment-16551471 ] Haibo Chen commented on YARN-8498: -- I have finally been able to setup a Ubuntu 18.04 machine to reproduce

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

2018-07-20 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551467#comment-16551467 ] Zian Chen commented on YARN-8509: - [~sunilg], Let me address the failed UTs first. > Fix UserLimit

[jira] [Commented] (YARN-8301) Yarn Service Upgrade: Add documentation

2018-07-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551448#comment-16551448 ] Hudson commented on YARN-8301: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14611 (See

[jira] [Commented] (YARN-8429) Improve diagnostic message when artifact is not set properly

2018-07-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551432#comment-16551432 ] Eric Yang commented on YARN-8429: - [~gsaha] Thank you for the patch. The patch looks good. One minor

[jira] [Commented] (YARN-8380) Support shared mounts in docker runtime

2018-07-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551424#comment-16551424 ] Eric Yang commented on YARN-8380: - Here are order of my preferences: 1. Support format 1, 2, 3, 4. Use

[jira] [Commented] (YARN-8301) Yarn Service Upgrade: Add documentation

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551417#comment-16551417 ] genericqa commented on YARN-8301: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8360) Yarn service conflict between restart policy and NM configuration

2018-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8360: - Target Version/s: 3.2.0, 3.1.2 Priority: Critical (was: Major) > Yarn service conflict

[jira] [Updated] (YARN-8301) Yarn Service Upgrade: Add documentation

2018-07-20 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8301: Attachment: YARN-8301.007.patch > Yarn Service Upgrade: Add documentation >

[jira] [Commented] (YARN-8429) Improve diagnostic message when artifact is not set properly

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551349#comment-16551349 ] genericqa commented on YARN-8429: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8330) An extra container got launched by RM for yarn-service

2018-07-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551338#comment-16551338 ] Jason Lowe commented on YARN-8330: -- To me this all depends upon the intent of how the ATS data is going

[jira] [Commented] (YARN-8525) RegistryDNS tcp channel stops working on interrupts

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551339#comment-16551339 ] genericqa commented on YARN-8525: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

2018-07-20 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551334#comment-16551334 ] Zian Chen commented on YARN-8509: - Upload first patch for review. [~sunilg],could you help review the

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

2018-07-20 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.001.patch > Fix UserLimit calculation for preemption to balance scenario after queue

[jira] [Commented] (YARN-8429) Improve diagnostic message when artifact is not set properly

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551300#comment-16551300 ] genericqa commented on YARN-8429: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8525) RegistryDNS tcp channel stops working on interrupts

2018-07-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551289#comment-16551289 ] Eric Yang commented on YARN-8525: - [~billie.rinaldi] Thank you for catching the other bug where exception

[jira] [Updated] (YARN-8525) RegistryDNS tcp channel stops working on interrupts

2018-07-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8525: Attachment: YARN-8525.002.patch > RegistryDNS tcp channel stops working on interrupts >

[jira] [Updated] (YARN-8429) Improve diagnostic message when artifact is not set properly

2018-07-20 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-8429: Attachment: YARN-8429.002.patch > Improve diagnostic message when artifact is not set properly >

[jira] [Commented] (YARN-8429) Improve diagnostic message when artifact is not set properly

2018-07-20 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551276#comment-16551276 ] Gour Saha commented on YARN-8429: - Uploaded 002 with a test fix. > Improve diagnostic message when

[jira] [Updated] (YARN-8544) [DS] AM registration fails when hadoop authorization is enabled

2018-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8544: - Target Version/s: 3.2.0, 3.1.2 (was: 3.1.1) > [DS] AM registration fails when hadoop authorization is

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551245#comment-16551245 ] Wangda Tan commented on YARN-8480: -- [~templedf], {quote}It also looks to me like the PCM is an

[jira] [Commented] (YARN-8544) [DS] AM registration fails when hadoop authorization is enabled

2018-07-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551243#comment-16551243 ] Arun Suresh commented on YARN-8544: --- w.r.t the patch, it looks fine. Any reason why we want to do lazy

[jira] [Assigned] (YARN-8545) YARN native service should return container if launch failed

2018-07-20 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh reassigned YARN-8545: --- Assignee: Chandni Singh > YARN native service should return container if launch failed >

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-20 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551228#comment-16551228 ] Daniel Templeton commented on YARN-8480: I read through both node attributes and rich placement

[jira] [Updated] (YARN-8429) Improve diagnostic message when artifact is not set properly

2018-07-20 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-8429: Fix Version/s: (was: 3.1.1) 3.1.2 > Improve diagnostic message when artifact is not

[jira] [Commented] (YARN-8429) Improve diagnostic message when artifact is not set properly

2018-07-20 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551208#comment-16551208 ] Gour Saha commented on YARN-8429: - [~eyang] please review when you get a chance. It's a usability

[jira] [Commented] (YARN-8429) Improve diagnostic message when artifact is not set properly

2018-07-20 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551204#comment-16551204 ] Gour Saha commented on YARN-8429: - [~yeshavora], with this patch the error msg will change to - {code} For

[jira] [Updated] (YARN-8429) Improve diagnostic message when artifact is not set properly

2018-07-20 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-8429: Fix Version/s: 3.1.1 3.2.0 > Improve diagnostic message when artifact is not set

[jira] [Updated] (YARN-8429) Improve diagnostic message when artifact is not set properly

2018-07-20 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-8429: Attachment: YARN-8429.001.patch > Improve diagnostic message when artifact is not set properly >

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551179#comment-16551179 ] genericqa commented on YARN-4606: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8330) An extra container got launched by RM for yarn-service

2018-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551137#comment-16551137 ] Wangda Tan commented on YARN-8330: -- [~rohithsharma],  To me it is fine that we publish

[jira] [Commented] (YARN-8330) An extra container got launched by RM for yarn-service

2018-07-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551118#comment-16551118 ] Rohith Sharma K S commented on YARN-8330: - Thanks [~suma.shivaprasad] for working on this patch.

[jira] [Commented] (YARN-8541) RM startup failure on recovery after user deletion

2018-07-20 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1655#comment-1655 ] Suma Shivaprasad commented on YARN-8541: Thanks [~sunilg] and [~bibinchundatt] . Patch LGTM . +1

[jira] [Commented] (YARN-8520) Document best practice for user management

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551086#comment-16551086 ] genericqa commented on YARN-8520: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2018-07-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551080#comment-16551080 ] Hudson commented on YARN-6964: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14604 (See

[jira] [Commented] (YARN-8559) Expose scheduling configuration info in Resource Manager's /conf endpoint

2018-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551066#comment-16551066 ] Wangda Tan commented on YARN-8559: -- [~cheersyang] / [~banditka],  Actually the scheduler-conf was not

[jira] [Commented] (YARN-8418) App local logs could leaked if log aggregation fails to initialize for the app

2018-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551057#comment-16551057 ] Wangda Tan commented on YARN-8418: -- For logics of the patch, a couple of comments:  1) Is it possible to

[jira] [Comment Edited] (YARN-8380) Support shared mounts in docker runtime

2018-07-20 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551033#comment-16551033 ] Billie Rinaldi edited comment on YARN-8380 at 7/20/18 5:46 PM: --- Ah, I see. I

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2018-07-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551046#comment-16551046 ] Haibo Chen commented on YARN-6964: -- +1. Will check it in shortly. > Fair scheduler misuses Resources

[jira] [Commented] (YARN-8418) App local logs could leaked if log aggregation fails to initialize for the app

2018-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551034#comment-16551034 ] Wangda Tan commented on YARN-8418: -- [~bibinchundatt],  {quote}As part of YARN-4984 we disabled the thread

[jira] [Commented] (YARN-8380) Support shared mounts in docker runtime

2018-07-20 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551033#comment-16551033 ] Billie Rinaldi commented on YARN-8380: -- Ah, I see. I didn't realize some of the options were

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-07-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551028#comment-16551028 ] Haibo Chen commented on YARN-6966: -- +1 from me pending some other checkstyle issues  I came across 1)

[jira] [Updated] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-07-20 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-4606: --- Attachment: YARN-4606.007.patch > CapacityScheduler: applications could get starved because

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-07-20 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551016#comment-16551016 ] Manikandan R commented on YARN-4606: [~eepayne] Attaching .007 patch containing #2, #3 & #4. Please

[jira] [Commented] (YARN-8541) RM startup failure on recovery after user deletion

2018-07-20 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550998#comment-16550998 ] Sunil Govindan commented on YARN-8541: -- Changes looks fine to me. [~suma.shivaprasad] do you have

[jira] [Updated] (YARN-8520) Document best practice for user management

2018-07-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8520: Attachment: YARN-8520.001.patch > Document best practice for user management >

[jira] [Commented] (YARN-7974) Allow updating application tracking url after registration

2018-07-20 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550991#comment-16550991 ] Jonathan Hung commented on YARN-7974: - Thanks [~leftnoteasy]. The unit test failures don't seem

[jira] [Commented] (YARN-8559) Expose scheduling configuration info in Resource Manager's /conf endpoint

2018-07-20 Thread Anna Savarin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550892#comment-16550892 ] Anna Savarin commented on YARN-8559: Ah, did not find it by myself :) Great, thanks so much! > Expose

[jira] [Resolved] (YARN-8559) Expose scheduling configuration info in Resource Manager's /conf endpoint

2018-07-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YARN-8559. --- Resolution: Not A Problem Target Version/s: 3.1.0, 3.0.0 (was: 3.0.0, 3.1.0) > Expose

[jira] [Commented] (YARN-8559) Expose scheduling configuration info in Resource Manager's /conf endpoint

2018-07-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550889#comment-16550889 ] Weiwei Yang commented on YARN-8559: --- Hi [~banditka], I think was added via YARN-5952, it is available

[jira] [Commented] (YARN-8559) Expose scheduling configuration info in Resource Manager's /conf endpoint

2018-07-20 Thread Anna Savarin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550881#comment-16550881 ] Anna Savarin commented on YARN-8559: Hi [~cheersyang], Sure, this is absolutely enough.  Can you

[jira] [Commented] (YARN-8528) Final states in ContainerAllocation might be modified externally causing unexpected allocation results

2018-07-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550875#comment-16550875 ] Weiwei Yang commented on YARN-8528: --- Pushed to trunk and branch-3.1, thanks [~wuzang] for the

[jira] [Created] (YARN-8560) TestCapacityScheduler#testCSReservationWithRootUnblocked fails on branch-3.0

2018-07-20 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8560: - Summary: TestCapacityScheduler#testCSReservationWithRootUnblocked fails on branch-3.0 Key: YARN-8560 URL: https://issues.apache.org/jira/browse/YARN-8560 Project: Hadoop

[jira] [Comment Edited] (YARN-8544) [DS] AM registration fails when hadoop authorization is enabled

2018-07-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550306#comment-16550306 ] Arun Suresh edited comment on YARN-8544 at 7/20/18 3:08 PM: Thanks for raising

[jira] [Commented] (YARN-8528) Final states in ContainerAllocation might be modified externally causing unexpected allocation results

2018-07-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550865#comment-16550865 ] Hudson commented on YARN-8528: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14600 (See

[jira] [Commented] (YARN-8548) AllocationRespose proto setNMToken initBuilder not done

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550833#comment-16550833 ] genericqa commented on YARN-8548: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8528) Final states in ContainerAllocation might be modified externally causing unexpected allocation results

2018-07-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550829#comment-16550829 ] Weiwei Yang commented on YARN-8528: --- +1, committing shortly > Final states in ContainerAllocation might

[jira] [Updated] (YARN-8528) Final states in ContainerAllocation might be modified externally causing unexpected allocation results

2018-07-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8528: -- Summary: Final states in ContainerAllocation might be modified externally causing unexpected allocation

[jira] [Updated] (YARN-8528) Final states in ContainerAllocation might be modified externally

2018-07-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8528: -- Summary: Final states in ContainerAllocation might be modified externally (was:

[jira] [Commented] (YARN-8559) Expose scheduling configuration info in Resource Manager's /conf endpoint

2018-07-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550818#comment-16550818 ] Weiwei Yang commented on YARN-8559: --- Hi [~banditka] For the scheduler conf, we have exposed them via

[jira] [Updated] (YARN-8559) Expose scheduling configuration info in Resource Manager's /conf endpoint

2018-07-20 Thread Anna Savarin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anna Savarin updated YARN-8559: --- Description: All Hadoop services provide a set of common endpoints (/stacks, /logLevel, /metrics,

[jira] [Created] (YARN-8559) Expose scheduling configuration info in Resource Manager's /conf endpoint

2018-07-20 Thread Anna Savarin (JIRA)
Anna Savarin created YARN-8559: -- Summary: Expose scheduling configuration info in Resource Manager's /conf endpoint Key: YARN-8559 URL: https://issues.apache.org/jira/browse/YARN-8559 Project: Hadoop

[jira] [Commented] (YARN-8528) ContainerAllocation.state should be private and unchangeable

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550733#comment-16550733 ] genericqa commented on YARN-8528: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8548) AllocationRespose proto setNMToken initBuilder not done

2018-07-20 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550723#comment-16550723 ] Bilwa S T commented on YARN-8548: - [~bibinchundatt] I have added test case for it > AllocationRespose

[jira] [Updated] (YARN-8548) AllocationRespose proto setNMToken initBuilder not done

2018-07-20 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-8548: Attachment: YARN-8548-003.patch > AllocationRespose proto setNMToken initBuilder not done >

[jira] [Commented] (YARN-8558) NM recovery level db not cleaned up properly on container finish

2018-07-20 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550703#comment-16550703 ] Bibin A Chundatt commented on YARN-8558: On container removal the following are missing .

[jira] [Updated] (YARN-8558) NM recovery level db not cleaned up properly on container finish

2018-07-20 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8558: --- Affects Version/s: 3.0.0 3.1.0 > NM recovery level db not cleaned up

[jira] [Updated] (YARN-8558) NM recovery level db not cleaned up properly on container finish

2018-07-20 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8558: --- Description: {code} 2018-07-20 16:49:23,117 INFO

[jira] [Updated] (YARN-8558) NM recovery level db not cleaned up properly on container finish

2018-07-20 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8558: --- Priority: Critical (was: Blocker) > NM recovery level db not cleaned up properly on

[jira] [Updated] (YARN-8558) NM recovery level db not cleaned up properly on container finish

2018-07-20 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8558: --- Target Version/s: 3.1.1 > NM recovery level db not cleaned up properly on container finish >

[jira] [Created] (YARN-8558) NM recovery level db not cleaned up properly on container finish

2018-07-20 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-8558: -- Summary: NM recovery level db not cleaned up properly on container finish Key: YARN-8558 URL: https://issues.apache.org/jira/browse/YARN-8558 Project: Hadoop

[jira] [Commented] (YARN-8541) RM startup failure on recovery after user deletion

2018-07-20 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550641#comment-16550641 ] Bibin A Chundatt commented on YARN-8541: Testcase failures seems not related to patch attached >

[jira] [Commented] (YARN-8541) RM startup failure on recovery after user deletion

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550622#comment-16550622 ] genericqa commented on YARN-8541: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550613#comment-16550613 ] genericqa commented on YARN-6964: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-8528) ContainerAllocation.state should be private and unchangeable

2018-07-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-8528: - Assignee: Xintong Song > ContainerAllocation.state should be private and unchangeable >

[jira] [Commented] (YARN-8554) Add more E2E tests for placement constraints

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550604#comment-16550604 ] genericqa commented on YARN-8554: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8528) ContainerAllocation.state should be private and unchangeable

2018-07-20 Thread Xintong Song (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated YARN-8528: --- Attachment: (was: YARN-8528.001.patch) > ContainerAllocation.state should be private and

[jira] [Commented] (YARN-8546) A reserved container might be released multiple times under async scheduling

2018-07-20 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550537#comment-16550537 ] genericqa commented on YARN-8546: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8543) Prometheus /metrics http endpoint for monitoring integration

2018-07-20 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated YARN-8543: -- Affects Version/s: 2.7.3 > Prometheus /metrics http endpoint for monitoring integration >

[jira] [Updated] (YARN-8543) Prometheus /metrics http endpoint for monitoring integration

2018-07-20 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated YARN-8543: -- Component/s: metrics > Prometheus /metrics http endpoint for monitoring integration >

[jira] [Updated] (YARN-8543) Prometheus /metrics http endpoint for monitoring integration

2018-07-20 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated YARN-8543: -- Affects Version/s: 3.0.3 > Prometheus /metrics http endpoint for monitoring integration >

[jira] [Created] (YARN-8557) Exclude lagged/unhealthy/decommissioned nodes in async allocating thread

2018-07-20 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8557: - Summary: Exclude lagged/unhealthy/decommissioned nodes in async allocating thread Key: YARN-8557 URL: https://issues.apache.org/jira/browse/YARN-8557 Project: Hadoop YARN

[jira] [Created] (YARN-8556) Support dynamic policy updates in Capacity Scheduler

2018-07-20 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8556: - Summary: Support dynamic policy updates in Capacity Scheduler Key: YARN-8556 URL: https://issues.apache.org/jira/browse/YARN-8556 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8553) Reduce complexity of AHSWebService getApps method

2018-07-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550493#comment-16550493 ] Rohith Sharma K S commented on YARN-8553: - All is yours.. Go ahead.. > Reduce complexity of

[jira] [Commented] (YARN-8541) RM startup failure on recovery after user deletion

2018-07-20 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550486#comment-16550486 ] Bibin A Chundatt commented on YARN-8541: Thank you [~suma.shivaprasad] for review Uploaded patch

[jira] [Updated] (YARN-8541) RM startup failure on recovery after user deletion

2018-07-20 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8541: --- Attachment: YARN-8541.003.patch > RM startup failure on recovery after user deletion >

[jira] [Created] (YARN-8555) Parameterize TestSchedulingRequestContainerAllocation(Async) to cover both PC handler options

2018-07-20 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8555: - Summary: Parameterize TestSchedulingRequestContainerAllocation(Async) to cover both PC handler options Key: YARN-8555 URL: https://issues.apache.org/jira/browse/YARN-8555

[jira] [Commented] (YARN-8544) [DS] AM registration fails when hadoop authorization is enabled

2018-07-20 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550362#comment-16550362 ] Bibin A Chundatt commented on YARN-8544: [~asuresh] Could you help out with the review.. Any

[jira] [Updated] (YARN-8554) Add more E2E tests for placement constraints

2018-07-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8554: -- Priority: Major (was: Minor) > Add more E2E tests for placement constraints >

  1   2   >