[jira] [Commented] (YARN-8496) The capacity scheduler uses label to cause vcore to be incorrect

2018-07-06 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535626#comment-16535626 ] tangshangwen commented on YARN-8496: I'll update a patch later > The capacity scheduler uses label

[jira] [Comment Edited] (YARN-5565) Capacity Scheduler not assigning value correctly.

2018-07-06 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535622#comment-16535622 ] Zian Chen edited comment on YARN-5565 at 7/7/18 4:48 AM: - Hi [~gurmukhd] , After

[jira] [Assigned] (YARN-5565) Capacity Scheduler not assigning value correctly.

2018-07-06 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-5565: --- Assignee: Zian Chen > Capacity Scheduler not assigning value correctly. >

[jira] [Commented] (YARN-5565) Capacity Scheduler not assigning value correctly.

2018-07-06 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535622#comment-16535622 ] Zian Chen commented on YARN-5565: - Hi [~gurmukhd] , After investigating this issue, I think is related to

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-06 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: hadoop_2.9.0.patch > Gpu locality support for Better AI scheduling >

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-06 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: (was: hadoop_2.9.0.patch) > Gpu locality support for Better AI scheduling >

[jira] [Commented] (YARN-8289) Modify distributedshell to support Node Attributes

2018-07-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535579#comment-16535579 ] Sunil Govindan commented on YARN-8289: -- [~Zian Chen] I have a patch ready for this. I ll share along

[jira] [Commented] (YARN-8289) Modify distributedshell to support Node Attributes

2018-07-06 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535541#comment-16535541 ] Zian Chen commented on YARN-8289: - Hi [~Naganarasimha] , [~cheersyang] , I think we pinged the wrong

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-06 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535536#comment-16535536 ] Zian Chen commented on YARN-8480: - [~templedf] , would you mind give some example what kind of resources

[jira] [Commented] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535442#comment-16535442 ] Hudson commented on YARN-8302: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14533 (See

[jira] [Updated] (YARN-8499) ATS v2 should handle connection issues in general for all storages

2018-07-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8499: Issue Type: Improvement (was: Bug) > ATS v2 should handle connection issues in general for

[jira] [Updated] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-07-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8302: Issue Type: Improvement (was: Bug) > ATS v2 should handle HBase connection issue properly

[jira] [Commented] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-07-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535414#comment-16535414 ] Rohith Sharma K S commented on YARN-8302: - committing shortly > ATS v2 should handle HBase

[jira] [Commented] (YARN-8487) Remove the unused Variable in TestBroadcastAMRMProxyFederationPolicy#testNotifyOfResponseFromUnknownSubCluster

2018-07-06 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535411#comment-16535411 ] Zian Chen commented on YARN-8487: - Hi [~msingh] , [~BilwaST] I quickly checked the method 

[jira] [Commented] (YARN-8383) TimelineServer 1.5 start fails with NoClassDefFoundError

2018-07-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535392#comment-16535392 ] Jason Lowe commented on YARN-8383: -- Sorry for the delay, as I was out on vacation and finally got back to

[jira] [Commented] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-07-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535326#comment-16535326 ] genericqa commented on YARN-8302: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8492) ATSv2 HBase tests are failing with ClassNotFoundException

2018-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535273#comment-16535273 ] Hudson commented on YARN-8492: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14531 (See

[jira] [Comment Edited] (YARN-7055) YARN Timeline Service v.2: beta 1

2018-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535264#comment-16535264 ] Vrushali C edited comment on YARN-7055 at 7/6/18 7:43 PM: -- Current status: Done:

[jira] [Commented] (YARN-7055) YARN Timeline Service v.2: beta 1

2018-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535264#comment-16535264 ] Vrushali C commented on YARN-7055: -- Current status: Done: - Migration Path plan for tsv1 to tsv2. -

[jira] [Created] (YARN-8500) Use hbase shaded jars

2018-07-06 Thread Vrushali C (JIRA)
Vrushali C created YARN-8500: Summary: Use hbase shaded jars Key: YARN-8500 URL: https://issues.apache.org/jira/browse/YARN-8500 Project: Hadoop YARN Issue Type: Sub-task Reporter:

[jira] [Commented] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-07-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535246#comment-16535246 ] Sunil Govindan commented on YARN-8302: -- Thanks [~vinodkv]. I have corrected the YarnConfguration

[jira] [Created] (YARN-8499) ATS v2 should handle connection issues in general for all storages

2018-07-06 Thread Sunil Govindan (JIRA)
Sunil Govindan created YARN-8499: Summary: ATS v2 should handle connection issues in general for all storages Key: YARN-8499 URL: https://issues.apache.org/jira/browse/YARN-8499 Project: Hadoop YARN

[jira] [Updated] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-07-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8302: - Attachment: YARN-8302.3.patch > ATS v2 should handle HBase connection issue properly >

[jira] [Updated] (YARN-8492) ATSv2 HBase tests are failing with ClassNotFoundException

2018-07-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8492: - Labels: test (was: ) > ATSv2 HBase tests are failing with ClassNotFoundException >

[jira] [Assigned] (YARN-6767) Timeline client won't be able to write when TimelineCollector is not up yet, or NM is down

2018-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C reassigned YARN-6767: Assignee: Vrushali C > Timeline client won't be able to write when TimelineCollector is not up

[jira] [Comment Edited] (YARN-6767) Timeline client won't be able to write when TimelineCollector is not up yet, or NM is down

2018-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535235#comment-16535235 ] Vrushali C edited comment on YARN-6767 at 7/6/18 7:01 PM: -- We need to handle

[jira] [Commented] (YARN-6767) Timeline client won't be able to write when TimelineCollector is not up yet, or NM is down

2018-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535235#comment-16535235 ] Vrushali C commented on YARN-6767: -- We need to handle collector fault tolerance, that is the case of

[jira] [Commented] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-07-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535233#comment-16535233 ] genericqa commented on YARN-8302: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7451) Add missing tests to verify the presence of custom resources of RM apps and scheduler webservice endpoints

2018-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535219#comment-16535219 ] Hudson commented on YARN-7451: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14529 (See

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2018-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535218#comment-16535218 ] Hudson commented on YARN-7556: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14529 (See

[jira] [Updated] (YARN-7753) [UI2] Meta information about Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-07-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-7753: -- Summary: [UI2] Meta information about Application logs has to be pulled from

[jira] [Commented] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-07-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535208#comment-16535208 ] Vinod Kumar Vavilapalli commented on YARN-8302: --- This should be generic to all storages -

[jira] [Commented] (YARN-8435) Fix NPE when the same client simultaneously contact for the first time Yarn Router

2018-07-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535206#comment-16535206 ] Giovanni Matteo Fumarola commented on YARN-8435: Thanks [~sunilg] for the comment. Yes, it

[jira] [Updated] (YARN-8435) Fix NPE when the same client simultaneously contact for the first time Yarn Router

2018-07-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8435: --- Fix Version/s: 3.2.0 > Fix NPE when the same client simultaneously contact

[jira] [Commented] (YARN-8435) Fix NPE when the same client simultaneously contact for the first time Yarn Router

2018-07-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535183#comment-16535183 ] Sunil Govindan commented on YARN-8435: -- [~giovanni.fumarola] Is this Jira supposed to be land on

[jira] [Commented] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-07-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535150#comment-16535150 ] Rohith Sharma K S commented on YARN-8302: - +1 for latest patch.. Pending jenkins.. I ran patch in

[jira] [Updated] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-07-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8302: - Attachment: YARN-8302.2.patch > ATS v2 should handle HBase connection issue properly >

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535146#comment-16535146 ] Sunil Govindan commented on YARN-8480: -- I think boolean resource is a bit vague item as per me.

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-06 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535129#comment-16535129 ] Daniel Templeton commented on YARN-8480: A boolean resource wouldn't be consumed by its use. The

[jira] [Commented] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2018-07-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535019#comment-16535019 ] Jason Lowe commented on YARN-8193: -- bq. The build failed due to some reason not related to the patch:

[jira] [Updated] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2018-07-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-8193: - Attachment: YARN-8193-branch-2-001.patch > YARN RM hangs abruptly (stops allocating resources) when

[jira] [Resolved] (YARN-8462) Resource Manager shutdown with FATAL Exception

2018-07-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-8462. -- Resolution: Duplicate This is being handled by YARN-8193 with a new branch-2 patch posted there. >

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-06 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: (was: hadoop_2.9.0.patch) > Gpu locality support for Better AI scheduling >

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-06 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: hadoop_2.9.0.patch > Gpu locality support for Better AI scheduling >

[jira] [Commented] (YARN-8496) The capacity scheduler uses label to cause vcore to be incorrect

2018-07-06 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534607#comment-16534607 ] Zian Chen commented on YARN-8496: - [~tangshangwen] , thanks for raising up this issue. This allocation is

[jira] [Commented] (YARN-8492) ATSv2 HBase tests are failing with ClassNotFoundException

2018-07-06 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534497#comment-16534497 ] Takanobu Asanuma commented on YARN-8492: [~rohithsharma] Sorry for generating the bug by