[jira] [Updated] (YARN-9538) Document scheduler/app activities and REST APIs

2019-05-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9538: --- Attachment: YARN-9538.001.patch > Document scheduler/app activities and REST APIs >

[jira] [Updated] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9497: --- Attachment: YARN-9497.003.patch > Support grouping by diagnostics for query results of scheduler and app >

[jira] [Updated] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9497: --- Attachment: (was: YARN-9497.003.patch) > Support grouping by diagnostics for query results of scheduler

[jira] [Updated] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9497: --- Attachment: YARN-9497.003.patch > Support grouping by diagnostics for query results of scheduler and app >

[jira] [Updated] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9497: --- Attachment: (was: YARN-9497.003.patch) > Support grouping by diagnostics for query results of scheduler

[jira] [Updated] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9497: --- Attachment: YARN-9497.003.patch > Support grouping by diagnostics for query results of scheduler and app >

[jira] [Commented] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845450#comment-16845450 ] Tao Yang commented on YARN-9497: Thanks [~cheersyang] for the confirmation! Attached v3 patch with

[jira] [Updated] (YARN-9578) Add limit option to control number of results for app activities REST API

2019-05-22 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9578: --- Attachment: YARN-9578.001.patch > Add limit option to control number of results for app activities REST API >

[jira] [Commented] (YARN-9578) Add limit option to control number of results for app activities REST API

2019-05-22 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845755#comment-16845755 ] Tao Yang commented on YARN-9578: Attached v1 patch for review. This patch should be submitted after

[jira] [Created] (YARN-9578) Add limit option to control number of results for app activities REST API

2019-05-22 Thread Tao Yang (JIRA)
Tao Yang created YARN-9578: -- Summary: Add limit option to control number of results for app activities REST API Key: YARN-9578 URL: https://issues.apache.org/jira/browse/YARN-9578 Project: Hadoop YARN

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-05-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845444#comment-16845444 ] Tao Yang commented on YARN-9567: Thanks [~wangda] for your suggestion,  I couldn't agree more for that.

[jira] [Commented] (YARN-9576) ResourceUsageMultiNodeLookupPolicy may cause Application starve forever

2019-05-22 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846407#comment-16846407 ] Tao Yang commented on YARN-9576: Thanks [~jutia] for raising this issue. I think it's indeed a problem,

[jira] [Updated] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-05-24 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9580: --- Attachment: YARN-9580.001.patch > Fulfilled reservation information in assignment is lost when transferring

[jira] [Created] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-05-24 Thread Tao Yang (JIRA)
Tao Yang created YARN-9580: -- Summary: Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers Key: YARN-9580 URL: https://issues.apache.org/jira/browse/YARN-9580

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-05-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Description: Currently on app attempt page we can see outstanding resource requests, it will be helpful for

[jira] [Created] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-05-20 Thread Tao Yang (JIRA)
Tao Yang created YARN-9567: -- Summary: Add diagnostics for outstanding resource requests on app attempts page Key: YARN-9567 URL: https://issues.apache.org/jira/browse/YARN-9567 Project: Hadoop YARN

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-05-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: (was: show_diagnostics_after_requesting_app_activities_REST_API.png) > Add diagnostics for

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-05-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: show_diagnostics_after_requesting_app_activities_REST_API.png > Add diagnostics for outstanding

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-05-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Description: Currently on app attempt page we can see outstanding resource requests, it will be helpful for

[jira] [Commented] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16842878#comment-16842878 ] Tao Yang commented on YARN-9497: It looks like each dimension or both together are all supported, but each

[jira] [Updated] (YARN-9539) Improve cleanup process of app activities and make some conditions configurable

2019-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9539: --- Environment: (was: [YARN-9050 Design doc

[jira] [Updated] (YARN-9539) Improve cleanup process of app activities and make some conditions configurable

2019-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9539: --- Description: [YARN-9050 Design doc

[jira] [Updated] (YARN-9539) Improve cleanup process of app activities and make some conditions configurable

2019-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9539: --- Attachment: YARN-9539.001.patch > Improve cleanup process of app activities and make some conditions >

[jira] [Updated] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9497: --- Attachment: YARN-9497.001.patch > Support grouping by diagnostics for query results of scheduler and app >

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: (was: YARN-9440.003.patch) > Improve diagnostics for scheduler and app activities >

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.003.patch > Improve diagnostics for scheduler and app activities >

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830264#comment-16830264 ] Tao Yang commented on YARN-9440: Thanks [~cheersyang] for some advices when we talked on the phone.

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.003.patch > Improve diagnostics for scheduler and app activities >

[jira] [Updated] (YARN-9489) Support filtering by request-priorities and allocation-request-ids for query results of app activities

2019-05-06 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9489: --- Attachment: YARN-9489.002.patch > Support filtering by request-priorities and allocation-request-ids for

[jira] [Updated] (YARN-9432) Reserved containers leak after its request has been cancelled or satisfied when multi-nodes enabled

2019-05-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9432: --- Attachment: YARN-9432.004.patch > Reserved containers leak after its request has been cancelled or satisfied

[jira] [Commented] (YARN-9432) Reserved containers leak after its request has been cancelled or satisfied when multi-nodes enabled

2019-05-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834446#comment-16834446 ] Tao Yang commented on YARN-9432: Thanks [~cheersyang] for the suggestion! Yes, there's a redundant loop 

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-05-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834538#comment-16834538 ] Tao Yang commented on YARN-9440: Thanks [~cheersyang] for the review and commit! > Improve diagnostics

[jira] [Reopened] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang reopened YARN-9495: Hi, [~cheersyang]. I saw the same findbugs warnings again from jenkins report generated today in YARN-9490.

[jira] [Updated] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9495: --- Attachment: YARN-9495.002.patch > Fix findbugs warnings in hadoop-yarn-server-resourcemanager module >

[jira] [Commented] (YARN-9490) applicationresourceusagereport return wrong number of reserved containers

2019-04-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821949#comment-16821949 ] Tao Yang commented on YARN-9490: Hi, [~cheersyang], could you please help to give contributor permission

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-05-02 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831669#comment-16831669 ] Tao Yang commented on YARN-9440: Thanks [~cheersyang] for the review. Remaining check-style warnings are

[jira] [Commented] (YARN-9432) Reserved containers leak after its request has been cancelled or satisfied when multi-nodes enabled

2019-05-06 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833551#comment-16833551 ] Tao Yang commented on YARN-9432: Thanks [~cheersyang] for the review.  The problem is that

[jira] [Updated] (YARN-9432) Reserved containers leak after its request has been cancelled or satisfied when multi-nodes enabled

2019-05-06 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9432: --- Attachment: YARN-9432.003.patch > Reserved containers leak after its request has been cancelled or satisfied

[jira] [Updated] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-07-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9664: --- Attachment: (was: YARN-9664.001.patch) > Improve response of scheduler/app activities for better

[jira] [Updated] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-07-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9664: --- Attachment: (was: YARN-9664.001.patch) > Improve response of scheduler/app activities for better

[jira] [Updated] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-07-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9664: --- Attachment: YARN-9664.001.patch > Improve response of scheduler/app activities for better understanding >

[jira] [Updated] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-07-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9664: --- Attachment: YARN-9664.001.patch > Improve response of scheduler/app activities for better understanding >

[jira] [Commented] (YARN-9658) Fix UT failures in TestLeafQueue

2019-07-02 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877495#comment-16877495 ] Tao Yang commented on YARN-9658: Thanks [~cheersyang] for the review and commit. > Fix UT failures in

[jira] [Updated] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-07-05 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9664: --- Attachment: YARN-9664.002.patch > Improve response of scheduler/app activities for better understanding >

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-07-05 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: YARN-9567.002.patch > Add diagnostics for outstanding resource requests on app attempts page >

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

2019-07-05 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879155#comment-16879155 ] Tao Yang commented on YARN-9538: Hi, [~cheersyang]. I have update the document under V3 separate line

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-07-05 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879130#comment-16879130 ] Tao Yang commented on YARN-9664: Attached v2 patch with additional updates: * Add activities DAO classes

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-07-05 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879157#comment-16879157 ] Tao Yang commented on YARN-9664: Hi, [~cheersyang], I have summarized all diagnostics in the activities

[jira] [Commented] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-06-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874840#comment-16874840 ] Tao Yang commented on YARN-7621: Attached v2 patch rebased from trunk. [~cheersyang], could you please

[jira] [Commented] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-06-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874825#comment-16874825 ] Tao Yang commented on YARN-9623: Thanks [~cheersyang] for your comments. {quote} If this configuration is

[jira] [Comment Edited] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-06-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874001#comment-16874001 ] Tao Yang edited comment on YARN-9623 at 6/28/19 10:07 AM: -- Thanks [~cheersyang]

[jira] [Updated] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-06-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9623: --- Attachment: YARN-9623.002.patch > Auto adjust max queue length of app activities to make sure activities on

[jira] [Updated] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-06-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7621: --- Attachment: YARN-7621.002.patch > Support submitting apps with queue path for CapacityScheduler >

[jira] [Created] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-07-02 Thread Tao Yang (JIRA)
Tao Yang created YARN-9664: -- Summary: Improve response of scheduler/app activities for better understanding Key: YARN-9664 URL: https://issues.apache.org/jira/browse/YARN-9664 Project: Hadoop YARN

[jira] [Updated] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-07-02 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9664: --- Description: Currently some diagnostics are not easy enough to understand for common users, and I found some

[jira] [Updated] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-07-02 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9664: --- Attachment: YARN-9664.001.patch > Improve response of scheduler/app activities for better understanding >

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-07-02 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877466#comment-16877466 ] Tao Yang commented on YARN-9664: Attached v1 patch for review. Updates: * Adjust structure and diagnostics

[jira] [Commented] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-07-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875997#comment-16875997 ] Tao Yang commented on YARN-9623: [~cheersyang], I have created YARN-9658 to fix these UT failures. > Auto

[jira] [Updated] (YARN-9658) UT failures in TestLeafQueue

2019-07-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9658: --- Description: In ActivitiesManager, if there's no yarn configuration in mock RMContext, cleanup interval

[jira] [Updated] (YARN-9658) UT failures in TestLeafQueue

2019-07-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9658: --- Attachment: YARN-9658.001.patch > UT failures in TestLeafQueue > > >

[jira] [Commented] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-06-26 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873814#comment-16873814 ] Tao Yang commented on YARN-9623: [~cheersyang], hope to hear your thoughts about this. Thanks. > Auto

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-24 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825704#comment-16825704 ] Tao Yang commented on YARN-9440: Thanks [~cheersyang] for the review.  I think we should discuss the

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813306#comment-16813306 ] Tao Yang commented on YARN-9439: Attached v3 patch to fix UT errors. > Support asynchronized scheduling

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Attachment: YARN-9439.003.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Created] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-17 Thread Tao Yang (JIRA)
Tao Yang created YARN-9495: -- Summary: Fix findbugs warnings in hadoop-yarn-server-resourcemanager module Key: YARN-9495 URL: https://issues.apache.org/jira/browse/YARN-9495 Project: Hadoop YARN

[jira] [Updated] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9495: --- Attachment: YARN-9495.001.patch > Fix findbugs warnings in hadoop-yarn-server-resourcemanager module >

[jira] [Updated] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9495: --- Description: Recently there are 2 extant Findbugs warnings in hadoop-yarn-server-resourcemanager module

[jira] [Commented] (YARN-9472) Add multi-thread asynchronous scheduling to fair scheduler

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818695#comment-16818695 ] Tao Yang commented on YARN-9472: Hi, [~zhuqi]. Multi-thread asynchronous scheduling only means support

[jira] [Comment Edited] (YARN-9472) Add multi-thread asynchronous scheduling to fair scheduler

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818695#comment-16818695 ] Tao Yang edited comment on YARN-9472 at 4/16/19 9:51 AM: - Hi, [~zhuqi].

[jira] [Commented] (YARN-9507) NPE when u stop NM if NM Init failed

2019-04-24 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825000#comment-16825000 ] Tao Yang commented on YARN-9507: Thanks [~BilwaST] for fixing this NPE. LGTM, +1 for the patch. > NPE

[jira] [Commented] (YARN-9490) applicationresourceusagereport return wrong number of reserved containers

2019-04-24 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825010#comment-16825010 ] Tao Yang commented on YARN-9490: Thanks [~cheersyang] for the review. The comments make sense to me.

[jira] [Commented] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-06-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874001#comment-16874001 ] Tao Yang commented on YARN-9623: Thanks [~cheersyang] for the feedback. {quote} However, the activity

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2019-06-25 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872862#comment-16872862 ] Tao Yang commented on YARN-6629: Hi, [~aihuaxu]. This patch has been already involved in branch-2 for more

[jira] [Commented] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-06-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875952#comment-16875952 ] Tao Yang commented on YARN-9623: Thanks [~cheersyang]. I just noticed that Jerkins report has related

[jira] [Created] (YARN-9658) UT failures in TestLeafQueue

2019-07-01 Thread Tao Yang (JIRA)
Tao Yang created YARN-9658: -- Summary: UT failures in TestLeafQueue Key: YARN-9658 URL: https://issues.apache.org/jira/browse/YARN-9658 Project: Hadoop YARN Issue Type: Bug Reporter: Tao

[jira] [Updated] (YARN-9658) UT failures in TestLeafQueue

2019-07-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9658: --- Affects Version/s: 3.3.0 > UT failures in TestLeafQueue > > >

[jira] [Created] (YARN-9716) AM container might leak

2019-07-31 Thread Tao Yang (JIRA)
Tao Yang created YARN-9716: -- Summary: AM container might leak Key: YARN-9716 URL: https://issues.apache.org/jira/browse/YARN-9716 Project: Hadoop YARN Issue Type: Bug Components:

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-08-19 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910932#comment-16910932 ] Tao Yang commented on YARN-8995: Thanks [~zhuqi] for this contribution, you are welcome to contribute more

[jira] [Updated] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9714: --- Attachment: YARN-9714.004.patch > ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916291#comment-16916291 ] Tao Yang commented on YARN-8917: Thanks [~rohithsharma], [~leftnoteasy], [~sunilg] for the review and

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916290#comment-16916290 ] Tao Yang commented on YARN-9714: TestZKRMStateStore#testZKRootPathAcls UT failure is caused by itself,

[jira] [Updated] (YARN-9798) ApplicationMasterServiceTestBase#testRepeatedFinishApplicationMaster fails intermittently

2019-08-30 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9798: --- Attachment: (was: YARN-9798.001.patch) >

[jira] [Updated] (YARN-9798) ApplicationMasterServiceTestBase#testRepeatedFinishApplicationMaster fails intermittently

2019-08-30 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9798: --- Attachment: YARN-9798.001.patch > ApplicationMasterServiceTestBase#testRepeatedFinishApplicationMaster fails

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-08-28 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917507#comment-16917507 ] Tao Yang commented on YARN-8995: Hi, [~zhuqi]. The latest patch seems not applicable for trunk now, could

[jira] [Updated] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-28 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9714: --- Attachment: YARN-9714.005.patch > ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-28 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917482#comment-16917482 ] Tao Yang commented on YARN-9714: {quote} Instead of comparing, how about checking for

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-08-28 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917516#comment-16917516 ] Tao Yang commented on YARN-9664: Hi, [~cheersyang], it indeed changes a lot and most of them are

[jira] [Commented] (YARN-9798) ApplicationMasterServiceTestBase#testRepeatedFinishApplicationMaster fails intermittently

2019-08-30 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919654#comment-16919654 ] Tao Yang commented on YARN-9798: Thanks [~abmodi] for the review. The frequency is only 1 or 2 failures

[jira] [Commented] (YARN-9540) TestRMAppTransitions fails intermittently

2019-08-30 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919658#comment-16919658 ] Tao Yang commented on YARN-9540: Thanks [~abmodi], [~adam.antal] for the review and commit. >

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-09-04 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921981#comment-16921981 ] Tao Yang commented on YARN-8995: Hi, [~zhuqi]. I noticed

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-29 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918446#comment-16918446 ] Tao Yang commented on YARN-9714: There is an intermittent UT failure in the latest jenkins report, I have

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-08-29 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918469#comment-16918469 ] Tao Yang commented on YARN-9664: Hi, [~cheersyang]. {quote} UT seems not related to this patch, Tao Yang,

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-08-29 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918511#comment-16918511 ] Tao Yang commented on YARN-9664: Thanks [~cheersyang] for the review and commit! > Improve response of

[jira] [Created] (YARN-9799) TestRMAppTransitions#testAppFinishedFinished fails intermittently

2019-08-29 Thread Tao Yang (Jira)
Tao Yang created YARN-9799: -- Summary: TestRMAppTransitions#testAppFinishedFinished fails intermittently Key: YARN-9799 URL: https://issues.apache.org/jira/browse/YARN-9799 Project: Hadoop YARN

[jira] [Commented] (YARN-9799) TestRMAppTransitions#testAppFinishedFinished fails intermittently

2019-08-29 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918506#comment-16918506 ] Tao Yang commented on YARN-9799: Thanks [~Prabhu Joseph] for reminding me, I'll fix this issue over there.

[jira] [Updated] (YARN-9799) TestRMAppTransitions#testAppFinishedFinished fails intermittently

2019-08-29 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9799: --- Attachment: YARN-9799.001.patch > TestRMAppTransitions#testAppFinishedFinished fails intermittently >

[jira] [Assigned] (YARN-9540) TestRMAppTransitions fails intermittently

2019-08-29 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang reassigned YARN-9540: -- Assignee: Tao Yang (was: Prabhu Joseph) > TestRMAppTransitions fails intermittently >

[jira] [Updated] (YARN-9540) TestRMAppTransitions fails intermittently

2019-08-29 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9540: --- Attachment: YARN-9540.001.patch > TestRMAppTransitions fails intermittently >

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

2019-08-29 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918510#comment-16918510 ] Tao Yang commented on YARN-9538: Thanks [~cheersyang] for reminding me, I will do that later. > Document

[jira] [Updated] (YARN-9798) ApplicationMasterServiceTestBase#testRepeatedFinishApplicationMaster fails intermittently

2019-08-29 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9798: --- Attachment: YARN-9798.001.patch > ApplicationMasterServiceTestBase#testRepeatedFinishApplicationMaster fails

<    3   4   5   6   7   8   9   10   >