[jira] [Commented] (YARN-10293) Reserved Containers not allocated from available space of other nodes in CandidateNodeSet in MultiNodePlacement (YARN-10259)

2020-06-02 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124527#comment-17124527 ] Tao Yang commented on YARN-10293: - Thanks [~wangda] for your confirmation. I think the proposed change

[jira] [Commented] (YARN-10300) appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124511#comment-17124511 ] Hadoop QA commented on YARN-10300: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10302) Support custom packing algorithm for FairScheduler

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124480#comment-17124480 ] Hadoop QA commented on YARN-10302: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124478#comment-17124478 ] Hadoop QA commented on YARN-9903: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10300) appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat

2020-06-02 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124461#comment-17124461 ] Eric Badger commented on YARN-10300: Added some null checks to patch 002 > appMasterHost not set in

[jira] [Updated] (YARN-10300) appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat

2020-06-02 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-10300: --- Attachment: YARN-10300.002.patch > appMasterHost not set in RM ApplicationSummary when AM fails

[jira] [Commented] (YARN-10300) appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat

2020-06-02 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124450#comment-17124450 ] Eric Badger commented on YARN-10300: bq. Eric Badger can you explain under what circumstances

[jira] [Commented] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-06-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124440#comment-17124440 ] Jim Brennan commented on YARN-10283: [~pbacsko] I downloaded your patch and your test case and

[jira] [Commented] (YARN-10300) appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat

2020-06-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124421#comment-17124421 ] Jim Brennan commented on YARN-10300: [~ebadger] can you explain under what circumstances

[jira] [Commented] (YARN-10302) Support custom packing algorithm for FairScheduler

2020-06-02 Thread William W. Graham Jr (Jira)
[ https://issues.apache.org/jira/browse/YARN-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124348#comment-17124348 ] William W. Graham Jr commented on YARN-10302: - Done. Also corrected the checkstyles and

[jira] [Commented] (YARN-10300) appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat

2020-06-02 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124328#comment-17124328 ] Eric Badger commented on YARN-10300: The unit tests pass for me locally. [~epayne], [~Jim_Brennan],

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124325#comment-17124325 ] Jim Brennan commented on YARN-9903: --- Uploaded patch 002, which removes an extraneous file. > Support

[jira] [Updated] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-9903: -- Attachment: YARN-9903.002.patch > Support reservations continue looking for Node Labels >

[jira] [Commented] (YARN-10293) Reserved Containers not allocated from available space of other nodes in CandidateNodeSet in MultiNodePlacement (YARN-10259)

2020-06-02 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124195#comment-17124195 ] Wangda Tan commented on YARN-10293: --- [~Tao Yang], the suggestion totally make sense to me. When we have

[jira] [Commented] (YARN-10286) PendingContainers bugs in the scheduler outputs

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124175#comment-17124175 ] Hadoop QA commented on YARN-10286: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10296) Make ContainerPBImpl#getId/setId synchronized

2020-06-02 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124121#comment-17124121 ] Wangda Tan commented on YARN-10296: --- [~bteke],  It makes sense to covert other method which uses

[jira] [Commented] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-06-02 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124044#comment-17124044 ] Hudson commented on YARN-10254: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18315 (See

[jira] [Comment Edited] (YARN-9097) Investigate why GpuDiscoverer methods are synchronized

2020-06-02 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123963#comment-17123963 ] Bilwa S T edited comment on YARN-9097 at 6/2/20, 4:47 PM: -- Hi [~snemeth] Thanks

[jira] [Commented] (YARN-10296) Make ContainerPBImpl#getId/setId synchronized

2020-06-02 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124042#comment-17124042 ] Benjamin Teke commented on YARN-10296: -- Hi [~leftnoteasy], I wanted to ask your opinion on this

[jira] [Commented] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-06-02 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124018#comment-17124018 ] Szilard Nemeth commented on YARN-10254: --- Thanks [~shuzirra] for working on this. Checked the latest

[jira] [Updated] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-06-02 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10254: -- Fix Version/s: 3.3.1 3.4.0 > CapacityScheduler incorrect User Group Mapping

[jira] [Commented] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123965#comment-17123965 ] Hadoop QA commented on YARN-10284: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-9097) Investigate why GpuDiscoverer methods are synchronized

2020-06-02 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123963#comment-17123963 ] Bilwa S T commented on YARN-9097: - Hi [~snemeth] Thanks for raising this issue. I could see that

[jira] [Commented] (YARN-10286) PendingContainers bugs in the scheduler outputs

2020-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123910#comment-17123910 ] Andras Gyori commented on YARN-10286: - The patch smoothly applied to both branch-3.3 and 3.2. >

[jira] [Updated] (YARN-10286) PendingContainers bugs in the scheduler outputs

2020-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10286: Attachment: YARN-10286.branch-3.3.001.patch > PendingContainers bugs in the scheduler outputs >

[jira] [Updated] (YARN-10286) PendingContainers bugs in the scheduler outputs

2020-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10286: Attachment: YARN-10286.branch-3.2.001.patch > PendingContainers bugs in the scheduler outputs >

[jira] [Commented] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-06-02 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123851#comment-17123851 ] Hudson commented on YARN-10284: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18314 (See

[jira] [Commented] (YARN-10295) CapacityScheduler NPE can cause apps to get stuck without resources

2020-06-02 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123844#comment-17123844 ] Benjamin Teke commented on YARN-10295: -- Test issues are related to YARN-10249 not this patch. >

[jira] [Updated] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-06-02 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10284: -- Attachment: YARN-10284.branch-3.3.001.patch > Add lazy initialization of

[jira] [Commented] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-06-02 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123841#comment-17123841 ] Adam Antal commented on YARN-10284: --- Thanks for committing this [~snemeth]. Uploaded patch for branch

[jira] [Commented] (YARN-10293) Reserved Containers not allocated from available space of other nodes in CandidateNodeSet in MultiNodePlacement (YARN-10259)

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123839#comment-17123839 ] Hadoop QA commented on YARN-10293: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-06-02 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123830#comment-17123830 ] Szilard Nemeth commented on YARN-10284: --- Hi [~adam.antal], Thanks for working on this. LGTM,

[jira] [Updated] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-06-02 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10284: -- Fix Version/s: 3.4.0 > Add lazy initialization of LogAggregationFileControllerFactory in

[jira] [Commented] (YARN-10286) PendingContainers bugs in the scheduler outputs

2020-06-02 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123827#comment-17123827 ] Hudson commented on YARN-10286: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18313 (See

[jira] [Commented] (YARN-10286) PendingContainers bugs in the scheduler outputs

2020-06-02 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123798#comment-17123798 ] Szilard Nemeth commented on YARN-10286: --- Hi [~gandras], Thanks for working on this. Patch LGTM,

[jira] [Updated] (YARN-10286) PendingContainers bugs in the scheduler outputs

2020-06-02 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10286: -- Fix Version/s: 3.4.0 > PendingContainers bugs in the scheduler outputs >

[jira] [Commented] (YARN-10304) Create an endpoint for remote application log directory path query

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123766#comment-17123766 ] Hadoop QA commented on YARN-10304: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10274) Merge QueueMapping and QueueMappingEntity

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123751#comment-17123751 ] Hadoop QA commented on YARN-10274: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10293) Reserved Containers not allocated from available space of other nodes in CandidateNodeSet in MultiNodePlacement (YARN-10259)

2020-06-02 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123686#comment-17123686 ] Tao Yang commented on YARN-10293: - Hi, [~prabhujoseph], [~wangda] This problem is similar to YARN-9598,

[jira] [Commented] (YARN-10293) Reserved Containers not allocated from available space of other nodes in CandidateNodeSet in MultiNodePlacement (YARN-10259)

2020-06-02 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123652#comment-17123652 ] Prabhu Joseph commented on YARN-10293: -- Have attached a patch with removing the if condition. Will

[jira] [Updated] (YARN-10293) Reserved Containers not allocated from available space of other nodes in CandidateNodeSet in MultiNodePlacement (YARN-10259)

2020-06-02 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-10293: - Attachment: YARN-10293-003-WIP.patch > Reserved Containers not allocated from available space of

[jira] [Updated] (YARN-10304) Create an endpoint for remote application log directory path query

2020-06-02 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10304: -- Parent: YARN-10025 Issue Type: Sub-task (was: Improvement) > Create an endpoint for remote

[jira] [Updated] (YARN-10274) Merge QueueMapping and QueueMappingEntity

2020-06-02 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10274: -- Attachment: YARN-10274.002.patch > Merge QueueMapping and QueueMappingEntity >

[jira] [Commented] (YARN-10305) Lost system-credentials when restarting RM

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123589#comment-17123589 ] Hadoop QA commented on YARN-10305: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123426#comment-17123426 ] Andras Gyori commented on YARN-10284: - Last patch LGTM (non-binding), I like the caching approach +1.

[jira] [Commented] (YARN-10304) Create an endpoint for remote application log directory path query

2020-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123405#comment-17123405 ] Andras Gyori commented on YARN-10304: - An early draft patch has been uploaded, that provides the

[jira] [Updated] (YARN-10304) Create an endpoint for remote application log directory path query

2020-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10304: Attachment: YARN-10304.001.patch > Create an endpoint for remote application log directory path

[jira] [Commented] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123401#comment-17123401 ] Hadoop QA commented on YARN-10284: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (YARN-10305) Lost system-credentials when restarting RM

2020-06-02 Thread kyungwan nam (Jira)
kyungwan nam created YARN-10305: --- Summary: Lost system-credentials when restarting RM Key: YARN-10305 URL: https://issues.apache.org/jira/browse/YARN-10305 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-10304) Create an endpoint for remote application log directory path query

2020-06-02 Thread Andras Gyori (Jira)
Andras Gyori created YARN-10304: --- Summary: Create an endpoint for remote application log directory path query Key: YARN-10304 URL: https://issues.apache.org/jira/browse/YARN-10304 Project: Hadoop YARN