[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-03-01 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782281#comment-16782281 ] Prabhu Joseph commented on YARN-8625: - [~eepayne] RM already publishes this information into ATS when

[jira] [Comment Edited] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-03-01 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1628#comment-1628 ] Wanqiang Ji edited comment on YARN-9214 at 3/2/19 12:20 AM: Hi, [~cheersyang], 

[jira] [Updated] (YARN-5714) ContainerExecutor does not order environment map

2019-03-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-5714: -- Attachment: YARN-5714-branch-2.8.001.patch YARN-5714-branch-2.001.patch >

[jira] [Reopened] (YARN-5714) ContainerExecutor does not order environment map

2019-03-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reopened YARN-5714: --- Assignee: Jim Brennan (was: Remi Catherinot) Re-opening so I can put up branch-2 patches. >

[jira] [Comment Edited] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

2019-03-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782097#comment-16782097 ] Eric Yang edited comment on YARN-8805 at 3/1/19 9:34 PM: - [~ebadger] The white

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

2019-03-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782097#comment-16782097 ] Eric Yang commented on YARN-8805: - [~ebadger] The white space behavior supports parameters with spacing

[jira] [Commented] (YARN-9340) [Clean-up] Remove NULL check before instanceof in ResourceRequestSetKey

2019-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782033#comment-16782033 ] Hadoop QA commented on YARN-9340: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7904) Privileged, trusted containers should be supported only in ENTRYPOINT mode

2019-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781998#comment-16781998 ] Hudson commented on YARN-7904: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16106 (See

[jira] [Commented] (YARN-9340) [Clean-up] Remove NULL check before instanceof in ResourceRequestSetKey

2019-03-01 Thread Shweta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781991#comment-16781991 ] Shweta commented on YARN-9340: -- Submitted patch to remove the NULL check before instanceof check. >

[jira] [Created] (YARN-9340) [Clean-up] Remove NULL check before instanceof in ResourceRequestSetKey

2019-03-01 Thread Shweta (JIRA)
Shweta created YARN-9340: Summary: [Clean-up] Remove NULL check before instanceof in ResourceRequestSetKey Key: YARN-9340 URL: https://issues.apache.org/jira/browse/YARN-9340 Project: Hadoop YARN

[jira] [Updated] (YARN-7904) Privileged, trusted containers should be supported only in ENTRYPOINT mode

2019-03-01 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7904: --- Labels: Docker incompatibleChange (was: Docker) > Privileged, trusted containers should be

[jira] [Updated] (YARN-7904) Privileged, trusted containers should be supported only in ENTRYPOINT mode

2019-03-01 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7904: --- Summary: Privileged, trusted containers should be supported only in ENTRYPOINT mode (was:

[jira] [Commented] (YARN-9150) Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2

2019-03-01 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781937#comment-16781937 ] Sushil Ks commented on YARN-9150: - Hi [~vrushalic], I have uploaded a new patch to resolve the conflicts

[jira] [Commented] (YARN-8376) Separate white list for docker.trusted.registries and docker.privileged-container.registries

2019-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781913#comment-16781913 ] Hadoop QA commented on YARN-8376: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

2019-03-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781864#comment-16781864 ] Eric Badger commented on YARN-8805: --- [~eyang], is there a reason we need to handle the case where there

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-03-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781840#comment-16781840 ] Eric Payne commented on YARN-8625: -- bq. Prabhu Joseph These metrics holds good for running applications.

[jira] [Commented] (YARN-7904) Privileged, trusted containers need all of their bind-mounted directories to be read-only

2019-03-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781838#comment-16781838 ] Eric Badger commented on YARN-7904: --- lgtm +1 (non-binding) > Privileged, trusted containers need all of

[jira] [Updated] (YARN-8376) Separate white list for docker.trusted.registries and docker.privileged-container.registries

2019-03-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8376: Attachment: YARN-8376.002.patch > Separate white list for docker.trusted.registries and >

[jira] [Commented] (YARN-9332) RackResolver tool should accept multiple hosts

2019-03-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781794#comment-16781794 ] Weiwei Yang commented on YARN-9332: --- Looks like there are some issues on gitbox right now, will commit

[jira] [Commented] (YARN-9332) RackResolver tool should accept multiple hosts

2019-03-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781786#comment-16781786 ] Weiwei Yang commented on YARN-9332: --- +1, committing now > RackResolver tool should accept multiple

[jira] [Commented] (YARN-9298) Implement FS placement rules using PlacementRule interface

2019-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781781#comment-16781781 ] Hadoop QA commented on YARN-9298: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9138) Test error handling of nvidia-smi binary execution of GpuDiscoverer

2019-03-01 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781767#comment-16781767 ] Szilard Nemeth commented on YARN-9138: -- Hi [~sunilg]! Thanks for the comments! 1. Fixed. 2. msg is

[jira] [Commented] (YARN-9298) Implement FS placement rules using PlacementRule interface

2019-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781756#comment-16781756 ] Hadoop QA commented on YARN-9298: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9076) ContainerShellWebSocket Render Process Output

2019-03-01 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781743#comment-16781743 ] BELUGA BEHR commented on YARN-9076: --- [~giovanni.fumarola] Hello. Thank you for your review. I see what

[jira] [Updated] (YARN-9076) ContainerShellWebSocket Render Process Output

2019-03-01 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-9076: -- Attachment: YARN-9076.3.patch > ContainerShellWebSocket Render Process Output >

[jira] [Comment Edited] (YARN-9138) Test error handling of nvidia-smi binary execution of GpuDiscoverer

2019-03-01 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781705#comment-16781705 ] Sunil Govindan edited comment on YARN-9138 at 3/1/19 2:59 PM: -- Hi [~snemeth]

[jira] [Updated] (YARN-9076) ContainerShellWebSocket Render Process Output

2019-03-01 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-9076: -- Attachment: YARN-9076.2.patch > ContainerShellWebSocket Render Process Output >

[jira] [Commented] (YARN-9326) Fair Scheduler configuration defaults are not documented in case of min and maxResources

2019-03-01 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781720#comment-16781720 ] Wilfred Spiegelenburg commented on YARN-9326: - Thank you for the update [~adam.antal] I see

[jira] [Commented] (YARN-9138) Test error handling of nvidia-smi binary execution of GpuDiscoverer

2019-03-01 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781705#comment-16781705 ] Sunil Govindan commented on YARN-9138: -- Hi [~snemeth] Few comments: # Could GPU_SCRIPT_REFERENCE

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781701#comment-16781701 ] Hudson commented on YARN-9139: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16103 (See

[jira] [Commented] (YARN-9298) Implement FS placement rules using PlacementRule interface

2019-03-01 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781661#comment-16781661 ] Wilfred Spiegelenburg commented on YARN-9298: - Last version also fixes the {{createQueue}}

[jira] [Updated] (YARN-9298) Implement FS placement rules using PlacementRule interface

2019-03-01 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-9298: Attachment: YARN-9298.005.patch > Implement FS placement rules using PlacementRule

[jira] [Commented] (YARN-9298) Implement FS placement rules using PlacementRule interface

2019-03-01 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781648#comment-16781648 ] Wilfred Spiegelenburg commented on YARN-9298: - # I added the abstract {{FSPlacementRule}} and

[jira] [Commented] (YARN-9337) GPU auto-discovery script runs even when the resource is given by hand

2019-03-01 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781631#comment-16781631 ] Adam Antal commented on YARN-9337: -- I started working on the issue, but it looks like there are several

[jira] [Updated] (YARN-9298) Implement FS placement rules using PlacementRule interface

2019-03-01 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-9298: Attachment: YARN-9298.004.patch > Implement FS placement rules using PlacementRule

[jira] [Commented] (YARN-8132) Final Status of applications shown as UNDEFINED in ATS app queries

2019-03-01 Thread Rakesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781599#comment-16781599 ] Rakesh Shah commented on YARN-8132: --- Hi [~Prabhu Joseph] in which scenerio the below fail event gets

[jira] [Commented] (YARN-9150) Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2

2019-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781547#comment-16781547 ] Hadoop QA commented on YARN-9150: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9332) RackResolver tool should accept multiple hosts

2019-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781528#comment-16781528 ] Hadoop QA commented on YARN-9332: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9150) Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2

2019-03-01 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-9150: Attachment: YARN-9150-branch-2.004.patch > Making TimelineSchemaCreator support different backends for

[jira] [Updated] (YARN-9332) RackResolver tool should accept multiple hosts

2019-03-01 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated YARN-9332: - Attachment: YARN-9332.003.patch > RackResolver tool should accept multiple hosts >