[jira] [Updated] (YARN-8795) QueuePlacementRule move to separate files

2018-09-18 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8795: -- Attachment: YARN-8795.003.patch > QueuePlacementRule move to separate files >

[jira] [Commented] (YARN-8795) QueuePlacementRule move to separate files

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620131#comment-16620131 ] Hadoop QA commented on YARN-8795: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8795) QueuePlacementRule move to separate files

2018-09-18 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8795: -- Attachment: YARN-8795.002.patch > QueuePlacementRule move to separate files >

[jira] [Updated] (YARN-8795) QueuePlacementRule move to separate files

2018-09-18 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8795: -- Attachment: (was: YARN-8795.001.patch) > QueuePlacementRule move to separate files >

[jira] [Updated] (YARN-8793) QueuePlacementPolicy bind more information to assgining result

2018-09-18 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8793: -- Attachment: (was: YARN-8793.001.patch) > QueuePlacementPolicy bind more information to assgining

[jira] [Updated] (YARN-8793) QueuePlacementPolicy bind more information to assgining result

2018-09-18 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8793: -- Attachment: YARN-8793.001.patch > QueuePlacementPolicy bind more information to assgining result >

[jira] [Commented] (YARN-8795) QueuePlacementRule move to separate files

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620102#comment-16620102 ] Hadoop QA commented on YARN-8795: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620077#comment-16620077 ] Eric Yang commented on YARN-8777: - [~Zian Chen] {quote} The method param list have out an outlen which

[jira] [Commented] (YARN-8793) QueuePlacementPolicy bind more information to assgining result

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620071#comment-16620071 ] Hadoop QA commented on YARN-8793: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8795) QueuePlacementRule move to separate files

2018-09-18 Thread Shuai Zhang (JIRA)
Shuai Zhang created YARN-8795: - Summary: QueuePlacementRule move to separate files Key: YARN-8795 URL: https://issues.apache.org/jira/browse/YARN-8795 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620042#comment-16620042 ] Tao Yang commented on YARN-8771: Attached v3 patch to improve unit test without adding new

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Attachment: YARN-8771.003.patch > CapacityScheduler fails to unreserve when cluster resource contains empty

[jira] [Commented] (YARN-8752) yarn-registry.md has wrong word ong-lived,it should be long-lived

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620022#comment-16620022 ] Hadoop QA commented on YARN-8752: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1662#comment-1662 ] Weiwei Yang commented on YARN-8468: --- Thanks [~bsteinbach] for the updates. A general comment to your

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620001#comment-16620001 ] Tao Yang commented on YARN-8771: Thanks [~leftnoteasy] for your review and suggestion. I will update the

[jira] [Updated] (YARN-8794) QueuePlacementPolicy add more rules

2018-09-18 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8794: -- Description: Still need more useful rules: # RejectNonLeafQueue # RejectDefaultQueue # RejectUsers

[jira] [Created] (YARN-8794) QueuePlacementPolicy add more rules

2018-09-18 Thread Shuai Zhang (JIRA)
Shuai Zhang created YARN-8794: - Summary: QueuePlacementPolicy add more rules Key: YARN-8794 URL: https://issues.apache.org/jira/browse/YARN-8794 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-8793) QueuePlacementPolicy bind more information to assgining result

2018-09-18 Thread Shuai Zhang (JIRA)
Shuai Zhang created YARN-8793: - Summary: QueuePlacementPolicy bind more information to assgining result Key: YARN-8793 URL: https://issues.apache.org/jira/browse/YARN-8793 Project: Hadoop YARN

[jira] [Created] (YARN-8792) Revisit FiarScheduler QueuePlacementPolicy

2018-09-18 Thread Shuai Zhang (JIRA)
Shuai Zhang created YARN-8792: - Summary: Revisit FiarScheduler QueuePlacementPolicy Key: YARN-8792 URL: https://issues.apache.org/jira/browse/YARN-8792 Project: Hadoop YARN Issue Type:

[jira] [Reopened] (YARN-8752) yarn-registry.md has wrong word ong-lived,it should be long-lived

2018-09-18 Thread leiqiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leiqiang reopened YARN-8752: > yarn-registry.md has wrong word ong-lived,it should be long-lived >

[jira] [Updated] (YARN-8752) yarn-registry.md has wrong word ong-lived,it should be long-lived

2018-09-18 Thread leiqiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leiqiang updated YARN-8752: --- Attachment: (was: YARN-8752-1.patch) > yarn-registry.md has wrong word ong-lived,it should be long-lived

[jira] [Commented] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619930#comment-16619930 ] Hadoop QA commented on YARN-8789: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8791) When STOPSIGNAL is not present then docker inspect returns an extra line feed

2018-09-18 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8791: Attachment: YARN-8791.001.patch > When STOPSIGNAL is not present then docker inspect returns an

[jira] [Created] (YARN-8791) When STOPSIGNAL is not present then docker inspect returns an extra line feed

2018-09-18 Thread Chandni Singh (JIRA)
Chandni Singh created YARN-8791: --- Summary: When STOPSIGNAL is not present then docker inspect returns an extra line feed Key: YARN-8791 URL: https://issues.apache.org/jira/browse/YARN-8791 Project:

[jira] [Commented] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619845#comment-16619845 ] Hadoop QA commented on YARN-8696: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8771: - Target Version/s: 3.1.1, 3.2.0 > CapacityScheduler fails to unreserve when cluster resource contains

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619835#comment-16619835 ] Wangda Tan commented on YARN-8771: -- Nice catch! Thanks [~Tao Yang].  Patch LGTM as well. For the test,

[jira] [Commented] (YARN-8784) DockerLinuxContainerRuntime prevents access to distributed cache entries on a full disk

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619817#comment-16619817 ] Hadoop QA commented on YARN-8784: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1013) CS should watch resource utilization of containers and allocate speculative containers if appropriate

2018-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619809#comment-16619809 ] Arun Suresh commented on YARN-1013: --- Thanks for taking a quick look [~elgoiri] So, the patch was more

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619796#comment-16619796 ] Hadoop QA commented on YARN-7599: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8789: -- Attachment: YARN-8789.2.patch > Add BoundedQueue to AsyncDispatcher >

[jira] [Updated] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8789: -- Attachment: (was: YARN-8789.2.patch) > Add BoundedQueue to AsyncDispatcher >

[jira] [Updated] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8789: -- Attachment: YARN-8789.2.patch > Add BoundedQueue to AsyncDispatcher >

[jira] [Updated] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8789: -- Attachment: (was: YARN-8789.2.patch) > Add BoundedQueue to AsyncDispatcher >

[jira] [Updated] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8789: -- Attachment: YARN-8789.2.patch > Add BoundedQueue to AsyncDispatcher >

[jira] [Commented] (YARN-1013) CS should watch resource utilization of containers and allocate speculative containers if appropriate

2018-09-18 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619771#comment-16619771 ] Íñigo Goiri commented on YARN-1013: --- Thanks [~asuresh] for [^YARN-1013-001.branch-2.patch]. A couple

[jira] [Updated] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8789: -- Attachment: (was: YARN-8789.2.patch) > Add BoundedQueue to AsyncDispatcher >

[jira] [Updated] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8789: -- Attachment: YARN-8789.2.patch > Add BoundedQueue to AsyncDispatcher >

[jira] [Updated] (YARN-8784) DockerLinuxContainerRuntime prevents access to distributed cache entries on a full disk

2018-09-18 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8784: -- Attachment: YARN-8784.001.patch > DockerLinuxContainerRuntime prevents access to distributed cache

[jira] [Commented] (YARN-8648) Container cgroups are leaked when using docker

2018-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619730#comment-16619730 ] Hudson commented on YARN-8648: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14997 (See

[jira] [Commented] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619716#comment-16619716 ] Hadoop QA commented on YARN-8789: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1013) CS should watch resource utilization of containers and allocate speculative containers if appropriate

2018-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619709#comment-16619709 ] Arun Suresh commented on YARN-1013: --- Attached an initial version of the patch for branch-2. Kindly

[jira] [Updated] (YARN-1013) CS should watch resource utilization of containers and allocate speculative containers if appropriate

2018-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-1013: -- Attachment: YARN-1013-001.branch-2.patch > CS should watch resource utilization of containers and

[jira] [Commented] (YARN-8648) Container cgroups are leaked when using docker

2018-09-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619670#comment-16619670 ] Jason Lowe commented on YARN-8648: -- Thanks, [~billie.rinaldi]! Looks like this is good to go then.

[jira] [Created] (YARN-8790) Authentication Filter change to force security check

2018-09-18 Thread Zian Chen (JIRA)
Zian Chen created YARN-8790: --- Summary: Authentication Filter change to force security check Key: YARN-8790 URL: https://issues.apache.org/jira/browse/YARN-8790 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8648) Container cgroups are leaked when using docker

2018-09-18 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619655#comment-16619655 ] Billie Rinaldi commented on YARN-8648: -- Thanks for checking in, [~Jim_Brennan] and [~jlowe]. I don't

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-18 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619631#comment-16619631 ] Botong Huang commented on YARN-7599: Thanks [~bibinchundatt] for the review!

[jira] [Updated] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-18 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7599: --- Attachment: YARN-7599-YARN-7402.v5.patch > [GPG] ApplicationCleaner in Global Policy Generator >

[jira] [Updated] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-18 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8696: --- Attachment: YARN-8696.v5.patch > [AMRMProxy] FederationInterceptor upgrade: home sub-cluster

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-18 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619572#comment-16619572 ] Bibin A Chundatt commented on YARN-7599: Thank you [~botong] for clarification Few comments on

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-18 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619569#comment-16619569 ] Zian Chen commented on YARN-8777: - Hi [~eyang], thanks for the patch, some quick suggestions and

[jira] [Commented] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619558#comment-16619558 ] Hadoop QA commented on YARN-8757: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8767) TestStreamingStatus fails

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619536#comment-16619536 ] Hadoop QA commented on YARN-8767: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-18 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619511#comment-16619511 ] Giovanni Matteo Fumarola commented on YARN-8696: Thanks [~botong] . 

[jira] [Reopened] (YARN-8786) LinuxContainerExecutor fails sporadically in create_local_dirs

2018-09-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened YARN-8786: -- This should be left open to track the sporadic failure in creating directories. YARN-8751 may make this

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-09-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619480#comment-16619480 ] Wangda Tan commented on YARN-8725: -- [~tangzhankun], cleanup whole staging dir seems overkill because

[jira] [Commented] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

2018-09-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619469#comment-16619469 ] Wangda Tan commented on YARN-8757: -- Thanks [~sunilg],  For 1. The default case is already handled by

[jira] [Updated] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

2018-09-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8757: - Attachment: YARN-8757.003.patch > [Submarine] Add Tensorboard component when --tensorboard is specified >

[jira] [Commented] (YARN-8786) LinuxContainerExecutor fails sporadically in create_local_dirs

2018-09-18 Thread Jon Bender (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619451#comment-16619451 ] Jon Bender commented on YARN-8786: -- Ah, I figured we wanted to leave this open until the race conditions

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-18 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619449#comment-16619449 ] Botong Huang commented on YARN-7599: bq. One concern is the response size Yeah we've hit this exact

[jira] [Updated] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8789: -- Attachment: YARN-8789.1.patch > Add BoundedQueue to AsyncDispatcher >

[jira] [Assigned] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR reassigned YARN-8789: - Assignee: BELUGA BEHR > Add BoundedQueue to AsyncDispatcher >

[jira] [Resolved] (YARN-8786) LinuxContainerExecutor fails sporadically in create_local_dirs

2018-09-18 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger resolved YARN-8786. --- Resolution: Duplicate Sounds good. Resolving this as a duplicate of YARN-8751 >

[jira] [Assigned] (YARN-1013) CS should watch resource utilization of containers and allocate speculative containers if appropriate

2018-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-1013: - Assignee: Arun Suresh (was: Weiwei Yang) > CS should watch resource utilization of containers

[jira] [Updated] (YARN-8767) TestStreamingStatus fails

2018-09-18 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-8767: --- Attachment: YARN-8767.003.patch > TestStreamingStatus fails > - > >

[jira] [Commented] (YARN-8786) LinuxContainerExecutor fails sporadically in create_local_dirs

2018-09-18 Thread Jon Bender (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619361#comment-16619361 ] Jon Bender commented on YARN-8786: -- Yep, YARN-8751 should definitely lessen the severity of the issue for

[jira] [Comment Edited] (YARN-8786) LinuxContainerExecutor fails sporadically in create_local_dirs

2018-09-18 Thread Jon Bender (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619361#comment-16619361 ] Jon Bender edited comment on YARN-8786 at 9/18/18 4:28 PM: --- Yep, YARN-8751 

[jira] [Created] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-18 Thread BELUGA BEHR (JIRA)
BELUGA BEHR created YARN-8789: - Summary: Add BoundedQueue to AsyncDispatcher Key: YARN-8789 URL: https://issues.apache.org/jira/browse/YARN-8789 Project: Hadoop YARN Issue Type: Improvement

[jira] [Comment Edited] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-18 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618519#comment-16618519 ] Bibin A Chundatt edited comment on YARN-7599 at 9/18/18 3:30 PM: - Thank

[jira] [Commented] (YARN-8635) Container Resource localization fails if umask is 077

2018-09-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619284#comment-16619284 ] Jason Lowe commented on YARN-8635: -- Thanks for the patch! It would be nice to have a short comment

[jira] [Commented] (YARN-8786) LinuxContainerExecutor fails sporadically in create_local_dirs

2018-09-18 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619248#comment-16619248 ] Eric Badger commented on YARN-8786: --- As [~shaneku...@gmail.com] said on the mailing list, this should be

[jira] [Comment Edited] (YARN-8553) Reduce complexity of AHSWebService getApps method

2018-09-18 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619232#comment-16619232 ] Antal Bálint Steinbach edited comment on YARN-8553 at 9/18/18 2:59 PM:

[jira] [Commented] (YARN-8553) Reduce complexity of AHSWebService getApps method

2018-09-18 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619232#comment-16619232 ] Antal Bálint Steinbach commented on YARN-8553: -- Hi [~snemeth] , Thanks for creating the

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619208#comment-16619208 ] Weiwei Yang commented on YARN-8771: --- OK, if that's the case, I am fine with the patch. LGTM, +1, if we

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619181#comment-16619181 ] Tao Yang commented on YARN-8771: Thanks [~cheersyang] for the review. {quote} Instead of adding a new

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619110#comment-16619110 ] Hadoop QA commented on YARN-8468: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8750) Refactor TestQueueMetrics

2018-09-18 Thread Zoltan Siegl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619061#comment-16619061 ] Zoltan Siegl commented on YARN-8750: Thanks for the patch, +1 LGTM (non-binding) > Refactor

[jira] [Updated] (YARN-8783) Improve the documentation for the docker.trusted.registries configuration

2018-09-18 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8783: -- Summary: Improve the documentation for the docker.trusted.registries configuration (was: Property

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-18 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618935#comment-16618935 ] Antal Bálint Steinbach commented on YARN-8468: -- Hi [~cheersyang] , Thanks for the feedback.

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-18 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468.013.patch > Limit container sizes per queue in

[jira] [Updated] (YARN-8749) Restrict job submission to queue based on apptype

2018-09-18 Thread Oleksandr Shevchenko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksandr Shevchenko updated YARN-8749: --- Attachment: YARN-8749.001.patch > Restrict job submission to queue based on apptype >

[jira] [Commented] (YARN-8749) Restrict job submission to queue based on apptype

2018-09-18 Thread Oleksandr Shevchenko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618929#comment-16618929 ] Oleksandr Shevchenko commented on YARN-8749: Attached patch to demonstrate the approach. 

[jira] [Commented] (YARN-8775) TestDiskFailures.testLocalDirsFailures sometimes can fail on concurrent File modifications

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618910#comment-16618910 ] Hadoop QA commented on YARN-8775: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8783) Property docker.trusted.registries does not work when using a list

2018-09-18 Thread Simon Prewo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618872#comment-16618872 ] Simon Prewo edited comment on YARN-8783 at 9/18/18 10:35 AM: -

[jira] [Commented] (YARN-8653) Wrong display of resources when cluster resources are less than min resources

2018-09-18 Thread Jinjiang Ling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618876#comment-16618876 ] Jinjiang Ling commented on YARN-8653: - Hi [~haibochen], could you help to review this ? > Wrong

[jira] [Comment Edited] (YARN-8783) Property docker.trusted.registries does not work when using a list

2018-09-18 Thread Simon Prewo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618872#comment-16618872 ] Simon Prewo edited comment on YARN-8783 at 9/18/18 10:26 AM: -

[jira] [Commented] (YARN-8783) Property docker.trusted.registries does not work when using a list

2018-09-18 Thread Simon Prewo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618872#comment-16618872 ] Simon Prewo commented on YARN-8783: --- [~shaneku...@gmail.com], [~eyang] Thanks a lot for you great

[jira] [Commented] (YARN-8787) Fix broken list items in PlacementConstraints documentation

2018-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618810#comment-16618810 ] Hudson commented on YARN-8787: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14992 (See

[jira] [Updated] (YARN-8775) TestDiskFailures.testLocalDirsFailures sometimes can fail on concurrent File modifications

2018-09-18 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8775: - Attachment: YARN-8775.002.patch > TestDiskFailures.testLocalDirsFailures

[jira] [Commented] (YARN-8775) TestDiskFailures.testLocalDirsFailures sometimes can fail on concurrent File modifications

2018-09-18 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618803#comment-16618803 ] Antal Bálint Steinbach commented on YARN-8775: -- Hi [~snemeth] , Thanks for the comments. All

[jira] [Commented] (YARN-8653) Wrong display of resources when cluster resources are less than min resources

2018-09-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618786#comment-16618786 ] Weiwei Yang commented on YARN-8653: --- Hi [~lingjinjiang] I am not familiar with fair scheduler code,

[jira] [Commented] (YARN-8787) Fix broken list items in PlacementConstraints documentation

2018-09-18 Thread Masahiro Tanaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618781#comment-16618781 ] Masahiro Tanaka commented on YARN-8787: --- Thank you for re-uploading and reviewing [~ajisakaa] !

[jira] [Commented] (YARN-8653) Wrong display of resources when cluster resources are less than min resources

2018-09-18 Thread Jinjiang Ling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618768#comment-16618768 ] Jinjiang Ling commented on YARN-8653: - Hi [~cheersyang], could you help to review this ? > Wrong

[jira] [Updated] (YARN-8787) Fix broken list items in PlacementConstraints documentation

2018-09-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8787: -- Summary: Fix broken list items in PlacementConstraints documentation (was: Fix broken list items in

[jira] [Commented] (YARN-8787) Fix broken list items in PlacementConstraints.md.vm

2018-09-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618746#comment-16618746 ] Weiwei Yang commented on YARN-8787: --- +1 as well, thanks [~masatana], [~ajisakaa], I'll help to commit

[jira] [Commented] (YARN-8787) Fix broken list items in PlacementConstraints.md.vm

2018-09-18 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618720#comment-16618720 ] Akira Ajisaka commented on YARN-8787: - +1, thanks [~masatana]. > Fix broken list items in

[jira] [Commented] (YARN-8787) Fix broken list items in PlacementConstraints.md.vm

2018-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618633#comment-16618633 ] Hadoop QA commented on YARN-8787: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8652) [UI2] YARN UI2 breaks if getUserInfo REST API is not available in older versions.

2018-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618625#comment-16618625 ] Hudson commented on YARN-8652: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14989 (See

[jira] [Commented] (YARN-8726) [UI2] YARN UI2 is not accessible when config.env file failed to load

2018-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618600#comment-16618600 ] Hudson commented on YARN-8726: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14988 (See

[jira] [Commented] (YARN-8753) [UI2] Lost nodes representation missing from Nodemanagers Chart

2018-09-18 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618592#comment-16618592 ] Sunil Govindan commented on YARN-8753: -- This needs a rebase to trunk. [~yeshavora] pls help > [UI2]

  1   2   >