[jira] [Commented] (YARN-4883) Make consistent operation name in AdminService

[ https://issues.apache.org/jira/browse/YARN-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213343#comment-15213343 ] Hadoop QA commented on YARN-4883: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213335#comment-15213335 ] Hudson commented on YARN-4805: -- FAILURE: Integrated in Hadoop-trunk-Commit #9506 (See

[jira] [Commented] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213332#comment-15213332 ] Karthik Kambatla commented on YARN-4805: Checking this in. > Don't go through all schedulers in

[jira] [Commented] (YARN-4808) SchedulerNode can use a few more cosmetic changes

[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213328#comment-15213328 ] Karthik Kambatla commented on YARN-4808: [~leftnoteasy], [~asuresh] - can either of you review this

[jira] [Updated] (YARN-3839) Quit throwing NMNotYetReadyException

[ https://issues.apache.org/jira/browse/YARN-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3839: --- Target Version/s: (was: 2.8.0) > Quit throwing NMNotYetReadyException >

[jira] [Updated] (YARN-3839) Quit throwing NMNotYetReadyException

[ https://issues.apache.org/jira/browse/YARN-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3839: --- Assignee: (was: Karthik Kambatla) > Quit throwing NMNotYetReadyException >

[jira] [Updated] (YARN-3073) FS rack-local requests wait for node-locality delay even in the absence of node-local requests

[ https://issues.apache.org/jira/browse/YARN-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3073: --- Assignee: (was: Karthik Kambatla) > FS rack-local requests wait for node-locality delay

[jira] [Updated] (YARN-314) Schedulers should allow resource requests of different sizes at the same priority and location

[ https://issues.apache.org/jira/browse/YARN-314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-314: -- Assignee: (was: Karthik Kambatla) > Schedulers should allow resource requests of different

[jira] [Updated] (YARN-2941) Revisit Disk IO configs

[ https://issues.apache.org/jira/browse/YARN-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2941: --- Assignee: (was: Karthik Kambatla) > Revisit Disk IO configs > --- > >

[jira] [Created] (YARN-4885) Aggregate container utilization can be negative

Karthik Kambatla created YARN-4885: -- Summary: Aggregate container utilization can be negative Key: YARN-4885 URL: https://issues.apache.org/jira/browse/YARN-4885 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213326#comment-15213326 ] Kuhu Shukla commented on YARN-4311: --- Maven and javac failures are unrelated and coming from hdfs project.

[jira] [Commented] (YARN-4884) Missing documentation about rmadmin command regarding node labels

[ https://issues.apache.org/jira/browse/YARN-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213316#comment-15213316 ] Hadoop QA commented on YARN-4884: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4884) Missing documentation about rmadmin command regarding node labels

[ https://issues.apache.org/jira/browse/YARN-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated YARN-4884: - Attachment: YARN-4884.01.patch > Missing documentation about rmadmin command regarding node labels >

[jira] [Created] (YARN-4884) Missing documentation about rmadmin command regarding node labels

Kai Sasaki created YARN-4884: Summary: Missing documentation about rmadmin command regarding node labels Key: YARN-4884 URL: https://issues.apache.org/jira/browse/YARN-4884 Project: Hadoop YARN

[jira] [Commented] (YARN-4773) Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled

[ https://issues.apache.org/jira/browse/YARN-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213296#comment-15213296 ] Hadoop QA commented on YARN-4773: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4883) Make consistent operation name in AdminService

[ https://issues.apache.org/jira/browse/YARN-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated YARN-4883: - Attachment: YARN-4883.01.patch > Make consistent operation name in AdminService >

[jira] [Created] (YARN-4883) Make consistent operation name in AdminService

Kai Sasaki created YARN-4883: Summary: Make consistent operation name in AdminService Key: YARN-4883 URL: https://issues.apache.org/jira/browse/YARN-4883 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4773) Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled

[ https://issues.apache.org/jira/browse/YARN-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213287#comment-15213287 ] Jun Gong commented on YARN-4773: Sorry... Attached a new patch. > Log aggregation performs extraneous

[jira] [Updated] (YARN-4773) Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled

[ https://issues.apache.org/jira/browse/YARN-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-4773: --- Attachment: YARN-4773.03.patch > Log aggregation performs extraneous filesystem operations when rolling log >

[jira] [Commented] (YARN-2883) Queuing of container requests in the NM

[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213264#comment-15213264 ] Karthik Kambatla commented on YARN-2883: Took a closer look at the patch. I am a little confused,

[jira] [Commented] (YARN-2883) Queuing of container requests in the NM

[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213235#comment-15213235 ] Karthik Kambatla commented on YARN-2883: bq. But again, this will not break any semantics of the

[jira] [Commented] (YARN-4830) Add support for resource types in the nodemanager

[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213143#comment-15213143 ] Hadoop QA commented on YARN-4830: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4830) Add support for resource types in the nodemanager

[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4830: Attachment: YARN-4830-YARN-3926.002.patch Uploaded new patch to fix checkstyle issues. > Add

[jira] [Commented] (YARN-4830) Add support for resource types in the nodemanager

[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213055#comment-15213055 ] Hadoop QA commented on YARN-4830: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213032#comment-15213032 ] Hadoop QA commented on YARN-4311: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4711) NM is going down with NPE's due to single thread processing of events by Timeline client

[ https://issues.apache.org/jira/browse/YARN-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212987#comment-15212987 ] Naganarasimha G R commented on YARN-4711: - Seems like all test case failures are not related to the

[jira] [Updated] (YARN-4830) Add support for resource types in the nodemanager

[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4830: Attachment: YARN-4830-YARN-3926.001.patch > Add support for resource types in the nodemanager >

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: YARN-4311-v12.patch Thanks a lot for all the reviews! Updating patch as per Jason's

[jira] [Commented] (YARN-4880) Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE

[ https://issues.apache.org/jira/browse/YARN-4880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212929#comment-15212929 ] Sunil G commented on YARN-4880: --- Yes, that make sense. Thanks for sharing. > Running

[jira] [Commented] (YARN-4880) Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE

[ https://issues.apache.org/jira/browse/YARN-4880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212928#comment-15212928 ] Rohith Sharma K S commented on YARN-4880: - I thought about this initially but since it start new ZK

[jira] [Commented] (YARN-4881) RM continuously switch if HDFS is too busy when NodeLabel is configured

[ https://issues.apache.org/jira/browse/YARN-4881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212924#comment-15212924 ] Rohith Sharma K S commented on YARN-4881: - I logged ticket YARN-4882 for discussion about log level

[jira] [Created] (YARN-4882) Change the log level to DEBUG for recovering completed applications

Rohith Sharma K S created YARN-4882: --- Summary: Change the log level to DEBUG for recovering completed applications Key: YARN-4882 URL: https://issues.apache.org/jira/browse/YARN-4882 Project:

[jira] [Commented] (YARN-4881) RM continuously switch if HDFS is too busy when NodeLabel is configured

[ https://issues.apache.org/jira/browse/YARN-4881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212912#comment-15212912 ] Rohith Sharma K S commented on YARN-4881: - Another issue noticed if RM continuously switches is

[jira] [Commented] (YARN-4881) RM continuously switch if HDFS is too busy when NodeLabel is configured

[ https://issues.apache.org/jira/browse/YARN-4881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212908#comment-15212908 ] Sunil G commented on YARN-4881: --- Yes. Thanks for clarifying. > RM continuously switch if HDFS is too busy

[jira] [Commented] (YARN-4881) RM continuously switch if HDFS is too busy when NodeLabel is configured

[ https://issues.apache.org/jira/browse/YARN-4881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212903#comment-15212903 ] Rohith Sharma K S commented on YARN-4881: - In our cluster RM HA is enabled. Both RM's are up and

[jira] [Commented] (YARN-4881) RM continuously switch if HDFS is too busy when NodeLabel is configured

[ https://issues.apache.org/jira/browse/YARN-4881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212899#comment-15212899 ] Sunil G commented on YARN-4881: --- One more thing to note is that for NodeLabel, we explicitly use

[jira] [Commented] (YARN-4880) Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE

[ https://issues.apache.org/jira/browse/YARN-4880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212894#comment-15212894 ] Sunil G commented on YARN-4880: --- Oh Yes. This can run an independent java app also.We also can try initialize

[jira] [Commented] (YARN-4881) RM continuously switch if HDFS is too busy when NodeLabel is configured

[ https://issues.apache.org/jira/browse/YARN-4881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212893#comment-15212893 ] Rohith Sharma K S commented on YARN-4881: - Exception trace has message like *There are 7

[jira] [Created] (YARN-4881) RM continuously switch if HDFS is too busy when NodeLabel is configured

Rohith Sharma K S created YARN-4881: --- Summary: RM continuously switch if HDFS is too busy when NodeLabel is configured Key: YARN-4881 URL: https://issues.apache.org/jira/browse/YARN-4881 Project:

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212888#comment-15212888 ] Sunil G commented on YARN-4751: --- As [~eepayne] mentioned, we might need below tickets also to get YARN-3362

[jira] [Commented] (YARN-4880) Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE

[ https://issues.apache.org/jira/browse/YARN-4880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212877#comment-15212877 ] Rohith Sharma K S commented on YARN-4880: - I do not think changing annotation would help here

[jira] [Commented] (YARN-4880) Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE

[ https://issues.apache.org/jira/browse/YARN-4880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212871#comment-15212871 ] Sunil G commented on YARN-4880: --- Hi [~rohithsharma] May be we can put {{curatorTestingServer}} initializing

[jira] [Commented] (YARN-4865) Track Reserved resources in ResourceUsage and QueueCapacities

[ https://issues.apache.org/jira/browse/YARN-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212867#comment-15212867 ] Sunil G commented on YARN-4865: --- I re-checked {{moveApplication}} and {{recoverContainer}} flows in detail.

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212866#comment-15212866 ] Sunil G commented on YARN-3933: --- Hi In current patch, below code is added in

[jira] [Created] (YARN-4880) Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE

Rohith Sharma K S created YARN-4880: --- Summary: Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE Key: YARN-4880 URL: https://issues.apache.org/jira/browse/YARN-4880 Project:

[jira] [Commented] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212861#comment-15212861 ] Hadoop QA commented on YARN-4117: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4711) NM is going down with NPE's due to single thread processing of events by Timeline client

[ https://issues.apache.org/jira/browse/YARN-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212854#comment-15212854 ] Hadoop QA commented on YARN-4711: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212853#comment-15212853 ] Shiwei Guo commented on YARN-3933: -- Sorry, I didn't catch the point, I am not a YARN source code expert,

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212851#comment-15212851 ] Shiwei Guo commented on YARN-3933: -- Seems CS do not have this issue. And as reply to Karthik Kambatla

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212844#comment-15212844 ] Shiwei Guo commented on YARN-3933: -- Sorry for long time to reply. Did you mean adding this check in the