[jira] [Commented] (YARN-8918) [Submarine] Correct method usage of str.subString in CliUtils

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657735#comment-16657735 ] Hadoop QA commented on YARN-8918: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6913) Some cgroup settings are not documented in yarn-default.xml

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657732#comment-16657732 ] Zhankun Tang commented on YARN-6913: [~miklos.szeg...@cloudera.com] , I just checked that the first

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657720#comment-16657720 ] Hadoop QA commented on YARN-8917: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8918) [Submarine] Correct method usage of str.subString in CliUtils

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8918: --- Description: In CliUtils.java (line 74), there's uncorrect code block,: {code:java} if

[jira] [Updated] (YARN-8918) [Submarine] Correct method usage of str.subString(0, str.length()) in CliUtils

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8918: --- Summary: [Submarine] Correct method usage of str.subString(0, str.length()) in CliUtils (was:

[jira] [Updated] (YARN-8918) [Submarine] Correct method usage of str.subString in CliUtils

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8918: --- Summary: [Submarine] Correct method usage of str.subString in CliUtils (was: [Submarine] Correct

[jira] [Updated] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8918: --- Attachment: YARN-8918-trunk.003.patch > [Submarine] Remove redundant method of str.subString(0,

[jira] [Updated] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8918: --- Attachment: YARN-8918-trunk.002.patch > [Submarine] Remove redundant method of str.subString(0,

[jira] [Commented] (YARN-8923) Cleanup references to ENV file type in YARN service code

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657687#comment-16657687 ] Hadoop QA commented on YARN-8923: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657666#comment-16657666 ] Hadoop QA commented on YARN-8920: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8922) Fix test-container-executor

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657645#comment-16657645 ] Eric Yang commented on YARN-8922: - [~rkanter] Code 139 means segmentation fault. The short hand for

[jira] [Comment Edited] (YARN-8922) Fix test-container-executor

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657645#comment-16657645 ] Eric Yang edited comment on YARN-8922 at 10/20/18 1:43 AM: --- [~rkanter] Code 139

[jira] [Updated] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2018-10-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8917: --- Attachment: YARN-8917.002.patch > Absolute (maximum) capacity of level3+ queues is wrongly calculated for >

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2018-10-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657637#comment-16657637 ] Tao Yang commented on YARN-8917: Thanks [~sunilg], [~leftnoteasy] for the review. {quote} cud u pls write

[jira] [Commented] (YARN-8923) Cleanup references to ENV file type in YARN service code

2018-10-19 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657633#comment-16657633 ] Suma Shivaprasad commented on YARN-8923: [~eyang] [~gsaha] Can you pls review? > Cleanup

[jira] [Updated] (YARN-8923) Cleanup references to ENV file type in code

2018-10-19 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8923: --- Attachment: YARN-8923.1.patch > Cleanup references to ENV file type in code >

[jira] [Updated] (YARN-8923) Cleanup references to ENV file type in YARN service code

2018-10-19 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8923: --- Summary: Cleanup references to ENV file type in YARN service code (was: Cleanup references

[jira] [Created] (YARN-8923) Cleanup references to ENV file type in code

2018-10-19 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-8923: -- Summary: Cleanup references to ENV file type in code Key: YARN-8923 URL: https://issues.apache.org/jira/browse/YARN-8923 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8542) Yarn Service: Add component name to container json

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657631#comment-16657631 ] Hadoop QA commented on YARN-8542: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8911) NM incorrectly account for container cpu utilization by their number of vcores

2018-10-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657594#comment-16657594 ] Haibo Chen commented on YARN-8911: -- I see.  I can update YARN-1011 oversubscription code to address this.

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-19 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657588#comment-16657588 ] Suma Shivaprasad commented on YARN-8920: Thanks for reviewing the patch [~leftnoteasy] Attaching

[jira] [Updated] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-19 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8920: --- Attachment: YARN-8920.3.patch > LogAggregation should be configurable to allow writing to

[jira] [Commented] (YARN-8895) Improve YARN Error diagnostics

2018-10-19 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657579#comment-16657579 ] Young Chen commented on YARN-8895: -- [~subru] [~wangda], [~jlowe], [~sunilg] - if you have time to take a

[jira] [Commented] (YARN-8542) Yarn Service: Add component name to container json

2018-10-19 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657575#comment-16657575 ] Chandni Singh commented on YARN-8542: - Addressed checkstyle & license warning in patch 2 > Yarn

[jira] [Updated] (YARN-8542) Yarn Service: Add component name to container json

2018-10-19 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8542: Attachment: YARN-8542.002.patch > Yarn Service: Add component name to container json >

[jira] [Commented] (YARN-8922) Fix test-container-executor

2018-10-19 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657572#comment-16657572 ] Robert Kanter commented on YARN-8922: - [~eyang], I'm not sure why you and test-patch are getting ERROR

[jira] [Updated] (YARN-8895) Improve YARN Error diagnostics

2018-10-19 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Young Chen updated YARN-8895: - Description: Currently identifying error sources can be quite difficult, as they are written into an

[jira] [Commented] (YARN-8895) Improve YARN Error diagnostics

2018-10-19 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657567#comment-16657567 ] Young Chen commented on YARN-8895: -- Currently identifying error sources can be quite difficult, as they

[jira] [Commented] (YARN-8542) Yarn Service: Add component name to container json

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657554#comment-16657554 ] Hadoop QA commented on YARN-8542: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657549#comment-16657549 ] Jason Lowe commented on YARN-8865: -- Thanks for updating the patch! The main change looks fine to me. It

[jira] [Commented] (YARN-8911) NM incorrectly account for container cpu utilization by their number of vcores

2018-10-19 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657521#comment-16657521 ] Íñigo Goiri commented on YARN-8911: --- I think reporting 6 is the correct way to go. We report as vcores.

[jira] [Commented] (YARN-8542) Yarn Service: Add component name to container json

2018-10-19 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657513#comment-16657513 ] Chandni Singh commented on YARN-8542: - [~gsaha] [~eyang] could you please review? > Yarn Service: Add

[jira] [Updated] (YARN-8542) Yarn Service: Add component name to container json

2018-10-19 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8542: Attachment: YARN-8542.001.patch > Yarn Service: Add component name to container json >

[jira] [Commented] (YARN-8922) Fix test-container-executor

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657507#comment-16657507 ] Hadoop QA commented on YARN-8922: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8911) NM incorrectly account for container cpu utilization by their number of vcores

2018-10-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657488#comment-16657488 ] Haibo Chen commented on YARN-8911: -- CC [~elgoiri], who wrote the initial code. > NM incorrectly account

[jira] [Commented] (YARN-8911) NM incorrectly account for container cpu utilization by their number of vcores

2018-10-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657482#comment-16657482 ] Haibo Chen commented on YARN-8911: -- YARN-1011 has been using the cpu portion of ResourceUtilization as a

[jira] [Comment Edited] (YARN-8911) NM incorrectly account for container cpu utilization by their number of vcores

2018-10-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657482#comment-16657482 ] Haibo Chen edited comment on YARN-8911 at 10/19/18 9:48 PM: YARN-1011 has been

[jira] [Comment Edited] (YARN-8922) Fix test-container-executor

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657472#comment-16657472 ] Eric Yang edited comment on YARN-8922 at 10/19/18 9:46 PM: --- The code base may

[jira] [Comment Edited] (YARN-8922) Fix test-container-executor

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657472#comment-16657472 ] Eric Yang edited comment on YARN-8922 at 10/19/18 9:39 PM: --- The code base may

[jira] [Commented] (YARN-8922) Fix test-container-executor

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657472#comment-16657472 ] Eric Yang commented on YARN-8922: - The code base may have years of evolution that made some mode of

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657452#comment-16657452 ] Eric Yang commented on YARN-8569: - [~rkanter] Thank you for filing the problem as separate JIRA. I will

[jira] [Commented] (YARN-8922) Fix test-container-executor

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657450#comment-16657450 ] Eric Yang commented on YARN-8922: - [~rkanter] Thank you for the patch. I get a segmentation fault with

[jira] [Commented] (YARN-8911) NM incorrectly account for container cpu utilization by their number of vcores

2018-10-19 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657448#comment-16657448 ] Jim Brennan commented on YARN-8911: --- [~haibochen], can you provide a little more detail about what lead

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657441#comment-16657441 ] Hadoop QA commented on YARN-8920: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657422#comment-16657422 ] Hadoop QA commented on YARN-8920: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657413#comment-16657413 ] Wangda Tan commented on YARN-8920: -- Thanks [~suma.shivaprasad], 1) Inside YarnConfiguration, We should

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-19 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657385#comment-16657385 ] Robert Kanter commented on YARN-8569: - [~eyang], I think I've come up with the proper fix for the

[jira] [Commented] (YARN-8922) Fix test-container-executor

2018-10-19 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657383#comment-16657383 ] Robert Kanter commented on YARN-8922: - I've tested running {{test-container-executor}} followed by

[jira] [Updated] (YARN-8922) Fix test-container-executor

2018-10-19 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-8922: Attachment: YARN-8922.001.patch > Fix test-container-executor > --- > >

[jira] [Created] (YARN-8922) Fix test-container-executor

2018-10-19 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-8922: --- Summary: Fix test-container-executor Key: YARN-8922 URL: https://issues.apache.org/jira/browse/YARN-8922 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657311#comment-16657311 ] Hadoop QA commented on YARN-8569: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8921) SnapshotBasedOverAllocationPolicy incorrectly caps the amount of memory availabe in bytes to Integer.MAX_VALUE

2018-10-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8921: - Summary: SnapshotBasedOverAllocationPolicy incorrectly caps the amount of memory availabe in bytes to

[jira] [Created] (YARN-8921) SnapshotBasedOverAllocationPolicy incorrectly rounds memory availabe int bytes

2018-10-19 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8921: Summary: SnapshotBasedOverAllocationPolicy incorrectly rounds memory availabe int bytes Key: YARN-8921 URL: https://issues.apache.org/jira/browse/YARN-8921 Project: Hadoop

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-19 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657276#comment-16657276 ] Suma Shivaprasad commented on YARN-8920: Fixed javadoc > LogAggregation should be configurable to

[jira] [Updated] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-19 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8920: --- Attachment: YARN-8920.2.patch > LogAggregation should be configurable to allow writing to

[jira] [Updated] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-19 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8920: --- Attachment: YARN-8920.1.patch > LogAggregation should be configurable to allow writing to

[jira] [Updated] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-19 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8920: --- Description: Currently NM Log Aggregation does not support writing to underlying storage as

[jira] [Created] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-19 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-8920: -- Summary: LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user Key: YARN-8920 URL:

[jira] [Commented] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657251#comment-16657251 ] Hadoop QA commented on YARN-8893: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8910) Misleading log statement in NM when max retries is -1

2018-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657244#comment-16657244 ] Hudson commented on YARN-8910: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15272 (See

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-19 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657208#comment-16657208 ] Robert Kanter commented on YARN-8569: - [~eyang], I tried it out and with the YARN-8569 014 patch,

[jira] [Commented] (YARN-8910) Misleading log statement in NM when max retries is -1

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657201#comment-16657201 ] Eric Yang commented on YARN-8910: - Thank you for the patch [~csingh]. I just committed this to trunk,

[jira] [Commented] (YARN-8910) Misleading log statement in NM when max retries is -1

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657186#comment-16657186 ] Eric Yang commented on YARN-8910: - +1 Unit test failure for patch 001 was caused by YARN-8448. The unit

[jira] [Commented] (YARN-8908) Fix errors in yarn-default.xml related to GPU/FPGA

2018-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657157#comment-16657157 ] Hudson commented on YARN-8908: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15270 (See

[jira] [Commented] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

2018-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657158#comment-16657158 ] Hudson commented on YARN-8916: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15270 (See

[jira] [Updated] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-19 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated YARN-8919: --- Description: These tests still fail due to {{NoClassDefFoundError:

[jira] [Commented] (YARN-8587) Delays are noticed to launch docker container

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657126#comment-16657126 ] Hadoop QA commented on YARN-8587: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-19 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657127#comment-16657127 ] Takanobu Asanuma commented on YARN-8919: Uploaded the wip patch. It seems fix the tests in local

[jira] [Updated] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-19 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated YARN-8919: --- Attachment: YARN-8919.WIP.1.patch > Some tests fail due to NoClassDefFoundError for

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2018-10-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657113#comment-16657113 ] Wangda Tan commented on YARN-8917: -- Nice catch [~Tao Yang]! Fix makes sense to me. [~sunilg], this

[jira] [Commented] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657107#comment-16657107 ] Hadoop QA commented on YARN-8059: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-19 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657104#comment-16657104 ] Takanobu Asanuma commented on YARN-8919: They don't depend on hadoop-minicluster so YARN-8899

[jira] [Created] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-19 Thread Takanobu Asanuma (JIRA)
Takanobu Asanuma created YARN-8919: -- Summary: Some tests fail due to NoClassDefFoundError for OperatorCreationException Key: YARN-8919 URL: https://issues.apache.org/jira/browse/YARN-8919 Project:

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-19 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657096#comment-16657096 ] Robert Kanter commented on YARN-8569: - Sorry about that. I had to fix a number of problems with

[jira] [Updated] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

2018-10-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8916: - Fix Version/s: 3.3.0 > Define a constant "docker" string in "ContainerRuntimeConstants.java" for >

[jira] [Updated] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

2018-10-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8918: - Fix Version/s: (was: 3.2.1) (was: 3.3.0) (was: 3.1.2) >

[jira] [Updated] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

2018-10-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8918: - Fix Version/s: 3.2.1 3.3.0 3.1.2 > [Submarine] Remove redundant

[jira] [Updated] (YARN-8908) Fix errors in yarn-default.xml related to GPU/FPGA

2018-10-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8908: - Fix Version/s: 3.2.1 3.3.0 3.1.2 > Fix errors in yarn-default.xml

[jira] [Updated] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

2018-10-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8916: - Fix Version/s: (was: 3.2.0) 3.2.1 > Define a constant "docker" string in

[jira] [Updated] (YARN-8569) Create an interface to provide cluster information to application

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8569: Attachment: YARN-8569.014.patch > Create an interface to provide cluster information to application >

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657077#comment-16657077 ] Eric Yang commented on YARN-8569: - Patch 14 includes the test-container-executor hot fix to pass

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657073#comment-16657073 ] Eric Yang commented on YARN-8569: - Unit test failure is caused by YARN-8448, where

[jira] [Commented] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

2018-10-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657057#comment-16657057 ] Wangda Tan commented on YARN-8916: -- +1, thanks [~tangzhankun]. > Define a constant "docker" string in

[jira] [Commented] (YARN-8448) AM HTTPS Support for AM communication with RMWeb proxy

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657044#comment-16657044 ] Eric Yang commented on YARN-8448: - [~rkanter] This patch has a problem with clean up

[jira] [Commented] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657034#comment-16657034 ] Hadoop QA commented on YARN-8916: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Issue Comment Deleted] (YARN-8569) Create an interface to provide cluster information to application

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8569: Comment: was deleted (was: Node manager unit test failure is caused by YARN-8449 where the tmp directory

[jira] [Issue Comment Deleted] (YARN-8449) RM HA for AM web server HTTPS Support

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8449: Comment: was deleted (was: Container-executor change is causing pre-commit build to fail.

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657027#comment-16657027 ] Eric Yang commented on YARN-8569: - Node manager unit test failure is caused by YARN-8449 where the tmp

[jira] [Commented] (YARN-8449) RM HA for AM web server HTTPS Support

2018-10-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657022#comment-16657022 ] Eric Yang commented on YARN-8449: - Container-executor change is causing pre-commit build to fail.

[jira] [Assigned] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-7277: -- Assignee: Zhankun Tang > Container Launch expand environment needs to consider bracket

[jira] [Comment Edited] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657016#comment-16657016 ] Zhankun Tang edited comment on YARN-7277 at 10/19/18 4:20 PM: -- [~balloons] ,

[jira] [Commented] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657016#comment-16657016 ] Zhankun Tang commented on YARN-7277: [~balloons] , Thanks for reporting this. I'd like to check it. >

[jira] [Commented] (YARN-8908) Fix errors in yarn-default.xml related to GPU/FPGA

2018-10-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657005#comment-16657005 ] Wangda Tan commented on YARN-8908: -- +1, thanks [~tangzhankun].  > Fix errors in yarn-default.xml related

[jira] [Commented] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

2018-10-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657004#comment-16657004 ] Wangda Tan commented on YARN-8918: -- [~tangzhankun],  I think the correct logic should be:  {code:java}

[jira] [Commented] (YARN-8833) compute shares may lock the scheduling process

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656972#comment-16656972 ] Zhankun Tang commented on YARN-8833: [~yoelee] , could you please elaborate the problem, or how to

[jira] [Commented] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656936#comment-16656936 ] Zhankun Tang commented on YARN-8916: [~ebadger] , Thanks for the review! > Define a constant "docker"

[jira] [Commented] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

2018-10-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656932#comment-16656932 ] Eric Badger commented on YARN-8916: --- +1 lgtm (non-binding), pending hadoopqa > Define a constant

[jira] [Commented] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656927#comment-16656927 ] Hadoop QA commented on YARN-8918: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2018-10-19 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656890#comment-16656890 ] Sunil Govindan commented on YARN-8917: -- [~Tao Yang] cud u pls write a test case to prove the

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2018-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656884#comment-16656884 ] Hadoop QA commented on YARN-8917: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >