[jira] [Updated] (YARN-3409) Support Node Attribute functionality

2017-07-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3409: Description: Specify only one label for each node (IAW, partition a cluster) is a way to

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

2017-07-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097026#comment-16097026 ] Naganarasimha G R commented on YARN-3409: - In between, i have updated the naming convention (from

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

2017-07-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097025#comment-16097025 ] Naganarasimha G R commented on YARN-3409: - Thanks [~dan...@cloudera.com], [~grey], [~sunilg] &

[jira] [Updated] (YARN-3409) Support Node Attribute functionality

2017-07-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3409: Summary: Support Node Attribute functionality (was: Add constraint node labels) > Support

[jira] [Commented] (YARN-6628) Unexpected jackson-core-2.2.3 dependency introduced

2017-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097006#comment-16097006 ] Hadoop QA commented on YARN-6628: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096979#comment-16096979 ] Hadoop QA commented on YARN-6768: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3409) Add constraint node labels

2017-07-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096933#comment-16096933 ] Wangda Tan commented on YARN-3409: -- Just read above comments from [~sunilg]/[~grey]/[~dan...@cloudera.com]

[jira] [Updated] (YARN-6628) Unexpected jackson-core-2.2.3 dependency introduced

2017-07-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-6628: -- Attachment: YARN-6628.5-branch-2.patch Thanks [~jlowe]. Relocated the service loader in the meta

[jira] [Commented] (YARN-6840) Leverage RMStateStore to store scheduler configuration updates

2017-07-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096913#comment-16096913 ] Wangda Tan commented on YARN-6840: -- [~Naganarasimha], thanks, I think compress could still help here: for

[jira] [Updated] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-6768: -- Attachment: YARN-6768.7.patch Thanks [~jlowe] and [~nroberts]. This makes a nice addition. >

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096899#comment-16096899 ] Wangda Tan commented on YARN-6788: -- Thanks [~sunilg], In general looks good, few comments for

[jira] [Comment Edited] (YARN-5219) When an export var command fails in launch_container.sh, the full container launch should fail

2017-07-21 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096740#comment-16096740 ] Suma Shivaprasad edited comment on YARN-5219 at 7/21/17 9:03 PM: - 1. Could

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096847#comment-16096847 ] Hadoop QA commented on YARN-6804: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096821#comment-16096821 ] Jason Lowe commented on YARN-6768: -- Thanks for updating the patch! I think we're almost there. It looks

[jira] [Commented] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096818#comment-16096818 ] Hadoop QA commented on YARN-6846: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096783#comment-16096783 ] Hadoop QA commented on YARN-6733: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6846: - Attachment: YARN-6846.003.patch Tweaking the patch to remove some C99-isms so the patch is easier to pull

[jira] [Updated] (YARN-4731) container-executor should not follow symlinks in recursive_unlink_children

2017-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4731: - Fix Version/s: 2.8.2 I committed this to branch-2.8 and branch-2.8.2 as well. > container-executor should

[jira] [Updated] (YARN-4594) container-executor fails to remove directory tree when chmod required

2017-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4594: - Fix Version/s: 2.8.2 I committed this to branch-2.8 and branch-2.8.2 as well. > container-executor fails

[jira] [Updated] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-21 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6804: - Attachment: YARN-6804-yarn-native-services.005.patch > Allow custom hostname for docker containers

[jira] [Commented] (YARN-5219) When an export var command fails in launch_container.sh, the full container launch should fail

2017-07-21 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096740#comment-16096740 ] Suma Shivaprasad commented on YARN-5219: Could enable "set +o pipefail -e" to capture exitCode of

[jira] [Updated] (YARN-6733) Add table for storing sub-application entities

2017-07-21 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6733: - Attachment: YARN-6733-YARN-5355.008.patch The rebased patch was not correctly generated. Uploading v008!

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096730#comment-16096730 ] Hadoop QA commented on YARN-6733: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096701#comment-16096701 ] Hudson commented on YARN-6804: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #12044 (See

[jira] [Commented] (YARN-6850) Ensure that supplemented timestamp is stored only for flow run metrics

2017-07-21 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096682#comment-16096682 ] Vrushali C commented on YARN-6850: -- Sounds good, thanks Varun. +1 on the patch. Will commit it in a day

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096680#comment-16096680 ] Jian He commented on YARN-6804: --- I've refreshed the yarn-native-service branch to latest trunk.

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096677#comment-16096677 ] Jian He commented on YARN-6804: --- The trunk patch looks good. Committed in trunk. > Allow custom hostname

[jira] [Closed] (YARN-6854) many job failed if NM couldn't detect disk error

2017-07-21 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash closed YARN-6854. -- > many job failed if NM couldn't detect disk error > > >

[jira] [Resolved] (YARN-6854) many job failed if NM couldn't detect disk error

2017-07-21 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved YARN-6854. Resolution: Not A Problem Please send your queries to the mailing list. JIRA is for tracking

[jira] [Commented] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096650#comment-16096650 ] Hadoop QA commented on YARN-6846: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6840) Leverage RMStateStore to store scheduler configuration updates

2017-07-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096632#comment-16096632 ] Naganarasimha G R commented on YARN-6840: - [~wangda], Can help to check that out, IIUC Based on

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096610#comment-16096610 ] Hadoop QA commented on YARN-6788: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5219) When an export var command fails in launch_container.sh, the full container launch should fail

2017-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096580#comment-16096580 ] Hadoop QA commented on YARN-5219: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6846: - Attachment: YARN-6846.002.patch Patch to address the whitespace issues. > Nodemanager can fail to fully

[jira] [Commented] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096512#comment-16096512 ] Hadoop QA commented on YARN-6846: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096506#comment-16096506 ] Wangda Tan commented on YARN-6593: -- [~kkaranasos], sounds good. Thanks > [API] Introduce Placement

[jira] [Commented] (YARN-6771) Use classloader inside configuration class to make new classes

2017-07-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096454#comment-16096454 ] Sangjin Lee commented on YARN-6771: --- Thanks for linking the ticket. As for wider tests, I think it'd be

[jira] [Assigned] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-6846: Assignee: Jason Lowe > Nodemanager can fail to fully delete application local directories when >

[jira] [Updated] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6846: - Attachment: YARN-6846.001.patch Attaching a patch that makes the container-executor more tolerant of paths

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.010.patch Latest patch with some more minor improvements. There are few

[jira] [Updated] (YARN-6450) TestContainerManagerWithLCE requires override for each new test added to ContainerManagerTest

2017-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6450: - Fix Version/s: 2.8.2 I committed this to branch-2.8 and branch-2.8.2 as well. >

[jira] [Commented] (YARN-3409) Add constraint node labels

2017-07-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096324#comment-16096324 ] Sunil G commented on YARN-3409: --- Hi [~templedf] Lemme take the liberty of pointing out some thoughts here.

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

2017-07-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096167#comment-16096167 ] Varun Saxena commented on YARN-6047: Note: Need to update documentation for metricstimebegin and

[jira] [Commented] (YARN-6850) Ensure that supplemented timestamp is stored only for flow run metrics

2017-07-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096166#comment-16096166 ] Varun Saxena commented on YARN-6850: Thanks [~vrushalic] for the review. bq. In case someone wants all

[jira] [Created] (YARN-6854) many job failed if NM couldn't detect disk error

2017-07-21 Thread sandflee (JIRA)
sandflee created YARN-6854: -- Summary: many job failed if NM couldn't detect disk error Key: YARN-6854 URL: https://issues.apache.org/jira/browse/YARN-6854 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-07-21 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095839#comment-16095839 ] Vrushali C commented on YARN-6820: -- thanks [~jlowe]! Yes, this whitelist would be an interim step that