[jira] [Updated] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3862: --- Issue Type: Sub-task (was: Bug) Parent: YARN-2928 Decide which contents to retrieve and send

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605401#comment-14605401 ] Varun Saxena commented on YARN-3862: As HBase supports prefix match, we will initially

[jira] [Created] (YARN-3863) Enahnce filters in TimelineReader

2015-06-29 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-3863: -- Summary: Enahnce filters in TimelineReader Key: YARN-3863 URL: https://issues.apache.org/jira/browse/YARN-3863 Project: Hadoop YARN Issue Type: Bug Affects

[jira] [Updated] (YARN-3863) Enahnce filters in TimelineReader

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3863: --- Description: Currently filters in timeline reader will return an entity only if all the filter

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Description: YARN-1447 and YARN-1448 are outdated. This ticket deals with AM-RM Protocol changes to support

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Attachment: YARN-3866.1.patch Attach patch for review. The patch appears to be big, but it involves the

[jira] [Created] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
MENG DING created YARN-3866: --- Summary: AM-RM protocol changes to support container resizing Key: YARN-3866 URL: https://issues.apache.org/jira/browse/YARN-3866 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Hadoop Flags: (was: Reviewed) AM-RM protocol changes to support container resizing

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Assignee: MENG DING (was: Wangda Tan) AM-RM protocol changes to support container resizing

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Component/s: (was: resourcemanager) AM-RM protocol changes to support container resizing

[jira] [Commented] (YARN-3856) YARN shoud allocate container that is closest to the data

2015-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605339#comment-14605339 ] Hadoop QA commented on YARN-3856: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-06-29 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-3862: -- Summary: Decide which contents to retrieve and send back in response in TimelineReader Key: YARN-3862 URL: https://issues.apache.org/jira/browse/YARN-3862 Project:

[jira] [Commented] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id 9999)

2015-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605490#comment-14605490 ] Hadoop QA commented on YARN-3840: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3864) TimelineReader API for aggregated entities

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3864: --- Issue Type: Sub-task (was: Bug) Parent: YARN-2928 TimelineReader API for aggregated entities

[jira] [Updated] (YARN-3864) TimelineReader API for aggregated entities

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3864: --- Component/s: timelineserver TimelineReader API for aggregated entities

[jira] [Created] (YARN-3865) Backward compatibility of reader with ATSv1

2015-06-29 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-3865: -- Summary: Backward compatibility of reader with ATSv1 Key: YARN-3865 URL: https://issues.apache.org/jira/browse/YARN-3865 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605508#comment-14605508 ] Hudson commented on YARN-3860: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #243 (See

[jira] [Commented] (YARN-3856) YARN shoud allocate container that is closest to the data

2015-06-29 Thread jaehoon ko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605377#comment-14605377 ] jaehoon ko commented on YARN-3856: -- Can any one help me? Hadoop QA complains that

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605406#comment-14605406 ] Varun Saxena commented on YARN-3862: For metrics time window, the question is whether

[jira] [Updated] (YARN-3863) Enahnce filters in TimelineReader

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3863: --- Issue Type: Sub-task (was: Bug) Parent: YARN-2928 Enahnce filters in TimelineReader

[jira] [Updated] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id 9999)

2015-06-29 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3840: Assignee: Mohammad Shahid Khan Resource Manager web ui issue when sorting application by id (with

[jira] [Created] (YARN-3864) TimelineReader API for aggregated entities

2015-06-29 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-3864: -- Summary: TimelineReader API for aggregated entities Key: YARN-3864 URL: https://issues.apache.org/jira/browse/YARN-3864 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id 9999)

2015-06-29 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3840: Environment: (was: Centos 6.6 Java 1.7) Labels: (was: PatchAvailable) Resource Manager web

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605517#comment-14605517 ] Hudson commented on YARN-3860: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #973 (See

[jira] [Resolved] (YARN-3315) Fix -list-blacklisted-trackers to print the blacklisted NMs

2015-06-29 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K resolved YARN-3315. - Resolution: Not A Problem Listing unhealthy nodes can be achieved now using the yarn command *yarn node

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605376#comment-14605376 ] Varun Saxena commented on YARN-3051: [~jrottinghuis], bq. In an earlier patch I saw

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Affects Version/s: (was: 2.2.0) AM-RM protocol changes to support container resizing

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Fix Version/s: (was: 2.3.0) AM-RM protocol changes to support container resizing

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605673#comment-14605673 ] Hudson commented on YARN-3860: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2171 (See

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605704#comment-14605704 ] Hudson commented on YARN-3860: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #232 (See

[jira] [Updated] (YARN-1965) Interrupted exception when closing YarnClient

2015-06-29 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-1965: -- Attachment: YARN-1965-v3.patch Changes to TestIPC and Client with correct indentation and formatting.

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605851#comment-14605851 ] Hudson commented on YARN-3860: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2189 (See

[jira] [Commented] (YARN-3819) Collect network usage on the node

2015-06-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605812#comment-14605812 ] Allen Wittenauer commented on YARN-3819: -1 This needs to go into common. I don't

[jira] [Commented] (YARN-3820) Collect disks usages on the node

2015-06-29 Thread Srikanth Kandula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605862#comment-14605862 ] Srikanth Kandula commented on YARN-3820: Similar discussion ongoing at YARN-3819.

[jira] [Commented] (YARN-3820) Collect disks usages on the node

2015-06-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605889#comment-14605889 ] Chris Douglas commented on YARN-3820: - [~aw] Is there a corresponding part of the

[jira] [Comment Edited] (YARN-3819) Collect network usage on the node

2015-06-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605879#comment-14605879 ] Allen Wittenauer edited comment on YARN-3819 at 6/29/15 4:58 PM:

[jira] [Commented] (YARN-3820) Collect disks usages on the node

2015-06-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605810#comment-14605810 ] Allen Wittenauer commented on YARN-3820: -1 This needs to go into common. I don't

[jira] [Resolved] (YARN-3709) RM Web UI AM link shown before MRAppMaster launch

2015-06-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt resolved YARN-3709. Resolution: Not A Problem No need to fix as its useful to show the link RM Web UI AM link

[jira] [Commented] (YARN-3819) Collect network usage on the node

2015-06-29 Thread Srikanth Kandula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605861#comment-14605861 ] Srikanth Kandula commented on YARN-3819: [~aw] Allen- Could you expand a bit?

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605883#comment-14605883 ] Hudson commented on YARN-3860: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #241 (See

[jira] [Commented] (YARN-3820) Collect disks usages on the node

2015-06-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605891#comment-14605891 ] Chris Douglas commented on YARN-3820: - Oh, didn't see YARN-3819. Will continue there.

[jira] [Commented] (YARN-3861) Add fav icon to YARN MR daemons web UI

2015-06-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605804#comment-14605804 ] Allen Wittenauer commented on YARN-3861: Why isn't this being done in common? Add

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-29 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605807#comment-14605807 ] Lei Guo commented on YARN-1197: --- [~mding], for the decrease flow via

[jira] [Commented] (YARN-3819) Collect network usage on the node

2015-06-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605879#comment-14605879 ] Allen Wittenauer commented on YARN-3819: Yes, I recognize that you are building on

[jira] [Commented] (YARN-3819) Collect network usage on the node

2015-06-29 Thread Srikanth Kandula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605917#comment-14605917 ] Srikanth Kandula commented on YARN-3819: From [~chris.douglas] @Allen Wittenauer Is

[jira] [Commented] (YARN-3820) Collect disks usages on the node

2015-06-29 Thread Srikanth Kandula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605915#comment-14605915 ] Srikanth Kandula commented on YARN-3820: Copied [~chris.douglas] comment to 3820 as

[jira] [Commented] (YARN-3819) Collect network usage on the node

2015-06-29 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605953#comment-14605953 ] Lei Guo commented on YARN-3819: --- Moving the implementation into common, it may help to reduce

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605995#comment-14605995 ] MENG DING commented on YARN-1197: - One option to consider is to let NM confirm back with RM

[jira] [Commented] (YARN-3819) Collect network usage on the node

2015-06-29 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605925#comment-14605925 ] Inigo Goiri commented on YARN-3819: --- [~aw], at some point, I talked to [~jakobhoman]

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605932#comment-14605932 ] MENG DING commented on YARN-1197: - [~grey], NM will persist the resource decrease in level

[jira] [Commented] (YARN-1965) Interrupted exception when closing YarnClient

2015-06-29 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605955#comment-14605955 ] Mit Desai commented on YARN-1965: - latest patch looks good. +1 (non-binding) Interrupted

[jira] [Commented] (YARN-2745) Extend YARN to support multi-resource packing of tasks

2015-06-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605974#comment-14605974 ] Allen Wittenauer commented on YARN-2745: Personally, I'd prefer that what is built

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-29 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605997#comment-14605997 ] Lei Guo commented on YARN-1197: --- Agreed, this is similar to the other cases you mentioned, In

[jira] [Commented] (YARN-1965) Interrupted exception when closing YarnClient

2015-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605944#comment-14605944 ] Hadoop QA commented on YARN-1965: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3332) [Umbrella] Unified Resource Statistics Collection per node

2015-06-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605966#comment-14605966 ] Allen Wittenauer commented on YARN-3332: Why is this a YARN JIRA and not in HADOOP?

[jira] [Commented] (YARN-3819) Collect network usage on the node

2015-06-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606014#comment-14606014 ] Chris Douglas commented on YARN-3819: - bq. I think that if we decide to move this to

[jira] [Commented] (YARN-3793) Several NPEs when deleting local files on NM recovery

2015-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606648#comment-14606648 ] Hadoop QA commented on YARN-3793: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Attachment: YARN-1449.1.patch Attach patch for AM-NM protocol changes AM-NM protocol changes to support

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Attachment: YARN-1644.2.patch RM-NM protocol changes and NodeStatusUpdater implementation to support

[jira] [Commented] (YARN-2004) Priority scheduling support in Capacity scheduler

2015-06-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606734#comment-14606734 ] Wangda Tan commented on YARN-2004: -- Thanks [~sunilg]'s update, some comments from my side:

[jira] [Updated] (YARN-3865) Backward compatibility of reader with ATSv1

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3865: --- Issue Type: Sub-task (was: Bug) Parent: YARN-2928 Backward compatibility of reader with

[jira] [Commented] (YARN-3848) TestNodeLabelContainerAllocation is timing out

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606144#comment-14606144 ] Varun Saxena commented on YARN-3848: [~jlowe]/[~leftnoteasy], kindly review

[jira] [Updated] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3508: --- Attachment: YARN-3508.03.patch Preemption processing occuring on the main RM dispatcher

[jira] [Commented] (YARN-3820) Collect disks usages on the node

2015-06-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606047#comment-14606047 ] Chris Douglas commented on YARN-3820: - I understand its function, I'm curious why it

[jira] [Updated] (YARN-3849) Too much of preemption activity causing continuos killing of containers across queues

2015-06-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3849: -- Attachment: 0001-YARN-3849.patch Hi [~leftnoteasy], [~rohithsharma] Uploading an initial patch. I have changed

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606062#comment-14606062 ] Wangda Tan commented on YARN-1197: -- I think we can handle container decreasing similar to

[jira] [Updated] (YARN-1370) Fair scheduler to re-populate container allocation state

2015-06-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1370: --- Component/s: (was: resourcemanager) fairscheduler Fair scheduler to

[jira] [Updated] (YARN-1923) Make FairScheduler resource ratio calculations terminate faster

2015-06-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1923: --- Component/s: (was: scheduler) fairscheduler Make FairScheduler resource

[jira] [Commented] (YARN-3770) SerializedException should also handle java.lang.Error

2015-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606498#comment-14606498 ] Hudson commented on YARN-3770: -- FAILURE: Integrated in Hadoop-trunk-Commit #8089 (See

[jira] [Commented] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-06-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606576#comment-14606576 ] Wangda Tan commented on YARN-3508: -- [~varun_saxena], It seems to me this patch doesn't

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606577#comment-14606577 ] Varun Saxena commented on YARN-3051: [~zjshen], thanks for looking at the patch. bq.

[jira] [Commented] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606379#comment-14606379 ] Hadoop QA commented on YARN-3508: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606469#comment-14606469 ] Varun Saxena commented on YARN-3051: To be precise, YARN-3863 is meant for that. To

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606542#comment-14606542 ] Zhijie Shen commented on YARN-3051: --- Varun, thanks for take over the reader interface

[jira] [Updated] (YARN-3823) Fix mismatch in default values for yarn.scheduler.maximum-allocation-vcores property

2015-06-29 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3823: - Attachment: YARN-3823.001.patch Initial version. Assume

[jira] [Comment Edited] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-06-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606611#comment-14606611 ] Zhijie Shen edited comment on YARN-3047 at 6/29/15 11:01 PM: -

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-06-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606405#comment-14606405 ] Sangjin Lee commented on YARN-3047: --- Thanks for the update [~varun_saxena]! Here is a

[jira] [Updated] (YARN-1550) NPE in FairSchedulerAppsBlock#render

2015-06-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1550: --- Component/s: (was: scheduler) fairscheduler NPE in

[jira] [Updated] (YARN-1774) FS: Submitting to non-leaf queue throws NPE

2015-06-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1774: --- Component/s: (was: resourcemanager) fairscheduler FS: Submitting to

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606510#comment-14606510 ] Li Lu commented on YARN-3051: - OK, linked all related JIRAs to this one. Feel free to add more.

[jira] [Commented] (YARN-3848) TestNodeLabelContainerAllocation is timing out

2015-06-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606543#comment-14606543 ] Wangda Tan commented on YARN-3848: -- Hi [~varun_saxena], Thanks for working on this patch.

[jira] [Updated] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3508: --- Attachment: YARN-3508.04.patch Preemption processing occuring on the main RM dispatcher

[jira] [Commented] (YARN-3770) SerializedException should also handle java.lang.Error

2015-06-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606441#comment-14606441 ] Jian He commented on YARN-3770: --- +1 SerializedException should also handle java.lang.Error

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606588#comment-14606588 ] Karthik Kambatla commented on YARN-3860: Also, I wonder if this affects the latency

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606586#comment-14606586 ] Karthik Kambatla commented on YARN-3860: I am not convinced we need this. The only

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-06-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606611#comment-14606611 ] Zhijie Shen commented on YARN-3047: --- 1. We should be able to reuse TimelineAbout. 2. I

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606466#comment-14606466 ] Varun Saxena commented on YARN-3051: [~gtCarrera9], I included the relational operators

[jira] [Commented] (YARN-3500) Optimize ResourceManager Web loading speed

2015-06-29 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606262#comment-14606262 ] Ravi Prakash commented on YARN-3500: I'm not sure *why* it was moved to client side.

[jira] [Commented] (YARN-3856) YARN shoud allocate container that is closest to the data

2015-06-29 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606400#comment-14606400 ] Ravi Prakash commented on YARN-3856: Hi Jaehoon! Thanks for your contribution and

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

2015-06-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606491#comment-14606491 ] Jason Lowe commented on YARN-2005: -- Thanks for posting a patch, Anubhav! I haven't done a

[jira] [Commented] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-06-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606618#comment-14606618 ] Varun Saxena commented on YARN-3508: [~leftnoteasy], the test failures seem unrelated.

[jira] [Commented] (YARN-3820) Collect disks usages on the node

2015-06-29 Thread Srikanth Kandula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606275#comment-14606275 ] Srikanth Kandula commented on YARN-3820: Quick profile: the call to read /proc

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-06-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606392#comment-14606392 ] Zhijie Shen commented on YARN-3116: --- Sounds good to me. Would you mind taking care of the

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

2015-06-29 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606549#comment-14606549 ] Anubhav Dhoot commented on YARN-2005: - The getNumActiveNMs gets number of unique

[jira] [Updated] (YARN-1645) Add increaseContainersResource interface and implementations to ContainerManager

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Summary: Add increaseContainersResource interface and implementations to ContainerManager (was: [YARN-1197]

[jira] [Reopened] (YARN-1645) [YARN-1197] Add changeContainersResource interface and implementations to ContainerManagementProtocol

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING reopened YARN-1645: - Assignee: MENG DING Reopen this issue as a subtask of YARN-1197. This issue tracks the ContainerManager

[jira] [Commented] (YARN-3695) ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception.

2015-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606387#comment-14606387 ] Hudson commented on YARN-3695: -- FAILURE: Integrated in Hadoop-trunk-Commit #8088 (See

[jira] [Updated] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-06-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3116: -- Target Version/s: 2.8.0 [Collector wireup] We need an assured way to determine if a container is an

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606458#comment-14606458 ] Li Lu commented on YARN-3051: - Hi [~varun_saxena], thanks for the patch! I think this version

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606459#comment-14606459 ] MENG DING commented on YARN-1197: - Released containers which are in RUNNING state are put

  1   2   >