[jira] [Commented] (YARN-4697) NM aggregation thread pool is not bound by limits

2016-02-18 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153675#comment-15153675 ] Wilfred Spiegelenburg commented on YARN-4697: - [~haibochen] should we do some r

[jira] [Commented] (YARN-4703) blacklist option for distributedshell

2016-02-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153665#comment-15153665 ] Hadoop QA commented on YARN-4703: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4703) blacklist option for distributedshell

2016-02-18 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-4703: --- Attachment: (was: YARN-4703.001.patch) > blacklist option for distributedshell > -

[jira] [Updated] (YARN-4703) blacklist option for distributedshell

2016-02-18 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-4703: --- Attachment: YARN-4703.001.patch > blacklist option for distributedshell >

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-02-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153606#comment-15153606 ] Hadoop QA commented on YARN-4676: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

2016-02-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153550#comment-15153550 ] Hadoop QA commented on YARN-4412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4678) Cluster used capacity is > 100 when container reserved

2016-02-18 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153547#comment-15153547 ] Brahma Reddy Battula commented on YARN-4678: [~sunilg] thanks for the patch..Ap

[jira] [Updated] (YARN-4678) Cluster used capacity is > 100 when container reserved

2016-02-18 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-4678: --- Assignee: Sunil G (was: Brahma Reddy Battula) > Cluster used capacity is > 100 when co

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

2016-02-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153542#comment-15153542 ] Li Lu commented on YARN-4545: - Thanks [~ste...@apache.org]! bq. the new hadoop-yarn-server-ti

[jira] [Commented] (YARN-4701) When task logs are not available, port 8041 is referenced instead of port 8042

2016-02-18 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153519#comment-15153519 ] Robert Kanter commented on YARN-4701: - A few comments: - When {{getApplicationLogURL()}

[jira] [Updated] (YARN-4701) When task logs are not available, port 8041 is referenced instead of port 8042

2016-02-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4701: - Description: Accessing logs for an task attempt in the workflow tool in Hue shows "Logs not available for

[jira] [Commented] (YARN-4692) [Umbrella] Simplified and first-class support for services in YARN

2016-02-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153434#comment-15153434 ] Wangda Tan commented on YARN-4692: -- [~asuresh], Thanks for reply, I can understand your c

[jira] [Commented] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

2016-02-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153238#comment-15153238 ] Hadoop QA commented on YARN-4412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

2016-02-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4412: -- Attachment: YARN-4412-yarn-2877.v6.patch > Create ClusterMonitor to compute ordered list of preferred NMs

[jira] [Created] (YARN-4704) TestResourceManager#testResourceAllocation() fails when using FairScheduler

2016-02-18 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-4704: Summary: TestResourceManager#testResourceAllocation() fails when using FairScheduler Key: YARN-4704 URL: https://issues.apache.org/jira/browse/YARN-4704 Project: Hadoop YARN

[jira] [Commented] (YARN-3344) procfs stat file is not in the expected format warning

2016-02-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153108#comment-15153108 ] Hadoop QA commented on YARN-3344: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-02-18 Thread Daniel Zhi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Zhi updated YARN-4676: - Attachment: HADOOP-4676.006.patch > Automatic and Asynchronous Decommissioning Nodes Status Tracking >

[jira] [Assigned] (YARN-3344) procfs stat file is not in the expected format warning

2016-02-18 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA reassigned YARN-3344: --- Assignee: Akira AJISAKA (was: Ravindra Kumar Naik) > procfs stat file is not in the expected

[jira] [Updated] (YARN-3344) procfs stat file is not in the expected format warning

2016-02-18 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-3344: Attachment: YARN-3344.06.patch > procfs stat file is not in the expected format warning > ---

[jira] [Updated] (YARN-4701) When task logs are not available, port 8041 is referenced instead of port 8042

2016-02-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4701: - Attachment: yarn4701.001.patch > When task logs are not available, port 8041 is referenced instead of port

[jira] [Commented] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

2016-02-18 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152964#comment-15152964 ] Carlo Curino commented on YARN-4412: [~asuresh], thanks for addressing my concerns and

[jira] [Commented] (YARN-4697) NM aggregation thread pool is not bound by limits

2016-02-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152960#comment-15152960 ] Hadoop QA commented on YARN-4697: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

2016-02-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4412: -- Attachment: YARN-4412-yarn-2877.v5.patch Updating patch to add some more documentation.. > Create Cluste

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-02-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152923#comment-15152923 ] Li Lu commented on YARN-4696: - Thanks [~ste...@apache.org]! The latest patch LGTM. Could some c

[jira] [Commented] (YARN-4634) Scheduler UI/Metrics need to consider cases like non-queue label mappings

2016-02-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152827#comment-15152827 ] Wangda Tan commented on YARN-4634: -- [~sunilg], My understanding of your proposal is, we w

[jira] [Commented] (YARN-4634) Scheduler UI/Metrics need to consider cases like non-queue label mappings

2016-02-18 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152800#comment-15152800 ] Sunil G commented on YARN-4634: --- Hi [~leftnoteasy] Yes, I understood the scenario which you h

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-02-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152776#comment-15152776 ] Hadoop QA commented on YARN-4675: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-3215) Respect labels in CapacityScheduler when computing headroom

2016-02-18 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152734#comment-15152734 ] Naganarasimha G R commented on YARN-3215: - Hi [~steve_l] / [~wangda], Any updates o

[jira] [Commented] (YARN-4692) [Umbrella] Simplified and first-class support for services in YARN

2016-02-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152735#comment-15152735 ] Arun Suresh commented on YARN-4692: --- [~leftnoteasy], Am not entirely convinced that Prior

[jira] [Commented] (YARN-3945) maxApplicationsPerUser is wrongly calculated

2016-02-18 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152729#comment-15152729 ] Naganarasimha G R commented on YARN-3945: - Thanks for the clarification [~wangda],

[jira] [Updated] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-02-18 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4675: Attachment: YARN-4675-YARN-2928.v1.001.patch I have refactored the TimelineClientImpl & Time

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-02-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152656#comment-15152656 ] Steve Loughran commented on YARN-4696: -- Patch -003. Adds more robustness/diagnostics t

[jira] [Commented] (YARN-4333) Fair scheduler should support preemption within queue

2016-02-18 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152594#comment-15152594 ] Tao Jie commented on YARN-4333: --- [~kasha], Thank you for reply! I just took a look at YARN-34

[jira] [Commented] (YARN-3934) Application with large ApplicationSubmissionContext can cause RM to exit when ZK store is used

2016-02-18 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152283#comment-15152283 ] Dustin Cote commented on YARN-3934: --- [~mingma] can you have a look at the proposed patch

[jira] [Updated] (YARN-4703) blacklist option for distributedshell

2016-02-18 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-4703: --- Attachment: YARN-4703.001.patch I attached a patch including test code. > blacklist option for distrib

[jira] [Created] (YARN-4703) blacklist option for distributedshell

2016-02-18 Thread kyungwan nam (JIRA)
kyungwan nam created YARN-4703: -- Summary: blacklist option for distributedshell Key: YARN-4703 URL: https://issues.apache.org/jira/browse/YARN-4703 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-02-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152271#comment-15152271 ] Hadoop QA commented on YARN-4696: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-02-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-4696: - Attachment: YARN-4696-003.patch Patch -003 Addresses # discussion # checkstyle # javadocs Adds a

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-02-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152148#comment-15152148 ] Steve Loughran commented on YARN-4696: -- # forgot about the -default.xml; will fix # an

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2016-02-18 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152105#comment-15152105 ] Naganarasimha G R commented on YARN-4183: - Hi [~sjlee0] & [~jeagles], Any further r

[jira] [Commented] (YARN-4654) Yarn node label CLI should parse "=" correctly when trying to remove all labels on a node

2016-02-18 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152101#comment-15152101 ] Naganarasimha G R commented on YARN-4654: - Thanks for the review and commit [~rohit

[jira] [Commented] (YARN-4654) Yarn node label CLI should parse "=" correctly when trying to remove all labels on a node

2016-02-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151971#comment-15151971 ] Hudson commented on YARN-4654: -- FAILURE: Integrated in Hadoop-trunk-Commit #9320 (See [https: