[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772233#comment-15772233 ] chenrongwei commented on YARN-6017: --- you are right. but native memory should be limited by MaxDirectSize

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772212#comment-15772212 ] Rajesh Balamohan commented on YARN-6017: "10193716 in [heap]" in smaps indicates that it is from

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772155#comment-15772155 ] chenrongwei commented on YARN-6017: --- thank you for reply, i already post,please check the attach file. >

[jira] [Updated] (YARN-6017) node manager physical memory leak

2016-12-22 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenrongwei updated YARN-6017: -- Attachment: 31169_smaps.txt > node manager physical memory leak > - > >

[jira] [Updated] (YARN-6017) node manager physical memory leak

2016-12-22 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenrongwei updated YARN-6017: -- Attachment: 31169_smaps.txt smaps of process 31169 > node manager physical memory leak >

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772139#comment-15772139 ] chenrongwei commented on YARN-6017: --- we hadn't set "yarn.nodemanager.recovery.enabled" in our config

[jira] [Commented] (YARN-5986) Adding YARN configuration entries to ContainerLaunchContext

2016-12-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772129#comment-15772129 ] Varun Vasudev commented on YARN-5986: - [~miklos.szeg...@cloudera.com] - we need this for other use

[jira] [Commented] (YARN-5962) Spelling errors in logging and exceptions for resource manager code

2016-12-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772114#comment-15772114 ] Varun Vasudev commented on YARN-5962: - +1. I'll commit this on Monday if no one objects. > Spelling

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772116#comment-15772116 ] Rajesh Balamohan commented on YARN-6017: Usage seems to be from native side. Can you also post

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772106#comment-15772106 ] Rohith Sharma K S commented on YARN-6017: - Is this NodeManager running with work preserving restart

[jira] [Commented] (YARN-4423) Cleanup lint warnings in resource mananger

2016-12-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772054#comment-15772054 ] Hadoop QA commented on YARN-4423: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4423) Cleanup lint warnings in resource mananger

2016-12-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772043#comment-15772043 ] Varun Saxena commented on YARN-4423: It seems that the patch doesn't apply cleanly > Cleanup lint

[jira] [Commented] (YARN-4423) Cleanup lint warnings in resource mananger

2016-12-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772039#comment-15772039 ] Hadoop QA commented on YARN-4423: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772031#comment-15772031 ] chenrongwei commented on YARN-6017: --- $ jmap -heap 31169 Attaching to process ID 31169, please wait...

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771984#comment-15771984 ] Rajesh Balamohan commented on YARN-6017: Can you share the details of {noformat} jmap -heap

[jira] [Commented] (YARN-3955) Support for priority ACLs in CapacityScheduler

2016-12-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771968#comment-15771968 ] Hadoop QA commented on YARN-3955: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6024) Capacity Scheduler continuous reservation looking doesn't work when queue's used+reserved = max

2016-12-22 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771771#comment-15771771 ] Ying Zhang commented on YARN-6024: -- [~leftnoteasy], why we don't get rid of the "nowRequired", calculate

[jira] [Updated] (YARN-3955) Support for priority ACLs in CapacityScheduler

2016-12-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3955: -- Attachment: YARN-3955.0004.patch Attaching an interim version of patch to check jenkins. > Support for priority

[jira] [Comment Edited] (YARN-6021) When your allocated minShare of all queue`s added up exceed cluster capacity you can get some queue for 0 fairshare

2016-12-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771743#comment-15771743 ] Karthik Kambatla edited comment on YARN-6021 at 12/23/16 3:22 AM: -- I am

[jira] [Commented] (YARN-6021) When your allocated minShare of all queue`s added up exceed cluster capacity you can get some queue for 0 fairshare

2016-12-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771743#comment-15771743 ] Karthik Kambatla commented on YARN-6021: I still am unable to understand. Are you able to share

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2016-12-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771737#comment-15771737 ] Karthik Kambatla commented on YARN-6022: bq. For example, with this change, we need to make

[jira] [Assigned] (YARN-6021) When your allocated minShare of all queue`s added up exceed cluster capacity you can get some queue for 0 fairshare

2016-12-22 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan reassigned YARN-6021: --- Assignee: Feng Yuan > When your allocated minShare of all queue`s added up exceed cluster capacity >

[jira] [Commented] (YARN-6021) When your allocated minShare of all queue`s added up exceed cluster capacity you can get some queue for 0 fairshare

2016-12-22 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771642#comment-15771642 ] Feng Yuan commented on YARN-6021: - Perhaps I was not clear,if R value is some very wee like 0.00390625,when

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771628#comment-15771628 ] Hadoop QA commented on YARN-5709: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-6020) Resource.add exceed Int class`s length,when compute queue demand

2016-12-22 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan reassigned YARN-6020: --- Assignee: Feng Yuan > Resource.add exceed Int class`s length,when compute queue demand >

[jira] [Commented] (YARN-6025) Few issues in synchronization in CapacityScheduler & AbstractYarnScheduler

2016-12-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771582#comment-15771582 ] Hadoop QA commented on YARN-6025: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6025) Few issues in synchronization in CapacityScheduler & AbstractYarnScheduler

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771517#comment-15771517 ] Wangda Tan commented on YARN-6025: -- Thanks [~naganarasimha...@apache.org], Minor comments: 1) Should not

[jira] [Updated] (YARN-6025) Few issues in synchronization in CapacityScheduler & AbstractYarnScheduler

2016-12-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6025: Attachment: YARN-6025.01.patch Hi [~wangda] , Hope you could have a look at it, as you had

[jira] [Commented] (YARN-6024) Capacity Scheduler continuous reservation looking doesn't work when queue's used+reserved = max

2016-12-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771472#comment-15771472 ] Hadoop QA commented on YARN-6024: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6025) Few issues in synchronization in CapacityScheduler & AbstractYarnScheduler

2016-12-22 Thread Naganarasimha G R (JIRA)
Naganarasimha G R created YARN-6025: --- Summary: Few issues in synchronization in CapacityScheduler & AbstractYarnScheduler Key: YARN-6025 URL: https://issues.apache.org/jira/browse/YARN-6025

[jira] [Commented] (YARN-6021) When your allocated minShare of all queue`s added up exceed cluster capacity you can get some queue for 0 fairshare

2016-12-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771433#comment-15771433 ] Karthik Kambatla commented on YARN-6021: bq. When your allocated minShare of all queue`s added up

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771301#comment-15771301 ] Jian He commented on YARN-5709: --- I fixed the javac warnings, javadoc warnings seems be existing. > Cleanup

[jira] [Updated] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5709: -- Attachment: yarn-5709-branch-2.8.01.patch > Cleanup leader election configs and pluggability >

[jira] [Commented] (YARN-5774) MR Job stuck in ACCEPTED status without any progress in Fair Scheduler if set yarn.scheduler.minimum-allocation-mb to 0.

2016-12-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771281#comment-15771281 ] Junping Du commented on YARN-5774: -- I just verified that this patch is not in branch-2.8. Set fix version

[jira] [Updated] (YARN-5774) MR Job stuck in ACCEPTED status without any progress in Fair Scheduler if set yarn.scheduler.minimum-allocation-mb to 0.

2016-12-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5774: - Fix Version/s: (was: 2.8.0) 2.9.0 > MR Job stuck in ACCEPTED status without any

[jira] [Updated] (YARN-6024) Capacity Scheduler continuous reservation looking doesn't work when queue's used+reserved = max

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6024: - Attachment: YARN-6024-branch-2.7.001.patch Reattached branch-2.7 to trigger Jenkins. > Capacity

[jira] [Commented] (YARN-6024) Capacity Scheduler continuous reservation looking doesn't work when queue's used+reserved = max

2016-12-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771255#comment-15771255 ] Hadoop QA commented on YARN-6024: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5993) Allow native services quicklinks to be exported for each component

2016-12-22 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771253#comment-15771253 ] Gour Saha commented on YARN-5993: - +1 for the 004 patch. > Allow native services quicklinks to be exported

[jira] [Commented] (YARN-6024) Capacity Scheduler continuous reservation looking doesn't work when queue's used+reserved = max

2016-12-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771241#comment-15771241 ] Hadoop QA commented on YARN-6024: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5993) Allow native services quicklinks to be exported for each component

2016-12-22 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771207#comment-15771207 ] Gour Saha commented on YARN-5993: - Then I like your strategy even more now. bq. It looks like the services

[jira] [Commented] (YARN-5864) YARN Capacity Scheduler - Queue Priorities

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771197#comment-15771197 ] Wangda Tan commented on YARN-5864: -- [~Naganarasimha], What I planned to do is adding an interface for

[jira] [Commented] (YARN-5756) Add state-machine implementation for queues

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771177#comment-15771177 ] Wangda Tan commented on YARN-5756: -- +1, will commit tomorrow if no opposite opinions. Thanks [~xgong] >

[jira] [Commented] (YARN-5993) Allow native services quicklinks to be exported for each component

2016-12-22 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771165#comment-15771165 ] Gour Saha commented on YARN-5993: - [~billie.rinaldi] I think we should file a sub-task under both, since

[jira] [Commented] (YARN-6024) Capacity Scheduler continuous reservation looking doesn't work when queue's used+reserved = max

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771146#comment-15771146 ] Wangda Tan commented on YARN-6024: -- [~sunilg] could you help review the change? > Capacity Scheduler

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2016-12-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771143#comment-15771143 ] Li Lu commented on YARN-5585: - I don't have a strong opinion on fromIdPrefix and fromId. Both ways make sense

[jira] [Updated] (YARN-6024) Capacity Scheduler continuous reservation looking doesn't work when queue's used+reserved = max

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6024: - Attachment: YARN-6024-branch-2.7.001.patch Attached fix for branch-2.7. > Capacity Scheduler continuous

[jira] [Commented] (YARN-6024) Capacity Scheduler continuous reservation looking doesn't work when queue's used+reserved = max

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771071#comment-15771071 ] Wangda Tan commented on YARN-6024: -- The issue exists in branch-2.7, and not existed in

[jira] [Created] (YARN-6024) Capacity Scheduler continuous reservation looking doesn't work when queue's used+reserved = max

2016-12-22 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-6024: Summary: Capacity Scheduler continuous reservation looking doesn't work when queue's used+reserved = max Key: YARN-6024 URL: https://issues.apache.org/jira/browse/YARN-6024

[jira] [Commented] (YARN-5993) Allow native services quicklinks to be exported for each component

2016-12-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771002#comment-15771002 ] Hadoop QA commented on YARN-5993: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5962) Spelling errors in logging and exceptions for resource manager code

2016-12-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770969#comment-15770969 ] Hadoop QA commented on YARN-5962: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5993) Allow native services quicklinks to be exported for each component

2016-12-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-5993: - Attachment: YARN-5993-yarn-native-services.004.patch Attempted to fix a checkstyle issue and

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770909#comment-15770909 ] Wangda Tan commented on YARN-6022: -- I would prefer to think about interface of SchedulerResourceRequest

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2016-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770883#comment-15770883 ] Arun Suresh commented on YARN-6022: --- So, looks like the original class was created to unify Update

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770852#comment-15770852 ] Wangda Tan commented on YARN-6022: -- bq. Have a SchedulerResourceRequest wrapper class that takes either a

[jira] [Commented] (YARN-5969) FairShareComparator getResourceUsage poor performance

2016-12-22 Thread Hadoop QA (JIRA)
? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. {color} | \\ \\ || Subsystem || Report/Notes || | JIRA Issue | YARN-5969 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12844359/20161222.patch | | Console output | https://builds.apache.org/job

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2016-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770843#comment-15770843 ] Arun Suresh commented on YARN-6022: --- Hmmm... not sure why the inheritance is a problem.. But I agree,

[jira] [Commented] (YARN-5969) FairShareComparator getResourceUsage poor performance

2016-12-22 Thread Yufei Gu (JIRA)
omponents: fairscheduler >Affects Versions: 2.7.1 >Reporter: zhangshilong >Assignee: zhangshilong > Attachments: 20161206.patch, 20161222.patch, apprunning_after.png, > apprunning_before.png, containerAllocatedDelta_before.png, > conta

[jira] [Commented] (YARN-5993) Allow native services quicklinks to be exported for each component

2016-12-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770818#comment-15770818 ] Billie Rinaldi commented on YARN-5993: -- I created YARN-6023. Wasn't sure if this should be a subtask

[jira] [Created] (YARN-6023) Allow multiple IPs in native services container ServiceRecord

2016-12-22 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-6023: Summary: Allow multiple IPs in native services container ServiceRecord Key: YARN-6023 URL: https://issues.apache.org/jira/browse/YARN-6023 Project: Hadoop YARN

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770806#comment-15770806 ] Wangda Tan commented on YARN-6022: -- Probably mark it to private is not enough, because we should not make

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2016-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770801#comment-15770801 ] Arun Suresh commented on YARN-6022: --- Agree with [~leftnoteasy], we should also probably mark it as

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2016-12-22 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770799#comment-15770799 ] Sangjin Lee commented on YARN-5585: --- Thanks for the additional clarifications. (1) use of column value

[jira] [Commented] (YARN-6020) Resource.add exceed Int class`s length,when compute queue demand

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770788#comment-15770788 ] Wangda Tan commented on YARN-6020: -- [~Feng Yuan], I just added you to contributor list so in the future

[jira] [Commented] (YARN-6021) When your allocated minShare of all queue`s added up exceed cluster capacity you can get some queue for 0 fairshare

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770789#comment-15770789 ] Wangda Tan commented on YARN-6021: -- + [~kasha]. > When your allocated minShare of all queue`s added up

[jira] [Commented] (YARN-5993) Allow native services quicklinks to be exported for each component

2016-12-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770785#comment-15770785 ] Billie Rinaldi commented on YARN-5993: -- Yes, that's correct. These can be deduped on the exported

[jira] [Created] (YARN-6022) Revert changes of AbstractResourceRequest

2016-12-22 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-6022: Summary: Revert changes of AbstractResourceRequest Key: YARN-6022 URL: https://issues.apache.org/jira/browse/YARN-6022 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-5774) MR Job stuck in ACCEPTED status without any progress in Fair Scheduler if set yarn.scheduler.minimum-allocation-mb to 0.

2016-12-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-5774. -- Resolution: Fixed [~yufeigu], thanks for pointing the policy, no matter if it violated policy or not,

[jira] [Commented] (YARN-5774) MR Job stuck in ACCEPTED status without any progress in Fair Scheduler if set yarn.scheduler.minimum-allocation-mb to 0.

2016-12-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770723#comment-15770723 ] Yufei Gu commented on YARN-5774: Hi [~wangda], I understand it looks like different in doc. But

[jira] [Created] (YARN-6021) When your allocated minShare of all queue`s added up exceed cluster capacity you can get some queue for 0 fairshare

2016-12-22 Thread Feng Yuan (JIRA)
Feng Yuan created YARN-6021: --- Summary: When your allocated minShare of all queue`s added up exceed cluster capacity you can get some queue for 0 fairshare Key: YARN-6021 URL:

[jira] [Commented] (YARN-6021) When your allocated minShare of all queue`s added up exceed cluster capacity you can get some queue for 0 fairshare

2016-12-22 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770587#comment-15770587 ] Feng Yuan commented on YARN-6021: - [~leftnoteasy],WangDa how do you think? > When your allocated minShare

[jira] [Commented] (YARN-5993) Allow native services quicklinks to be exported for each component

2016-12-22 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770579#comment-15770579 ] Gour Saha commented on YARN-5993: - One more point - bq. What is happening here is that exports can be

[jira] [Commented] (YARN-5993) Allow native services quicklinks to be exported for each component

2016-12-22 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770556#comment-15770556 ] Gour Saha commented on YARN-5993: - [~billie.rinaldi] the 003 patch looks good. There are 5 new checkstyle

[jira] [Comment Edited] (YARN-6020) Resource.add exceed Int class`s length,when compute queue demand

2016-12-22 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770547#comment-15770547 ] Feng Yuan edited comment on YARN-6020 at 12/22/16 5:06 PM: --- [~leftnoteasy],Please

[jira] [Updated] (YARN-6020) Resource.add exceed Int class`s length,when compute queue demand

2016-12-22 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-6020: Description: Resource object use int to store memory field.When int exceed Integer,MAX_VALUE,you will get a

[jira] [Commented] (YARN-6020) Resource.add exceed Int class`s length,when compute queue demand

2016-12-22 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770547#comment-15770547 ] Feng Yuan commented on YARN-6020: - [~leftnoteasy],Please assign to me,i would like work on it. >

[jira] [Created] (YARN-6020) Resource.add exceed Int class`s length,when compute queue demand

2016-12-22 Thread Feng Yuan (JIRA)
Feng Yuan created YARN-6020: --- Summary: Resource.add exceed Int class`s length,when compute queue demand Key: YARN-6020 URL: https://issues.apache.org/jira/browse/YARN-6020 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2016-12-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770520#comment-15770520 ] Varun Saxena edited comment on YARN-5585 at 12/22/16 4:58 PM: -- bq. More

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2016-12-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770520#comment-15770520 ] Varun Saxena commented on YARN-5585: bq. More importantly, we have missed one point over here. That's

[jira] [Updated] (YARN-6019) MR application fails with "No NMToken sent" exception after MRAppMaster recovery

2016-12-22 Thread Aleksandr Balitsky (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr Balitsky updated YARN-6019: - Component/s: resourcemanager > MR application fails with "No NMToken sent" exception after

[jira] [Commented] (YARN-6019) MR application fails with "No NMToken sent" exception after MRAppMaster recovery

2016-12-22 Thread Aleksandr Balitsky (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770392#comment-15770392 ] Aleksandr Balitsky commented on YARN-6019: -- I tried to save NMTokens and containers form previous

[jira] [Updated] (YARN-6019) MR application fails with "No NMToken sent" exception after MRAppMaster recovery

2016-12-22 Thread Aleksandr Balitsky (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr Balitsky updated YARN-6019: - Attachment: YARN-6019.001.patch > MR application fails with "No NMToken sent" exception

[jira] [Created] (YARN-6019) MR application fails with "No NMToken sent" exception after MRAppMaster recovery

2016-12-22 Thread Aleksandr Balitsky (JIRA)
Aleksandr Balitsky created YARN-6019: Summary: MR application fails with "No NMToken sent" exception after MRAppMaster recovery Key: YARN-6019 URL: https://issues.apache.org/jira/browse/YARN-6019

[jira] [Commented] (YARN-5903) Fix race condition in TestResourceManagerAdministrationProtocolPBClientImpl beforeclass setup method

2016-12-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770279#comment-15770279 ] Varun Saxena commented on YARN-5903: Committed to trunk,branch-2. Thanks Haibo Chen for your

[jira] [Commented] (YARN-5903) Fix race condition in TestResourceManagerAdministrationProtocolPBClientImpl beforeclass setup method

2016-12-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770253#comment-15770253 ] Hudson commented on YARN-5903: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11030 (See

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2016-12-22 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770183#comment-15770183 ] Rohith Sharma K S commented on YARN-5585: - There couple of things to discuss more # I would be

[jira] [Commented] (YARN-5864) YARN Capacity Scheduler - Queue Priorities

2016-12-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15769807#comment-15769807 ] Naganarasimha G R commented on YARN-5864: - Thanks [~wangda], Seems to be a useful proposal to

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2016-12-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15769543#comment-15769543 ] Varun Saxena commented on YARN-5585: bq. I don't think we should set the info from the fromId to entity

[jira] [Assigned] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2016-12-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-5831: -- Assignee: Yufei Gu > Propagate allowPreemptionFrom flag all the way down to the app >

[jira] [Assigned] (YARN-5893) Experiment with using PriorityQueue for storing starved applications

2016-12-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-5893: -- Assignee: Yufei Gu > Experiment with using PriorityQueue for storing starved applications >