[jira] [Commented] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203144#comment-16203144 ] Sunil G commented on YARN-7270: --- I am good with latest patch. Will wait for jenkins. >

[jira] [Commented] (YARN-7314) Multiple Resource manager test cases failing

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203138#comment-16203138 ] Sunil G commented on YARN-7314: --- Looks like YARN-7270 is tracking the same. [~yufeigu] > Multiple Resource

[jira] [Comment Edited] (YARN-7314) Multiple Resource manager test cases failing

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203127#comment-16203127 ] Sunil G edited comment on YARN-7314 at 10/13/17 6:53 AM: - Adding more analysis from

[jira] [Commented] (YARN-7314) Multiple Resource manager test cases failing

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203127#comment-16203127 ] Sunil G commented on YARN-7314: --- Adding more analysis from end here. I could these test cases fails in trunk

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.006.patch Updating v6 patch after fixing javadoc and findbugs. Some test case

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.005.patch YARN-5881 branch is rebased. Re attaching the patch run jenkins again

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.004.patch Attaching v4 patch after fixing [~leftnoteasy] comments. Thank you. I

[jira] [Commented] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201278#comment-16201278 ] Sunil G commented on YARN-7169: --- [~vrushalic] for UI, we need maven 3.3 as a minimum version. We use

[jira] [Updated] (YARN-6620) Add support in NodeManager to isolate GPU devices by using CGroups

2017-10-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6620: -- Summary: Add support in NodeManager to isolate GPU devices by using CGroups (was: [YARN-6223] NM Java side code

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-10-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200702#comment-16200702 ] Sunil G commented on YARN-6620: --- Committing this patch.. > [YARN-6223] NM Java side code changes to support

[jira] [Commented] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200595#comment-16200595 ] Sunil G commented on YARN-7254: --- cc and javac are due to UI build. Unrelated to the patch. I ll check test

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.003.patch Almost fixed the mentioned comments. Updating a patch. bq.REST API

[jira] [Commented] (YARN-7309) TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by

2017-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199045#comment-16199045 ] Sunil G commented on YARN-7309: --- Thanks [~rkanter]. Committing later today if no other objections. >

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198968#comment-16198968 ] Sunil G commented on YARN-6620: --- Cool. Makes sense. I will wait for hear from others if they have some more

[jira] [Comment Edited] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198968#comment-16198968 ] Sunil G edited comment on YARN-6620 at 10/10/17 5:01 PM: - Cool. Makes sense. I

[jira] [Updated] (YARN-7307) Revisit resource-types.xml loading behaviors

2017-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7307: -- Attachment: YARN-7307.001.patch Uploading an initial version of patch to add more control for clients to load

[jira] [Commented] (YARN-7312) [Resource Profiles] getMaximumAllocationPerQueue to account for all resources

2017-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198828#comment-16198828 ] Sunil G commented on YARN-7312: --- Yes. As these test cases are not because of this patch, we can go ahead. I

[jira] [Commented] (YARN-7312) [Resource Profiles] getMaximumAllocationPerQueue to account for all resources

2017-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198794#comment-16198794 ] Sunil G commented on YARN-7312: --- Thanks. I guess there were some other known issues raised already. I ll help

[jira] [Commented] (YARN-7309) TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by

2017-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198700#comment-16198700 ] Sunil G commented on YARN-7309: --- Changes look good to me. However there are many test failures, I think these

[jira] [Commented] (YARN-7312) [Resource Profiles] getMaximumAllocationPerQueue to account for all resources

2017-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198661#comment-16198661 ] Sunil G commented on YARN-7312: --- Yes. test case are unrelated to your patch. You could check whether these

[jira] [Commented] (YARN-7180) Remove class ResourceType

2017-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198387#comment-16198387 ] Sunil G commented on YARN-7180: --- Thanks [~templedf] To me, I think the whole feature done in YARN-2162 is

[jira] [Assigned] (YARN-7296) [Resource Profiles] convertToProtoFormat(Resource r) is not setting all resources

2017-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7296: - Assignee: lovekesh bansal > [Resource Profiles] convertToProtoFormat(Resource r) is not setting all >

[jira] [Updated] (YARN-7296) convertToProtoFormat(Resource r) is not setting for all resource types

2017-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7296: -- Summary: convertToProtoFormat(Resource r) is not setting for all resource types (was: [Resource Profiles]

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198224#comment-16198224 ] Sunil G commented on YARN-6620: --- Thanks [~leftnoteasy] for the patch. Generally I am fine with latest patch.

[jira] [Updated] (YARN-7205) Log improvements for the ResourceUtils

2017-10-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7205: -- Attachment: YARN-7205.004.patch Updating v4 patch. Thanks [~templedf], please help to check the latest patch >

[jira] [Commented] (YARN-7296) [Resource Profiles] convertToProtoFormat(Resource r) is not setting all resources

2017-10-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198202#comment-16198202 ] Sunil G commented on YARN-7296: --- +1 for v2 patch. Committing shortly. > [Resource Profiles]

[jira] [Updated] (YARN-7312) [Resource Profiles] getMaximumAllocationPerQueue to account for all resources

2017-10-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7312: -- Issue Type: Sub-task (was: Task) Parent: YARN-7069 > [Resource Profiles] getMaximumAllocationPerQueue

[jira] [Updated] (YARN-7205) Log improvements for the ResourceUtils

2017-10-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7205: -- Attachment: YARN-7205.003.patch Updated patch as per last discussion. We ll not use resource profile boolean to

[jira] [Updated] (YARN-7245) Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user

2017-10-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7245: -- Summary: Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated

[jira] [Commented] (YARN-7269) Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications

2017-10-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16196702#comment-16196702 ] Sunil G commented on YARN-7269: --- [~leftnoteasy] [~jianhe], this patch is not handling non-ha case where

[jira] [Updated] (YARN-7180) Remove class ResourceType

2017-10-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7180: -- Attachment: YARN-7180.002.patch Thank you very much. I guess a dependency was added recently and jenkins for

[jira] [Commented] (YARN-7170) Investigate bower dependencies for YARN UI v2

2017-10-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16196553#comment-16196553 ] Sunil G commented on YARN-7170: --- Yes. Currently i was able to build it, however it still pulls a close 1Gb of

[jira] [Commented] (YARN-7296) [Resource Profiles] convertToProtoFormat(Resource r) is not setting all resources

2017-10-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16196552#comment-16196552 ] Sunil G commented on YARN-7296: --- [~lovekesh.bansal] please attach this patch against trunk. Old branch is

[jira] [Commented] (YARN-7180) Remove class ResourceType

2017-10-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16196510#comment-16196510 ] Sunil G commented on YARN-7180: --- Thanks [~rohithsharma] > Remove class ResourceType >

[jira] [Commented] (YARN-7245) In Cap Sched UI, Max AM Resource column in Active Users Info section should be per-user

2017-10-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16194559#comment-16194559 ] Sunil G commented on YARN-7245: --- Looks fine. Thank you. I will commit the patch later today if no objections.

[jira] [Commented] (YARN-7237) Cleanup usages of ResourceProfiles

2017-10-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193077#comment-16193077 ] Sunil G commented on YARN-7237: --- Cool. Will hold on. > Cleanup usages of ResourceProfiles >

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-10-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193076#comment-16193076 ] Sunil G commented on YARN-6620: --- Thanks [~leftnoteasy] Few more comments: # As {{GPU_URI}} is now

[jira] [Commented] (YARN-7237) Cleanup usages of ResourceProfiles

2017-10-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192986#comment-16192986 ] Sunil G commented on YARN-7237: --- Thanks [~leftnoteasy]. Committing shortly. > Cleanup usages of

[jira] [Commented] (YARN-7245) In Cap Sched UI, Max AM Resource column in Active Users Info section should be per-user

2017-10-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192982#comment-16192982 ] Sunil G commented on YARN-7245: --- Thanks [~eepayne]. This should do it. I ll test this in my cluster and

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.002.patch Attaching v2 patch which covers old RM UI as well. cc/[~leftnoteasy] > UI and

[jira] [Commented] (YARN-7237) Cleanup usages of ResourceProfiles

2017-10-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192614#comment-16192614 ] Sunil G commented on YARN-7237: --- Changes are fine to me. I will commit the patch later today if no

[jira] [Commented] (YARN-6871) Add additional deSelects params in RMWebServices#getAppReport

2017-10-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192510#comment-16192510 ] Sunil G commented on YARN-6871: --- [~tanujnay] please help to rebase branch-2 patch. > Add additional

[jira] [Updated] (YARN-6182) Fix alignment issues and missing information in new YARN UI's Queue page

2017-10-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6182: -- Summary: Fix alignment issues and missing information in new YARN UI's Queue page (was: [YARN-3368] Fix

[jira] [Commented] (YARN-6373) [YARN-3368] Improvements in cluster-overview page in YARN-UI

2017-10-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192498#comment-16192498 ] Sunil G commented on YARN-6373: --- [~GergelyNovak] I tested latest code in trunk. I see that there is a bug in

[jira] [Updated] (YARN-7279) Fix typo in helper message of ContainerLauncher

2017-10-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7279: -- Summary: Fix typo in helper message of ContainerLauncher (was: Small typo in the helper message of

[jira] [Resolved] (YARN-7287) Fix typo in ContainerLaunch

2017-10-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7287. --- Resolution: Duplicate Marking as duplicate to YARN-7279 > Fix typo in ContainerLaunch >

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-10-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191435#comment-16191435 ] Sunil G commented on YARN-6620: --- Thanks [~leftnoteasy] for the effort. Generally approach and patch seems

[jira] [Commented] (YARN-7283) Nodemanager can't start

2017-10-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190860#comment-16190860 ] Sunil G commented on YARN-7283: --- You could use YARN mailing lists (dev) to ask technical doubts related to

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.001.patch v1 patch > UI and metrics changes related to absolute resource configuration >

[jira] [Commented] (YARN-6856) Support CLI for Node Attributes Mapping

2017-10-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189662#comment-16189662 ] Sunil G commented on YARN-6856: --- I think patch needs a change in name as we use yarn-3409 and a rebase. >

[jira] [Commented] (YARN-7205) Log improvements for the ResourceUtils

2017-10-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187993#comment-16187993 ] Sunil G commented on YARN-7205: --- {{17/09/15 10:26:32 INFO conf.Configuration: resource-types.xml not found}}

[jira] [Commented] (YARN-7205) Log improvements for the ResourceUtils

2017-10-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187765#comment-16187765 ] Sunil G commented on YARN-7205: --- bq.Resource types and resource profiles are distinct features--each makes

[jira] [Commented] (YARN-6855) CLI Proto Modifications to support Node Attributes

2017-10-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187736#comment-16187736 ] Sunil G commented on YARN-6855: --- [~naganarasimha...@apache.org] could u please help to check the shaded

[jira] [Commented] (YARN-7279) Small typo in the helper message of ContainerLauncher.java

2017-10-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187669#comment-16187669 ] Sunil G commented on YARN-7279: --- Makes sense. Will commit shortly. Thanks [~elek] > Small typo in the helper

[jira] [Updated] (YARN-6855) CLI Proto Modifications to support Node Attributes

2017-10-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6855: -- Attachment: YARN-6855-yarn-3409.006.patch Attaching v6 patch again to kick jenkins > CLI Proto Modifications to

[jira] [Commented] (YARN-7205) Log improvements for the ResourceUtils

2017-10-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187306#comment-16187306 ] Sunil G commented on YARN-7205: --- # Improved logs to debug so that it wont show in console any more. #

[jira] [Updated] (YARN-7205) Log improvements for the ResourceUtils

2017-10-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7205: -- Attachment: YARN-7205.002.patch > Log improvements for the ResourceUtils >

[jira] [Commented] (YARN-7134) AppSchedulingInfo has a dependency on capacity scheduler

2017-09-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186932#comment-16186932 ] Sunil G commented on YARN-7134: --- I ll take over this. Thanks [~andrew.wang] > AppSchedulingInfo has a

[jira] [Assigned] (YARN-7134) AppSchedulingInfo has a dependency on capacity scheduler

2017-09-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7134: - Assignee: Sunil G > AppSchedulingInfo has a dependency on capacity scheduler >

[jira] [Commented] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-09-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186924#comment-16186924 ] Sunil G commented on YARN-7270: --- Thanks [~yufeigu]. Approach makes sense to me. I am not very sure about the

[jira] [Updated] (YARN-7205) Log improvements for the ResourceUtils

2017-09-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7205: -- Attachment: YARN-7205.001.patch Attaching an initial version of patch > Log improvements for the ResourceUtils

[jira] [Assigned] (YARN-7180) Remove class ResourceType

2017-09-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7180: - Assignee: Sunil G > Remove class ResourceType > - > > Key:

[jira] [Updated] (YARN-7180) Remove class ResourceType

2017-09-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7180: -- Affects Version/s: (was: YARN-3926) > Remove class ResourceType > - > >

[jira] [Updated] (YARN-7180) Remove class ResourceType

2017-09-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7180: -- Attachment: YARN-7180.001.patch Attaching a patch > Remove class ResourceType > - > >

[jira] [Commented] (YARN-6871) Add additional deSelects params in RMWebServices#getAppReport

2017-09-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185694#comment-16185694 ] Sunil G commented on YARN-6871: --- Oops. Patch seems a rebase again. [~tanujnay] please help to check. > Add

[jira] [Commented] (YARN-6871) Add additional deSelects params in RMWebServices#getAppReport

2017-09-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185691#comment-16185691 ] Sunil G commented on YARN-6871: --- Other test failures are not related. So getting this to branch-2 as well.

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-09-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184092#comment-16184092 ] Sunil G commented on YARN-7244: --- bq.the aux service doesn't even have to manage the directories itself if all

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-09-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184081#comment-16184081 ] Sunil G commented on YARN-7119: --- To keep the backward compatibility, we might need to support existing

[jira] [Commented] (YARN-6871) Add additional deSelects params in RMWebServices#getAppReport

2017-09-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184075#comment-16184075 ] Sunil G commented on YARN-6871: --- Test case failure seems related. [~tanujnay] please help to check the same.

[jira] [Comment Edited] (YARN-6182) [YARN-3368] Fix alignment issues and missing information in queue pages

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182908#comment-16182908 ] Sunil G edited comment on YARN-6182 at 9/27/17 5:05 PM: +1 Committing tomorrow if

[jira] [Commented] (YARN-6182) [YARN-3368] Fix alignment issues and missing information in queue pages

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182908#comment-16182908 ] Sunil G commented on YARN-6182: --- +1 Comitting tomorrow if no objections. > [YARN-3368] Fix alignment issues

[jira] [Commented] (YARN-6373) [YARN-3368] Improvements in cluster-overview page in YARN-UI

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182906#comment-16182906 ] Sunil G commented on YARN-6373: --- [~GergelyNovak], changes seems fine. Could you please help to rebase and

[jira] [Assigned] (YARN-7205) Log improvements for the ResourceUtils

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7205: - Assignee: Sunil G > Log improvements for the ResourceUtils > -- > >

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182720#comment-16182720 ] Sunil G commented on YARN-7244: --- Thanks [~jlowe] for adding more clarity on this. 'pull' model may be better

[jira] [Commented] (YARN-6871) Add additional deSelects params in RMWebServices#getAppReport

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182225#comment-16182225 ] Sunil G commented on YARN-6871: --- Committed to trunk. Please share branch-2 patch as compilation is failing.

[jira] [Updated] (YARN-6871) Add additional deSelects params in RMWebServices#getAppReport

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6871: -- Summary: Add additional deSelects params in RMWebServices#getAppReport (was: Add additional deSelects params in

[jira] [Commented] (YARN-7237) Cleanup usages of ResourceProfiles

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182203#comment-16182203 ] Sunil G commented on YARN-7237: --- Make sense [~leftnoteasy]. We could keep max as the max resource for that

[jira] [Commented] (YARN-7245) In Cap Sched UI, Max AM Resource column in Active Users Info section should be per-user

2017-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181178#comment-16181178 ] Sunil G commented on YARN-7245: --- This is bad. We ideally need user based max-am-limit. > In Cap Sched UI,

[jira] [Commented] (YARN-7116) CapacityScheduler Web UI: Queue's AM usage is always show on per-user's AM usage.

2017-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181174#comment-16181174 ] Sunil G commented on YARN-7116: --- Yes. Its a good addition in branch-2.8 > CapacityScheduler Web UI: Queue's

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181173#comment-16181173 ] Sunil G commented on YARN-7244: --- Thanks [~kshukla] for this improvement. Some doubts here. # ShuffleHandler

[jira] [Commented] (YARN-6855) CLI Proto Modifications to support Node Attributes

2017-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180400#comment-16180400 ] Sunil G commented on YARN-6855: --- Kicking jenkins before commit > CLI Proto Modifications to support Node

[jira] [Created] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-09-26 Thread Sunil G (JIRA)
Sunil G created YARN-7254: - Summary: UI and metrics changes related to absolute resource configuration Key: YARN-7254 URL: https://issues.apache.org/jira/browse/YARN-7254 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7157) Add admin configuration to filter per-user's apps in secure cluster

2017-09-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178903#comment-16178903 ] Sunil G commented on YARN-7157: --- Pushing jenkins one more time for branch-2 > Add admin configuration to

[jira] [Commented] (YARN-6871) Add additional deSelects params in getAppReport

2017-09-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178838#comment-16178838 ] Sunil G commented on YARN-6871: --- Yes. Latest patch seems fine to me. I could commit tomorrow if there are no

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-09-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178837#comment-16178837 ] Sunil G commented on YARN-6953: --- Latest patch seems fine (v8 patch). I will wait for [~dan...@cloudera.com]

[jira] [Commented] (YARN-6504) Add support for resource profiles in MapReduce

2017-09-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178805#comment-16178805 ] Sunil G commented on YARN-6504: --- Thanks [~dan...@cloudera.com] and [~vvasudev] I think I could get the

[jira] [Comment Edited] (YARN-7105) Refactor of Queue Visualization

2017-09-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178611#comment-16178611 ] Sunil G edited comment on YARN-7105 at 9/25/17 6:59 AM: Thanks [~dingda6] for this

[jira] [Commented] (YARN-7105) Refactor of Queue Visualization

2017-09-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178611#comment-16178611 ] Sunil G commented on YARN-7105: --- Thanks [~dingda6] for this work. Really appreciate the same. I will helping

[jira] [Commented] (YARN-6943) Update Yarn to YARN in documentation

2017-09-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178463#comment-16178463 ] Sunil G commented on YARN-6943: --- Thanks [~chetna] for helping in updating this. One quick comment. In

[jira] [Commented] (YARN-7237) Cleanup usages of ResourceProfiles

2017-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176401#comment-16176401 ] Sunil G commented on YARN-7237: --- Thanks [~leftnoteasy] for the idea. I also think this is better Some high

[jira] [Commented] (YARN-6504) Add support for resource profiles in MapReduce

2017-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176386#comment-16176386 ] Sunil G commented on YARN-6504: --- Adding to this discussion, I would like to hightlight couple of thoughts.

[jira] [Commented] (YARN-6991) "Kill application" button does not show error if other user tries to kill the application for secure cluster

2017-09-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171804#comment-16171804 ] Sunil G commented on YARN-6991: --- patch looks fine to me. > "Kill application" button does not show error if

[jira] [Updated] (YARN-7157) Add admin configuration to filter per-user's apps in secure cluster

2017-09-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7157: -- Attachment: YARN-7157-branch-2.002.patch Attaching branch-2 patch as well. > Add admin configuration to filter

[jira] [Updated] (YARN-7157) Add admin configuration to filter per-user's apps in secure cluster

2017-09-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7157: -- Attachment: YARN-7157-branch-3.0.002.patch Reattaching branch-3 patch > Add admin configuration to filter

[jira] [Reopened] (YARN-7163) RMContext need not to be injected to webapp and other Always Running services.

2017-09-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reopened YARN-7163: --- > RMContext need not to be injected to webapp and other Always Running services. >

[jira] [Commented] (YARN-6871) Add additional deSelects params in getAppReport

2017-09-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167212#comment-16167212 ] Sunil G commented on YARN-6871: --- +1 from my side as well. However looks like patch needs rebase. Kindly

[jira] [Commented] (YARN-7157) Support displaying per-user's apps in RM UI page and in secure cluster

2017-09-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164869#comment-16164869 ] Sunil G commented on YARN-7157: --- Yes. For different calls, check ll be done again. I ll track them in

[jira] [Commented] (YARN-7157) Support displaying per-user's apps in RM UI page and in secure cluster

2017-09-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164584#comment-16164584 ] Sunil G commented on YARN-7157: --- [~bibinchundatt]. I have an additional thought here, {{checkAccess}} is

[jira] [Commented] (YARN-7157) Support displaying per-user's apps in RM UI page and in secure cluster

2017-09-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164530#comment-16164530 ] Sunil G commented on YARN-7157: --- Thanks [~bibinchundatt] There are 2 aspects. One is user filter submitted

[jira] [Updated] (YARN-7157) Support displaying per-user's apps in RM UI page and in secure cluster

2017-09-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7157: -- Attachment: YARN-7157.005.patch Thanks [~rohithsharma]. Attaching new patch after fixing test case failure. >

<    7   8   9   10   11   12   13   14   15   16   >