[jira] [Updated] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution)

2017-08-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6896: --- Attachment: YARN-6896.v3.patch > Federation: routing REST invocations

[jira] [Commented] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution)

2017-08-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122558#comment-16122558 ] Giovanni Matteo Fumarola commented on YARN-6896: Attached V3 that addressed your feedback.

[jira] [Comment Edited] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution)

2017-08-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122558#comment-16122558 ] Giovanni Matteo Fumarola edited comment on YARN-6896 at 8/10/17 11:54 PM:

[jira] [Commented] (YARN-6905) Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat

2017-08-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122571#comment-16122571 ] Vrushali C commented on YARN-6905: -- thanks [~haibo.chen], patch 001 looks good to me. There is a minor

[jira] [Created] (YARN-6986) Fair scheduler should add a SchedulerMetrics class

2017-08-10 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6986: -- Summary: Fair scheduler should add a SchedulerMetrics class Key: YARN-6986 URL: https://issues.apache.org/jira/browse/YARN-6986 Project: Hadoop YARN

[jira] [Updated] (YARN-6905) Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat

2017-08-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6905: - Attachment: YARN-6905.00.patch > Multiple HBaseTimelineStorage test failures due to missing

[jira] [Commented] (YARN-6789) new api to get all supported resources from RM

2017-08-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121965#comment-16121965 ] Daniel Templeton commented on YARN-6789: Per the recent conversation with [~vvasudev] on YARN-4081,

[jira] [Updated] (YARN-6974) Make CuratorBasedElectorService the default

2017-08-10 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-6974: Target Version/s: 4.0.0 > Make CuratorBasedElectorService the default >

[jira] [Updated] (YARN-6974) Make CuratorBasedElectorService the default

2017-08-10 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-6974: Target Version/s: (was: 3.0.0-beta1) > Make CuratorBasedElectorService the default >

[jira] [Updated] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-08-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-6930: -- Attachment: YARN-6930.002.patch > Admins should be able to explicitly enable specific

[jira] [Commented] (YARN-6882) AllocationFileLoaderService.reloadAllocations() should use the diamond operator

2017-08-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122072#comment-16122072 ] Daniel Templeton commented on YARN-6882: LGTM +1 > AllocationFileLoaderService.reloadAllocations()

[jira] [Commented] (YARN-6883) AllocationFileLoaderService.reloadAllocations() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122068#comment-16122068 ] Daniel Templeton commented on YARN-6883: If it's alright with you I'll close this JIRA as handled

[jira] [Commented] (YARN-6969) Remove method getMinShareMemoryFraction and getPendingContainers in class FairSchedulerQueueInfo

2017-08-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122083#comment-16122083 ] Yufei Gu commented on YARN-6969: Thanks [~rkanter]. Nice! I add some one as a contributor now. [~LarryLo],

[jira] [Commented] (YARN-6883) AllocationFileLoaderService.reloadAllocations() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-10 Thread Larry Lo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122082#comment-16122082 ] Larry Lo commented on YARN-6883: Sure! Please close this issue and I will find other JIRAs. >

[jira] [Commented] (YARN-6972) Adding RM ClusterId in AppInfo

2017-08-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122112#comment-16122112 ] Giovanni Matteo Fumarola commented on YARN-6972: Hi [~tanujnay], try to pull the new code

[jira] [Updated] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6620: - Attachment: YARN-6620.002.patch Rebased to latest trunk (002) > [YARN-6223] NM Java side code changes to

[jira] [Commented] (YARN-6885) AllocationFileLoaderService.loadQueue() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121621#comment-16121621 ] Wei-Chiu Chuang commented on YARN-6885: --- Hi [~Yu-Tang Lin] The refactory looks mostly good to me.

[jira] [Assigned] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-08-10 Thread Aaron Gresch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Gresch reassigned YARN-6736: -- Assignee: Aaron Gresch (was: Rohith Sharma K S) > Consider writing to both ats v1 & v2 from RM

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-08-10 Thread Aaron Gresch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121649#comment-16121649 ] Aaron Gresch commented on YARN-6736: [~rohithsharma] I just started looking into this issue recently

[jira] [Commented] (YARN-6981) The “Total Resource” displayed in RM node label page is inaccurate when refresh node resources

2017-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121587#comment-16121587 ] Sunil G commented on YARN-6981: --- Thanks [~daemon] Could you please give a bit more details. Whats the change

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121653#comment-16121653 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6386) Graceful shutdown support on webui 2

2017-08-10 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121680#comment-16121680 ] Elek, Marton commented on YARN-6386: Sorry, I missed your comment about requesting a screenshot. Thanks

[jira] [Commented] (YARN-5978) ContainerScheduler and Container state machine changes to support ExecType update

2017-08-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121781#comment-16121781 ] Arun Suresh commented on YARN-5978: --- Thanks for the patch [~kartheek]. Couple of nits: * I think you can

[jira] [Commented] (YARN-6972) Adding RM ClusterId in AppInfo

2017-08-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122001#comment-16122001 ] Giovanni Matteo Fumarola commented on YARN-6972: I checked {{AppInfo.java}} and I found

[jira] [Commented] (YARN-6905) Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122009#comment-16122009 ] Hadoop QA commented on YARN-6905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6882) AllocationFileLoaderService.reloadAllocations() should use the diamond operator

2017-08-10 Thread Larry Lo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Lo updated YARN-6882: --- Attachment: YARN-6882.001.patch Please help to review this patch, thanks. >

[jira] [Updated] (YARN-5536) Multiple format support (JSON, etc.) for exclude node file in NM graceful decommission with timeout

2017-08-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5536: -- Priority: Blocker (was: Critical) Target Version/s: 2.9.0, 3.0.0-beta1 (was: 2.9.0) Sounds

[jira] [Commented] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122038#comment-16122038 ] Hadoop QA commented on YARN-6610: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-6969) Remove method getMinShareMemoryFraction and getPendingContainers in class FairSchedulerQueueInfo

2017-08-10 Thread Larry Lo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Lo reassigned YARN-6969: -- Assignee: Larry Lo > Remove method getMinShareMemoryFraction and getPendingContainers in class >

[jira] [Updated] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6852: - Attachment: YARN-6852.006.patch Fixed compile issues and added additional tests (006) > [YARN-6223]

[jira] [Updated] (YARN-6972) Adding RM ClusterId in AppInfo

2017-08-10 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-6972: -- Attachment: YARN-6972.002.patch Attached v2 with [~giovanni.fumarola]'s suggestions along with the

[jira] [Commented] (YARN-6883) AllocationFileLoaderService.reloadAllocations() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122088#comment-16122088 ] Daniel Templeton commented on YARN-6883: Sweet. I'll close this one when YARN-6885 is committed.

[jira] [Commented] (YARN-6972) Adding RM ClusterId in AppInfo

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122115#comment-16122115 ] Hadoop QA commented on YARN-6972: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6923) Metrics for Federation Router

2017-08-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6923: --- Attachment: YARN-6923.v1.patch > Metrics for Federation Router >

[jira] [Commented] (YARN-6885) AllocationFileLoaderService.loadQueue() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122026#comment-16122026 ] Hadoop QA commented on YARN-6885: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6903) Yarn-native-service framework core rewrite

2017-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6903: -- Attachment: YARN-6903.yarn-native-services.06.patch > Yarn-native-service framework core rewrite >

[jira] [Commented] (YARN-6883) AllocationFileLoaderService.reloadAllocations() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-10 Thread Larry Lo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122063#comment-16122063 ] Larry Lo commented on YARN-6883: It looks like the same issue to change from if/else=if to switch statement

[jira] [Commented] (YARN-6972) Adding RM ClusterId in AppInfo

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122073#comment-16122073 ] Hadoop QA commented on YARN-6972: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5736) YARN container executor config does not handle white space

2017-08-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122091#comment-16122091 ] Miklos Szegedi commented on YARN-5736: -- Sure, please include the addendum as well. > YARN container

[jira] [Updated] (YARN-6969) Remove method getMinShareMemoryFraction and getPendingContainers in class FairSchedulerQueueInfo

2017-08-10 Thread Larry Lo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Lo updated YARN-6969: --- Attachment: YARN-6969.001.patch Sure, please help review the patch. > Remove method getMinShareMemoryFraction

[jira] [Commented] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122138#comment-16122138 ] Hadoop QA commented on YARN-6852: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6981) The “Total Resource” displayed in RM node label page is inaccurate when refresh node resources

2017-08-10 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6981: -- Description: The “Total Resource” displayed in RM node label page is > The “Total Resource” displayed

[jira] [Updated] (YARN-6981) The “Total Resource” displayed in RM node label page is inaccurate when refresh node resources

2017-08-10 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6981: -- Summary: The “Total Resource” displayed in RM node label page is inaccurate when refresh node resources

[jira] [Updated] (YARN-6981) The “Total Resource” displayed in RM node label page is inaccurate when refresh node resources

2017-08-10 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6981: -- Description: The “Total Resource” displayed in RM node label page is inaccurate when refresh node

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-08-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121509#comment-16121509 ] Varun Saxena commented on YARN-6736: Infact, clash of v1 and v2 configurations would be a problem for

[jira] [Updated] (YARN-6981) The “Total Resource” displayed in RM node label page is inaccurate when refresh node resources

2017-08-10 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6981: -- Description: The “Total Resource” displayed in RM node label page is inaccurate when refresh node

[jira] [Updated] (YARN-6981) The “Total Resource” displayed in RM node label page is inaccurate when refresh node resources

2017-08-10 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6981: -- Description: The *Total Resource* displayed in RM node label page is inaccurate when refresh node

[jira] [Updated] (YARN-6981) The “Total Resource” displayed in RM node label page is inaccurate when refresh node resources

2017-08-10 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6981: -- Component/s: fairscheduler > The “Total Resource” displayed in RM node label page is inaccurate when >

[jira] [Updated] (YARN-6905) Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat

2017-08-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6905: - Summary: Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat (was: Multiple test

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2017-08-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122755#comment-16122755 ] Tao Yang commented on YARN-6257: This problem was imported by YARN-3293 (2.8.0+). The operationsInfo can't

[jira] [Commented] (YARN-6969) Remove method getMinShareMemoryFraction and getPendingContainers in class FairSchedulerQueueInfo

2017-08-10 Thread Larry Lo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122774#comment-16122774 ] Larry Lo commented on YARN-6969: Hi, [~yufeigu]. the findbugs show there are warnings about

[jira] [Commented] (YARN-6413) Decouple Yarn Registry API from ZK

2017-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122143#comment-16122143 ] Jian He commented on YARN-6413: --- So the registry path is currently like this: {code}

[jira] [Commented] (YARN-6882) AllocationFileLoaderService.reloadAllocations() should use the diamond operator

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122177#comment-16122177 ] Hadoop QA commented on YARN-6882: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122188#comment-16122188 ] Vrushali C commented on YARN-6820: -- Thanks [~jlowe] bq. don't see why we would sometimes want to get the

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122192#comment-16122192 ] Vrushali C commented on YARN-6130: -- We could consider creating a separate jira for branch-2 to add in

[jira] [Created] (YARN-6987) Log app attempt during InvalidStateTransition

2017-08-10 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created YARN-6987: - Summary: Log app attempt during InvalidStateTransition Key: YARN-6987 URL: https://issues.apache.org/jira/browse/YARN-6987 Project: Hadoop YARN Issue

[jira] [Comment Edited] (YARN-6861) Reader API for sub application entities

2017-08-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122159#comment-16122159 ] Vrushali C edited comment on YARN-6861 at 8/10/17 7:22 PM: --- [~rohithsharma]

[jira] [Comment Edited] (YARN-6861) Reader API for sub application entities

2017-08-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122159#comment-16122159 ] Vrushali C edited comment on YARN-6861 at 8/10/17 7:23 PM: --- [~rohithsharma]

[jira] [Updated] (YARN-6972) Adding RM ClusterId in AppInfo

2017-08-10 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-6972: -- Attachment: YARN-6972.003.patch Attached v3. > Adding RM ClusterId in AppInfo >

[jira] [Commented] (YARN-6861) Reader API for sub application entities

2017-08-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122159#comment-16122159 ] Vrushali C commented on YARN-6861: -- [~rohithsharma] [~varun_saxena] and I discussed this in our weekly

[jira] [Commented] (YARN-6923) Metrics for Federation Router

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122182#comment-16122182 ] Hadoop QA commented on YARN-6923: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5328) InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem

2017-08-10 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5328: - Attachment: YARN-5328-v7.patch Thanks [~curino] for the fixes for the wrap-around reservations. I

[jira] [Commented] (YARN-6885) AllocationFileLoaderService.loadQueue() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-10 Thread Yu-Tang Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122737#comment-16122737 ] Yu-Tang Lin commented on YARN-6885: --- Hi [#Daniel Templeton], thanks for the comment! I put the text and

[jira] [Updated] (YARN-6834) A container request with only racks specified and relax locality set to false is never honoured

2017-08-10 Thread Muhammad Samir Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-6834: -- Attachment: YARN-6834.001.patch Not sure if the attached patch is the best way to solve

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

2017-08-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122191#comment-16122191 ] Vrushali C commented on YARN-6047: -- Note: Need to update documentation with changes in YARN-6820 (the

[jira] [Commented] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122190#comment-16122190 ] Hadoop QA commented on YARN-6930: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6958) Moving logging APIs over to slf4j in hadoop-yarn-server-timelineservice

2017-08-10 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122620#comment-16122620 ] Yeliang Cang commented on YARN-6958: Thanks for the review, [~ajisakaa]! > Moving logging APIs over to

[jira] [Commented] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution)

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122632#comment-16122632 ] Hadoop QA commented on YARN-6896: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6987) Log app attempt during InvalidStateTransition

2017-08-10 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-6987: -- Attachment: YARN-6987.001.patch > Log app attempt during InvalidStateTransition >

[jira] [Commented] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-08-10 Thread Larry Lo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122155#comment-16122155 ] Larry Lo commented on YARN-6878: Thanks Daniel! I'll try to fix this issue. >

[jira] [Comment Edited] (YARN-6972) Adding RM ClusterId in AppInfo

2017-08-10 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122180#comment-16122180 ] Tanuj Nayak edited comment on YARN-6972 at 8/10/17 7:38 PM: Attached v3, didn't

[jira] [Updated] (YARN-6903) Yarn-native-service framework core rewrite

2017-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6903: -- Attachment: YARN-6903.yarn-native-services.07.patch Not sure why the TestYarnNativeService always timed out on

[jira] [Updated] (YARN-6980) The YARN_TIMELINE_HEAPSIZE does not work

2017-08-10 Thread Jinjiang Ling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinjiang Ling updated YARN-6980: Attachment: YARN-6980-1.patch Thanks for your advice, [~aw]. Now I set both the Xms and Xmx in

[jira] [Commented] (YARN-6967) Limit application attempt's diagnostic message size thoroughly

2017-08-10 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122652#comment-16122652 ] Chengbing Liu commented on YARN-6967: - [~templedf] [~andras.piros] Could you review the patch again?

[jira] [Commented] (YARN-5434) Add -client|server argument for graceful decom

2017-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121406#comment-16121406 ] Sunil G commented on YARN-5434: --- [~djp] and [~rkanter] A quick doubt. I was trying to test graceful

[jira] [Assigned] (YARN-6972) Adding RM ClusterId in AppInfo

2017-08-10 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak reassigned YARN-6972: - Assignee: Tanuj Nayak > Adding RM ClusterId in AppInfo > -- > >

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-08-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121505#comment-16121505 ] Rohith Sharma K S commented on YARN-6736: - Thanks [~agresch] for your comments! On behalf of YARN

[jira] [Created] (YARN-6981) The “Total Resource” displayed in RM node page is inaccurate when refresh node resources

2017-08-10 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-6981: - Summary: The “Total Resource” displayed in RM node page is inaccurate when refresh node resources Key: YARN-6981 URL: https://issues.apache.org/jira/browse/YARN-6981

[jira] [Commented] (YARN-5978) ContainerScheduler and Container state machine changes to support ExecType update

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121381#comment-16121381 ] Hadoop QA commented on YARN-5978: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6386) Graceful shutdown support on webui 2

2017-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121423#comment-16121423 ] Sunil G commented on YARN-6386: --- I tested this feature locally. Seems fine. If there are no objections, I

[jira] [Commented] (YARN-6373) [YARN-3368] Improvements in cluster-overview page in YARN-UI

2017-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121440#comment-16121440 ] Sunil G commented on YARN-6373: --- Thanks [~GergelyNovak]. Extremely sorry for the delay. Few more comments

[jira] [Commented] (YARN-5150) [YARN-3368] Add a sunburst chart view for queues/applications resource usage to new YARN UI

2017-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121447#comment-16121447 ] Sunil G commented on YARN-5150: --- [~GergelyNovak] Thanks and I tested this more. Its really useful and much

[jira] [Commented] (YARN-5150) [YARN-3368] Add a sunburst chart view for queues/applications resource usage to new YARN UI

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121452#comment-16121452 ] Hadoop QA commented on YARN-5150: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6980) The YARN_TIMELINE_HEAPSIZE does not work

2017-08-10 Thread Jinjiang Ling (JIRA)
Jinjiang Ling created YARN-6980: --- Summary: The YARN_TIMELINE_HEAPSIZE does not work Key: YARN-6980 URL: https://issues.apache.org/jira/browse/YARN-6980 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-6980) The YARN_TIMELINE_HEAPSIZE does not work

2017-08-10 Thread Jinjiang Ling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinjiang Ling updated YARN-6980: Attachment: YARN-6980.patch Attach a patch, change the YARN_TIMELINESERVER_HEAPSIZE in "yarn" and

[jira] [Updated] (YARN-6972) Adding RM ClusterId in AppInfo

2017-08-10 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-6972: -- Attachment: YARN-6972.001.patch Uploaded v1 patch. > Adding RM ClusterId in AppInfo >

[jira] [Commented] (YARN-65) Reduce RM app memory footprint once app has completed

2017-08-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121530#comment-16121530 ] Rohith Sharma K S commented on YARN-65: --- thanks [~maniraj...@gmail.com] for the patch. Clearing

[jira] [Commented] (YARN-5736) YARN container executor config does not handle white space

2017-08-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121531#comment-16121531 ] Shane Kumpf commented on YARN-5736: --- No concerns here. > YARN container executor config does not handle

[jira] [Updated] (YARN-5978) ContainerScheduler and Container state machine changes to support ExecType update

2017-08-10 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kartheek muthyala updated YARN-5978: Attachment: YARN-5978.002.patch Fixing checkstyle, Javadoc and broken junit tests. >

[jira] [Created] (YARN-6982) Potential issue on setting AMContainerSpec#tokenConf to null before app is completed

2017-08-10 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-6982: --- Summary: Potential issue on setting AMContainerSpec#tokenConf to null before app is completed Key: YARN-6982 URL: https://issues.apache.org/jira/browse/YARN-6982

[jira] [Commented] (YARN-5328) InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122812#comment-16122812 ] Hadoop QA commented on YARN-5328: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6882) AllocationFileLoaderService.reloadAllocations() should use the diamond operator

2017-08-10 Thread Larry Lo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122827#comment-16122827 ] Larry Lo commented on YARN-6882: Hi, [~templedf]. It looks like not all unit tests passed. I have no idea

[jira] [Commented] (YARN-6903) Yarn-native-service framework core rewrite

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122846#comment-16122846 ] Hadoop QA commented on YARN-6903: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6727) Improve getQueueUserAcls API to query for specific queue and user

2017-08-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6727: --- Attachment: YARN-6727.003.patch Attaching updated patch > Improve getQueueUserAcls API to

<    1   2