[jira] [Commented] (YARN-6850) Ensure that supplemented timestamp is stored only for flow run metrics

2017-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095697#comment-16095697 ] Vrushali C commented on YARN-6850: -- If we don't want to update the documentation here, could you add in a

[jira] [Comment Edited] (YARN-6850) Ensure that supplemented timestamp is stored only for flow run metrics

2017-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095696#comment-16095696 ] Vrushali C edited comment on YARN-6850 at 7/21/17 2:42 AM: --- Thanks

[jira] [Commented] (YARN-6850) Ensure that supplemented timestamp is stored only for flow run metrics

2017-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095696#comment-16095696 ] Vrushali C commented on YARN-6850: -- Thanks [~varun_saxena] for the patch. Yes, I think we want to add in

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095688#comment-16095688 ] Hadoop QA commented on YARN-6804: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6323) Rolling upgrade/config change is broken on timeline v2.

2017-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095682#comment-16095682 ] Vrushali C commented on YARN-6323: -- Ping on this jira. To summarize: - new NM fails to recover apps since

[jira] [Updated] (YARN-6733) Add table for storing sub-application entities

2017-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6733: - Attachment: YARN-6733-YARN-5355.007.patch Rebased the earlier 006 patch. Uploading v007. > Add table for

[jira] [Updated] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-20 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6804: - Attachment: YARN-6804-yarn-native-services.004.patch I separated this into two patches (004), one

[jira] [Updated] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-20 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6804: - Attachment: YARN-6804-trunk.004.patch > Allow custom hostname for docker containers in native

[jira] [Commented] (YARN-6837) Null LocalResource visibility or resource type can crash the nodemanager

2017-07-20 Thread Jinjiang Ling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095591#comment-16095591 ] Jinjiang Ling commented on YARN-6837: - [~jlowe], thanks for your review. > Null LocalResource

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095578#comment-16095578 ] Vrushali C commented on YARN-6733: -- Looks like I need to rebase my patch to the latest branch state. Will

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-20 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095566#comment-16095566 ] Konstantinos Karanasos commented on YARN-6593: -- Thanks for the feedback, [~leftnoteasy] and

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095563#comment-16095563 ] Hadoop QA commented on YARN-6733: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6733) Add table for storing sub-application entities

2017-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6733: - Attachment: YARN-6733-YARN-5355.006.patch Attaching v006 that addresses all the documentation

[jira] [Created] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-20 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-6853: -- Summary: Add MySql Scripts for FederationStateStore Key: YARN-6853 URL: https://issues.apache.org/jira/browse/YARN-6853 Project: Hadoop YARN

[jira] [Commented] (YARN-3254) HealthReport should include disk full information

2017-07-20 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095484#comment-16095484 ] Suma Shivaprasad commented on YARN-3254: [~sunilg] Can you pls review the patch? > HealthReport

[jira] [Commented] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095480#comment-16095480 ] Hadoop QA commented on YARN-6768: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095440#comment-16095440 ] Wangda Tan commented on YARN-6593: -- bq. Do you have specific use cases in mind? Regarding to LRA, change

[jira] [Commented] (YARN-6033) Add support for sections in container-executor configuration file

2017-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095405#comment-16095405 ] Wangda Tan commented on YARN-6033: -- [~vvasudev], While doing test for YARN-6223 (based on this patch). I

[jira] [Commented] (YARN-6223) [Umbrella] Natively support GPU configuration/discovery/scheduling/isolation on YARN

2017-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095391#comment-16095391 ] Wangda Tan commented on YARN-6223: -- [~chris.douglas], I just split native patch to YARN-6852 and included

[jira] [Updated] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6852: - Attachment: YARN-6852.001.patch Attached YARN-6852.001 patch for review. Thanks

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095369#comment-16095369 ] Jian He commented on YARN-6130: --- btw, what is the existing AppCollectorData#rmIdentifier used for ? >

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095366#comment-16095366 ] Jian He commented on YARN-6130: --- minor comment: The AllocateResponse#newInstance method may be not needed. I

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095358#comment-16095358 ] Hadoop QA commented on YARN-6620: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6620: - Attachment: YARN-6620.001.patch Attached ver.001 patch for review. > [YARN-6223] NM Java side code

[jira] [Updated] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6852: - Description: This JIRA plan to add support of: 1) Isolation in CGroups. (native side). > [YARN-6223]

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095348#comment-16095348 ] Wangda Tan commented on YARN-6620: -- (Deleted originally attached patch since it is out-of-date and

[jira] [Updated] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6620: - Description: This JIRA plan to add support of: 1) GPU configuration for NodeManagers 2) Isolation in

[jira] [Updated] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6620: - Summary: [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups (was:

[jira] [Updated] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6620: - Attachment: (was: YARN-6620.001.patch) > [YARN-6223] NM Java side code changes to support isolate GPU

[jira] [Created] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-07-20 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-6852: Summary: [YARN-6223] Native code changes to support isolate GPU devices by using CGroups Key: YARN-6852 URL: https://issues.apache.org/jira/browse/YARN-6852 Project: Hadoop

[jira] [Updated] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2017-07-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4006: - Target Version/s: 2.9.0 (was: 2.8.2) > YARN ATS Alternate Kerberos HTTP Authentication Changes >

[jira] [Commented] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2017-07-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095320#comment-16095320 ] Junping Du commented on YARN-4006: -- Move it out of 2.8.2 given no activity for over a year on this JIRA.

[jira] [Updated] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-20 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-6768: -- Attachment: YARN-6768.6.patch > Improve performance of yarn api record toString and fromString >

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-07-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095298#comment-16095298 ] Jason Lowe commented on YARN-6820: -- A simple whitelist of users that are allowed to use the readers and

[jira] [Commented] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095273#comment-16095273 ] Hadoop QA commented on YARN-6768: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095232#comment-16095232 ] Vrushali C commented on YARN-6733: -- Will update the documentation. Varun and I discussed during today's

[jira] [Assigned] (YARN-6779) DominantResourceFairnessPolicy.DominantResourceFairnessComparator.calculateShares() should be @VisibleForTesting

2017-07-20 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-6779: -- Assignee: Laura Torres >

[jira] [Updated] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-20 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-6768: -- Attachment: YARN-6768.5.patch > Improve performance of yarn api record toString and fromString >

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-07-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095227#comment-16095227 ] Chris Douglas commented on YARN-6726: - Not sure if I'll have cycles to review the patch in detail, but

[jira] [Commented] (YARN-5304) Ship single node HBase config option with single startup command

2017-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095225#comment-16095225 ] Vrushali C commented on YARN-5304: -- Went over this jira with [~jrottinghuis] and here is a summary of what

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095220#comment-16095220 ] Hadoop QA commented on YARN-6804: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095217#comment-16095217 ] Chris Douglas commented on YARN-6593: - bq. I found it is very important otherwise we cannot support

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095209#comment-16095209 ] Vrushali C commented on YARN-6820: -- Thanks [~varun_saxena] and [~jlowe] Yes, I think we could look at

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-07-20 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095165#comment-16095165 ] Wei Yan commented on YARN-4161: --- The failed testcase passed locally, looks like not related to this patch.

[jira] [Created] (YARN-6851) Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat

2017-07-20 Thread Wei Yan (JIRA)
Wei Yan created YARN-6851: - Summary: Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat Key: YARN-6851 URL: https://issues.apache.org/jira/browse/YARN-6851

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095136#comment-16095136 ] Hadoop QA commented on YARN-6842: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6734) Ensure sub-application user is extracted & sent to timeline service

2017-07-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095074#comment-16095074 ] Varun Saxena commented on YARN-6734: Had a cursory glance at the patch. Seems to be fine. A couple of

[jira] [Updated] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-20 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6804: - Attachment: YARN-6804-yarn-native-services.003.patch Attaching a new patch addressing [~jianhe]'s

[jira] [Commented] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095051#comment-16095051 ] Hadoop QA commented on YARN-6791: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095049#comment-16095049 ] Wangda Tan commented on YARN-6593: -- [~chris.douglas], bq. Do we want to support users adding new

[jira] [Comment Edited] (YARN-6734) Ensure sub-application user is extracted & sent to timeline service

2017-07-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095043#comment-16095043 ] Varun Saxena edited comment on YARN-6734 at 7/20/17 5:33 PM: - [~rohithsharma],

[jira] [Commented] (YARN-6734) Ensure sub-application user is extracted & sent to timeline service

2017-07-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095043#comment-16095043 ] Varun Saxena commented on YARN-6734: [~rohithsharma], will we be creating a proxy user to write

[jira] [Commented] (YARN-6840) Leverage RMStateStore to store scheduler configuration updates

2017-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095022#comment-16095022 ] Wangda Tan commented on YARN-6840: -- [~Naganarasimha], I think storing to a single zk node should be fine.

[jira] [Commented] (YARN-6850) Ensure that supplemented timestamp is stored only for flow run metrics

2017-07-20 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094990#comment-16094990 ] Joep Rottinghuis commented on YARN-6850: +1 looks good. Note that for data written before this

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094973#comment-16094973 ] Hadoop QA commented on YARN-6788: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6837) Null LocalResource visibility or resource type can crash the nodemanager

2017-07-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094926#comment-16094926 ] Hudson commented on YARN-6837: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12038 (See

[jira] [Updated] (YARN-6837) Null LocalResource visibility or resource type can crash the nodemanager

2017-07-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6837: - Summary: Null LocalResource visibility or resource type can crash the nodemanager (was: When the

[jira] [Updated] (YARN-6842) Implement a new access type for queue

2017-07-20 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6842: -- Attachment: YARN-6842.001.patch > Implement a new access type for queue >

[jira] [Commented] (YARN-6837) When the LocalResource's visibility is null, the NodeManager will shutdown

2017-07-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094867#comment-16094867 ] Jason Lowe commented on YARN-6837: -- The findbug warnings are unrelated to the patch. +1 lgtm. Committing

[jira] [Updated] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-20 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6791: -- Attachment: YARN-6791.004.patch > Add a new acl control to make YARN acl control perfect >

[jira] [Commented] (YARN-6830) Support quoted strings for environment variables

2017-07-20 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094847#comment-16094847 ] Shane Kumpf commented on YARN-6830: --- Thanks for the feedback [~templedf]. I see what you are proposing

[jira] [Commented] (YARN-6685) Add job count in to SLS JSON input format

2017-07-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094846#comment-16094846 ] Hudson commented on YARN-6685: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12037 (See

[jira] [Commented] (YARN-6685) Add job count in to SLS JSON input format

2017-07-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094810#comment-16094810 ] Haibo Chen commented on YARN-6685: -- +1. Committing this shortly. > Add job count in to SLS JSON input

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-20 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.009.patch Uploading a new patch. Few more improvement, and will try jenkins

[jira] [Assigned] (YARN-6721) container-executor should have stack checking

2017-07-20 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-6721: - Assignee: Sunil G > container-executor should have stack checking >

[jira] [Commented] (YARN-6721) container-executor should have stack checking

2017-07-20 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094773#comment-16094773 ] Sunil G commented on YARN-6721: --- I would like to take it up and give it a go. Please assign back if any one

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-07-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094769#comment-16094769 ] Jason Lowe commented on YARN-6820: -- Visibility labels on the surface look like they would map very closely

[jira] [Commented] (YARN-6373) [YARN-3368] Improvements in cluster-overview page in YARN-UI

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094752#comment-16094752 ] Hadoop QA commented on YARN-6373: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-6373) [YARN-3368] Improvements in cluster-overview page in YARN-UI

2017-07-20 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094737#comment-16094737 ] Akhil PB edited comment on YARN-6373 at 7/20/17 2:10 PM: - It seems that there are

[jira] [Commented] (YARN-6373) [YARN-3368] Improvements in cluster-overview page in YARN-UI

2017-07-20 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094737#comment-16094737 ] Akhil PB commented on YARN-6373: It seems that there are changes made for donut charts in most of the

[jira] [Commented] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094736#comment-16094736 ] Hadoop QA commented on YARN-6791: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-20 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094734#comment-16094734 ] YunFan Zhou commented on YARN-6791: --- [~dan...@cloudera.com] Yes, I want to close it. And use my new JIRA

[jira] [Updated] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-20 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6791: -- Attachment: YARN-6791.003.patch > Add a new acl control to make YARN acl control perfect >

[jira] [Updated] (YARN-6734) Ensure sub-application user is extracted & sent to timeline service

2017-07-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6734: Attachment: YARN-6734-YARN-5355.001.patch Attaching v0 patch for writing data into

[jira] [Commented] (YARN-6850) Ensure that supplemented timestamp is stored only for flow run metrics

2017-07-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094700#comment-16094700 ] Varun Saxena commented on YARN-6850: Tests not required. > Ensure that supplemented timestamp is

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094682#comment-16094682 ] Rohith Sharma K S commented on YARN-6733: - Adding to Varun comments, SubApplicaitonTable does not

[jira] [Commented] (YARN-6850) Ensure that supplemented timestamp is stored only for flow run metrics

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094665#comment-16094665 ] Hadoop QA commented on YARN-6850: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6850) Ensure that supplemented timestamp is stored only for flow run metrics

2017-07-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6850: --- Attachment: YARN-6850-YARN-5355.01.patch Attaching a quick fix. > Ensure that supplemented timestamp

[jira] [Assigned] (YARN-6850) Ensure that supplemented timestamp is stored only for flow run metrics

2017-07-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-6850: -- Assignee: Varun Saxena > Ensure that supplemented timestamp is stored only for flow run metrics

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094484#comment-16094484 ] Varun Saxena commented on YARN-6733: Thanks [~vrushalic] for the patch and [~rohithsharma] for the

[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094460#comment-16094460 ] Hadoop QA commented on YARN-6102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094452#comment-16094452 ] Varun Saxena commented on YARN-6130: Thanks [~rohithsharma] for the review. bq. newly added proto i.e

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-07-20 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094404#comment-16094404 ] YunFan Zhou commented on YARN-6842: --- [~templedf] Yes, you are right. > Implement a new access type for

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094391#comment-16094391 ] Varun Saxena commented on YARN-4455: Thanks [~rohithsharma] for the review and commit. Thanks

[jira] [Updated] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-07-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6102: Attachment: YARN-6102.07.patch attached the patch fixing java doc errors. > On failover RM

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094371#comment-16094371 ] Rohith Sharma K S commented on YARN-4455: - committed to YARN-5355-branch-2 as well. > Support

[jira] [Updated] (YARN-4455) Support fetching metrics by time range

2017-07-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4455: Fix Version/s: YARN-5355-branch-2 > Support fetching metrics by time range >

[jira] [Commented] (YARN-6844) AMRMClientImpl.checkNodeLabelExpression() has wrong error message

2017-07-20 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094367#comment-16094367 ] Daniel Templeton commented on YARN-6844: LGTM +1. I'll commit it later. >

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094365#comment-16094365 ] Rohith Sharma K S commented on YARN-6733: - As offline discussion with Vrushali, YARN-6850 is

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094348#comment-16094348 ] Varun Saxena commented on YARN-4455: bq. Does it required to commit YARN-5355-branch-2? Is this fix is

[jira] [Commented] (YARN-6685) Add job count in to SLS JSON input format

2017-07-20 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094300#comment-16094300 ] Yufei Gu commented on YARN-6685: The test failure is unrelated. > Add job count in to SLS JSON input

[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094296#comment-16094296 ] Hadoop QA commented on YARN-6102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6685) Add job count in to SLS JSON input format

2017-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094285#comment-16094285 ] Hadoop QA commented on YARN-6685: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-07-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094275#comment-16094275 ] Varun Saxena commented on YARN-6820: As all reads from Timeline Reader would be with ats user, so would

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094269#comment-16094269 ] Rohith Sharma K S commented on YARN-4455: - [~varun_saxena] Does it required to commit

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094267#comment-16094267 ] Rohith Sharma K S commented on YARN-4455: - committing shortly > Support fetching metrics by time

[jira] [Updated] (YARN-6685) Add job count in to SLS JSON input format

2017-07-20 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6685: --- Attachment: YARN-6685.003.patch Thanks [~haibo.chen], uploaded new patch for your comment. > Add job count in

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094258#comment-16094258 ] Vrushali C commented on YARN-4455: -- +1 on the patch right now. The supplemented timestamp issue will be

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094257#comment-16094257 ] Rohith Sharma K S commented on YARN-6130: - [~varun_saxena] I skimmed through the patch. First look

[jira] [Updated] (YARN-6850) Ensure that supplemented timestamp is stored only for flow run metrics

2017-07-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6850: - Description: In timeline service v2, ColumnHelper#getPutTimestamp supplements the timestamp and is

  1   2   >