[jira] [Commented] (YARN-7586) Application Placement should be done before ACL checks in ResourceManager

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275444#comment-16275444 ] genericqa commented on YARN-7586: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275442#comment-16275442 ] Jian He edited comment on YARN-6669 at 12/2/17 6:36 AM: Thanks Eric for help

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.11.patch > Support security for YARN service framework >

[jira] [Comment Edited] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275442#comment-16275442 ] Jian He edited comment on YARN-6669 at 12/2/17 6:30 AM: Thanks Eric for help

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275442#comment-16275442 ] Jian He commented on YARN-6669: --- Thanks Eric for help debugging. You are right, it is because the

[jira] [Commented] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275438#comment-16275438 ] genericqa commented on YARN-7520: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275431#comment-16275431 ] genericqa commented on YARN-6704: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: (was: YARN-6669.11.patch) > Support security for YARN service framework >

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.11.patch > Support security for YARN service framework >

[jira] [Comment Edited] (YARN-7586) Application Placement should be done before ACL checks in ResourceManager

2017-12-01 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275411#comment-16275411 ] Suma Shivaprasad edited comment on YARN-7586 at 12/2/17 4:52 AM: - Thanks

[jira] [Comment Edited] (YARN-7586) Application Placement should be done before ACL checks in ResourceManager

2017-12-01 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275411#comment-16275411 ] Suma Shivaprasad edited comment on YARN-7586 at 12/2/17 4:52 AM: - Thanks

[jira] [Updated] (YARN-7586) Application Placement should be done before ACL checks in ResourceManager

2017-12-01 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7586: --- Attachment: YARN-7586.4.patch Thanks [~sunilg] Attached patch with comments addressed.

[jira] [Updated] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-12-01 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6704: --- Attachment: YARN-6704.v7.patch > Add Federation Interceptor restart when work preserving NM is enabled

[jira] [Comment Edited] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-12-01 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275401#comment-16275401 ] Suma Shivaprasad edited comment on YARN-7520 at 12/2/17 4:16 AM: - Thanks

[jira] [Updated] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-12-01 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7520: --- Attachment: YARN-7520.3.patch Thanks [~sunilg] Attached patch with review comments addressed

[jira] [Commented] (YARN-5594) Handle old RMDelegationToken format when recovering RM

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275400#comment-16275400 ] genericqa commented on YARN-5594: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275391#comment-16275391 ] genericqa commented on YARN-7516: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275385#comment-16275385 ] genericqa commented on YARN-6704: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-12-01 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275356#comment-16275356 ] Botong Huang commented on YARN-6704: Thanks [~subru] for the comments! In v6 patch, I've changed the

[jira] [Updated] (YARN-7599) Application cleaner and subcluster cleaner in Global Policy Generator

2017-12-01 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7599: --- Issue Type: Sub-task (was: Task) Parent: YARN-5597 > Application cleaner and subcluster

[jira] [Created] (YARN-7599) Application cleaner and subcluster cleaner in Global Policy Generator

2017-12-01 Thread Botong Huang (JIRA)
Botong Huang created YARN-7599: -- Summary: Application cleaner and subcluster cleaner in Global Policy Generator Key: YARN-7599 URL: https://issues.apache.org/jira/browse/YARN-7599 Project: Hadoop YARN

[jira] [Updated] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-12-01 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6704: --- Attachment: YARN-6704.v6.patch > Add Federation Interceptor restart when work preserving NM is enabled

[jira] [Commented] (YARN-7584) Support resource profiles in native services

2017-12-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275343#comment-16275343 ] Jonathan Hung commented on YARN-7584: - In addition, right now the assumption is components will only

[jira] [Updated] (YARN-7584) Support resource profiles and fine-grained resource requests in native services

2017-12-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7584: Summary: Support resource profiles and fine-grained resource requests in native services (was:

[jira] [Updated] (YARN-5594) Handle old RMDelegationToken format when recovering RM

2017-12-01 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-5594: Attachment: YARN-5594.004.patch Test failure unrelated. The 004 patch fixes the relevant checkstyle

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2017-12-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Attachment: YARN-7516.001.patch - Added check for docker private registry. - Prevent mounting for public

[jira] [Assigned] (YARN-7516) Security check for untrusted docker image

2017-12-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7516: --- Assignee: Eric Yang > Security check for untrusted docker image >

[jira] [Commented] (YARN-7555) Support multiple resource types in YARN native services

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275330#comment-16275330 ] genericqa commented on YARN-7555: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5594) Handle old RMDelegationToken format when recovering RM

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275316#comment-16275316 ] genericqa commented on YARN-5594: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275315#comment-16275315 ] Miklos Szegedi commented on YARN-7590: -- [~eyang], why do not we just call getuid() to get the uid? >

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275300#comment-16275300 ] Eric Yang commented on YARN-7590: - [~miklos.szeg...@cloudera.com] One problem with option 3 is that

[jira] [Updated] (YARN-7555) Support multiple resource types in YARN native services

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7555: - Attachment: YARN-7555.003.patch Attached ver.3 patch, tested in local cluster and added UT.

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Affects Version/s: 2.0.1-alpha 2.2.0 2.3.0

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275232#comment-16275232 ] Andrew Wang commented on YARN-7590: --- Thanks Eric! > Improve container-executor validation check >

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275221#comment-16275221 ] Eric Yang commented on YARN-7590: - [~ebadger] {quote} I've brought this up in the past (can't remember

[jira] [Commented] (YARN-5418) When partial log aggregation is enabled, display the list of aggregated files on the container log page

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275217#comment-16275217 ] genericqa commented on YARN-5418: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled

2017-12-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275214#comment-16275214 ] Xuan Gong commented on YARN-7381: - bq. I believe we currently aggregate all local files to a single HDFS

[jira] [Commented] (YARN-5418) When partial log aggregation is enabled, display the list of aggregated files on the container log page

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275213#comment-16275213 ] Wangda Tan commented on YARN-5418: -- [~xgong], change is staled, mind to rebase? > When partial log

[jira] [Commented] (YARN-5418) When partial log aggregation is enabled, display the list of aggregated files on the container log page

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275211#comment-16275211 ] genericqa commented on YARN-5418: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275205#comment-16275205 ] Andrew Wang commented on YARN-7590: --- Hi folks, is this a release blocker? Could someone set the affects

[jira] [Created] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2017-12-01 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-7598: --- Summary: Document how to use classpath isolation for aux-services in YARN Key: YARN-7598 URL: https://issues.apache.org/jira/browse/YARN-7598 Project: Hadoop YARN

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-12-01 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275178#comment-16275178 ] Konstantinos Karanasos commented on YARN-7522: -- Thanks again for the patch, [~leftnoteasy].

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275168#comment-16275168 ] Mike Yoder commented on YARN-7590: -- {quote} Container executor should link to a C based XML parser to get

[jira] [Updated] (YARN-7471) queueUsagePercentage is wrongly calculated for applications in zero-capacity queues

2017-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7471: -- Target Version/s: 3.1.0 (was: 3.0.0-alpha4) > queueUsagePercentage is wrongly calculated for

[jira] [Updated] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7461: -- Target Version/s: 3.1.0 (was: 3.0.0-alpha4) > DominantResourceCalculator#ratio calculation problem when

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-12-01 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275152#comment-16275152 ] Robert Kanter commented on YARN-7556: - I'm concerned that the changes in {{ConfigurableResource}} could

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275142#comment-16275142 ] Miklos Szegedi commented on YARN-7590: -- I have two more options: 3. Instead of getting a prefix path

[jira] [Commented] (YARN-7589) TestPBImplRecords fails with NullPointerException

2017-12-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275099#comment-16275099 ] Daniel Templeton commented on YARN-7589: Thanks for the review and commit, [~jlowe]! >

[jira] [Updated] (YARN-7589) TestPBImplRecords fails with NullPointerException

2017-12-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7589: --- Affects Version/s: 3.0.0 Target Version/s: 3.0.0, 3.1.0, 3.0.1 (was: 3.1.0, 3.0.1)

[jira] [Updated] (YARN-5594) Handle old RMDelegationToken format when recovering RM

2017-12-01 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-5594: Attachment: YARN-5594.003.patch That's what I get for copy-pasting. I had originally had that

[jira] [Commented] (YARN-7455) quote_and_append_arg can overflow buffer

2017-12-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275084#comment-16275084 ] Hudson commented on YARN-7455: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13311 (See

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275068#comment-16275068 ] Eric Badger commented on YARN-7590: --- bq. Make sure the prefix path is same as the one in yarn-site.xml,

[jira] [Commented] (YARN-7589) TestPBImplRecords fails with NullPointerException

2017-12-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275048#comment-16275048 ] Hudson commented on YARN-7589: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13310 (See

[jira] [Commented] (YARN-7455) quote_and_append_arg can overflow buffer

2017-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275037#comment-16275037 ] Jason Lowe commented on YARN-7455: -- Thanks for updating the patch! The test failure is unrelated and

[jira] [Updated] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

2017-12-01 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7591: - Target Version/s: 2.9.1 > NPE in async-scheduling mode of CapacityScheduler >

[jira] [Commented] (YARN-7589) TestPBImplRecords fails with NullPointerException

2017-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275015#comment-16275015 ] Jason Lowe commented on YARN-7589: -- Thanks for finding time to look into it, Daniel! I verified the

[jira] [Resolved] (YARN-7517) RegistryDNS does not work with secure ZooKeeper

2017-12-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-7517. - Resolution: Duplicate Assignee: Jian He This issue will be fixed in YARN-6669. > RegistryDNS does

[jira] [Created] (YARN-7597) testContainerLogsWithNewAPI and testContainerLogsWithOldAPI UT fails

2017-12-01 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7597: Summary: testContainerLogsWithNewAPI and testContainerLogsWithOldAPI UT fails Key: YARN-7597 URL: https://issues.apache.org/jira/browse/YARN-7597 Project: Hadoop YARN

[jira] [Commented] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2017-12-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274947#comment-16274947 ] Hudson commented on YARN-4813: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13309 (See

[jira] [Commented] (YARN-7589) TestPBImplRecords fails with NullPointerException

2017-12-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274932#comment-16274932 ] Daniel Templeton commented on YARN-7589: Findbugs issue is unrelated. > TestPBImplRecords fails

[jira] [Commented] (YARN-7589) TestPBImplRecords fails with NullPointerException

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274908#comment-16274908 ] genericqa commented on YARN-7589: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2017-12-01 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274869#comment-16274869 ] Robert Kanter commented on YARN-4813: - Test failure looks unrelated +1 LGTM >

[jira] [Commented] (YARN-7596) Resource configs not parsed correctly in MapReduce for resources with dot

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274865#comment-16274865 ] genericqa commented on YARN-7596: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274842#comment-16274842 ] genericqa commented on YARN-7591: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7589) TestPBImplRecords fails with NullPointerException

2017-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7589: Assignee: Daniel Templeton > TestPBImplRecords fails with NullPointerException >

[jira] [Commented] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274816#comment-16274816 ] genericqa commented on YARN-7005: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-12-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274814#comment-16274814 ] Hudson commented on YARN-6507: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13306 (See

[jira] [Commented] (YARN-7242) Support specify values of different resource types in DistributedShell for easier testing

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274800#comment-16274800 ] genericqa commented on YARN-7242: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7455) quote_and_append_arg can overflow buffer

2017-12-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274788#comment-16274788 ] Jim Brennan commented on YARN-7455: --- The same hadoop.yarn.server.nodemanager.webapp.TestNMWebServices

[jira] [Updated] (YARN-7596) Resource configs not parsed correctly in MapReduce for resources with dot

2017-12-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7596: Attachment: YARN-7596.001.patch > Resource configs not parsed correctly in MapReduce for resources

[jira] [Commented] (YARN-7596) Resource configs not parsed correctly in MapReduce for resources with dot

2017-12-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274783#comment-16274783 ] Jonathan Hung commented on YARN-7596: - Attached 001 patch which changes the regex used to parse

[jira] [Updated] (YARN-7596) Resource configs not parsed correctly in MapReduce for resources with dot

2017-12-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7596: Attachment: (was: YARN-7596.001.patch) > Resource configs not parsed correctly in MapReduce for

[jira] [Updated] (YARN-7596) Resource configs not parsed correctly in MapReduce for resources with dot

2017-12-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7596: Attachment: YARN-7596.001.patch > Resource configs not parsed correctly in MapReduce for resources

[jira] [Updated] (YARN-7596) Resource configs not parsed correctly in MapReduce for resources with dot

2017-12-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7596: Issue Type: Sub-task (was: Bug) Parent: YARN-7069 > Resource configs not parsed correctly

[jira] [Created] (YARN-7596) Resource configs not parsed correctly in MapReduce for resources with dot

2017-12-01 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-7596: --- Summary: Resource configs not parsed correctly in MapReduce for resources with dot Key: YARN-7596 URL: https://issues.apache.org/jira/browse/YARN-7596 Project: Hadoop

[jira] [Commented] (YARN-7443) Add native FPGA module support to do isolation with cgroups

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274772#comment-16274772 ] Wangda Tan commented on YARN-7443: -- Thanks [~tangzhankun], in general patch looks good. One minor

[jira] [Commented] (YARN-7594) TestNMWebServices.testGetNMResourceInfo fails on trunk

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274755#comment-16274755 ] genericqa commented on YARN-7594: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274754#comment-16274754 ] Eric Yang commented on YARN-6669: - In ServiceScheduler.java, the newly introduced code for setting

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274746#comment-16274746 ] Wangda Tan commented on YARN-7522: -- Thanks [~sunilg] for your suggestions. For 1). I suggest to not

[jira] [Commented] (YARN-7242) Support specify values of different resource types in DistributedShell for easier testing

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274727#comment-16274727 ] Wangda Tan commented on YARN-7242: -- Thanks [~GergelyNovak] for filing the JIRA. This will be important for

[jira] [Updated] (YARN-7242) Support specify values of different resource types in DistributedShell for easier testing

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7242: - Priority: Critical (was: Major) > Support specify values of different resource types in DistributedShell

[jira] [Commented] (YARN-5139) [Umbrella] Move YARN scheduler towards global scheduler

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274720#comment-16274720 ] Wangda Tan commented on YARN-5139: -- Thanks [~Tao Yang] for reporting this. I'm glad to see this runs in

[jira] [Commented] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274714#comment-16274714 ] genericqa commented on YARN-4813: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274710#comment-16274710 ] Wangda Tan commented on YARN-7591: -- Thanks [~Tao Yang], Rest of the fixes looks good except #3: bq. (3)

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274708#comment-16274708 ] Eric Yang commented on YARN-7590: - There is currently two proposals to address this issue: h3. Proposals

[jira] [Updated] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7591: - Priority: Critical (was: Major) > NPE in async-scheduling mode of CapacityScheduler >

[jira] [Commented] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274696#comment-16274696 ] Wangda Tan commented on YARN-7005: -- [~Tao Yang], Thanks for working on this fix. Looked at the patch,

[jira] [Commented] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274682#comment-16274682 ] Wangda Tan commented on YARN-7497: -- Moved to children JIRA of YARN-5734. [~jhung], do you have bandwidth

[jira] [Assigned] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-7497: Assignee: Jiandan Yang > Add HDFSSchedulerConfigurationStore for RM HA >

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7497: - Issue Type: Sub-task (was: New Feature) Parent: YARN-5734 > Add HDFSSchedulerConfigurationStore

[jira] [Commented] (YARN-7594) TestNMWebServices.testGetNMResourceInfo fails on trunk

2017-12-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274672#comment-16274672 ] Sunil G commented on YARN-7594: --- pending jenkins.. patch looks good. >

[jira] [Commented] (YARN-7594) TestNMWebServices.testGetNMResourceInfo fails on trunk

2017-12-01 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274664#comment-16274664 ] Gergely Novák commented on YARN-7594: - Attached a trivial patch to solve this. >

[jira] [Updated] (YARN-7589) TestPBImplRecords fails with NullPointerException

2017-12-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7589: --- Attachment: YARN-7589.001.patch Silly oversight on my part. This patch fixes the issue but

[jira] [Commented] (YARN-7594) TestNMWebServices.testGetNMResourceInfo fails on trunk

2017-12-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274652#comment-16274652 ] Sunil G commented on YARN-7594: --- Thanks [~GergelyNovak]. Yes, we are now returning empty json to avoid 500

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-12-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274650#comment-16274650 ] Sunil G commented on YARN-7522: --- Thanks [~leftnoteasy]. Few doubts/comments # As per offline talk with

[jira] [Commented] (YARN-882) Specify per user quota for private/application cache and user log files

2017-12-01 Thread Marcelo Valle Avila (JIRA)
[ https://issues.apache.org/jira/browse/YARN-882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274643#comment-16274643 ] Marcelo Valle Avila commented on YARN-882: -- +1 > Specify per user quota for private/application

[jira] [Commented] (YARN-7455) quote_and_append_arg can overflow buffer

2017-12-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274639#comment-16274639 ] genericqa commented on YARN-7455: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2017-12-01 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-4813: -- Attachment: YARN-4813.003.patch [~rkanter] Thanks, that was definitely missing, I'm uploading a new

[jira] [Updated] (YARN-7455) quote_and_append_arg can overflow buffer

2017-12-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-7455: -- Attachment: YARN-7455.003.patch Uploaded a new patch with changes as suggested by JLowe. Reran tests

[jira] [Updated] (YARN-7581) ATSv2 does not construct HBase filters correctly in HBase 2.0

2017-12-01 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7581: - Description: TestTimelineReaderWebServicesHBaseStorage.testGetEntitiesConfigFilters() and

  1   2   >