[jira] [Updated] (YARN-5765) Revert CHMOD on the new dirs created-LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

2017-01-17 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-5765: --- Fix Version/s: 3.0.0-alpha2 > Revert CHMOD on the new dirs created-LinuxContainerExecutor creat

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2017-01-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827446#comment-15827446 ] Hadoop QA commented on YARN-5928: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-6105) Support for new REST end point /clusterids

2017-01-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6105: Labels: (was: yarn-5355-merge-blocker) > Support for new REST end point /clusterids > -

[jira] [Commented] (YARN-6105) Support for new REST end point /clusterids

2017-01-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827421#comment-15827421 ] Rohith Sharma K S commented on YARN-6105: - bq. Not sure this should be marked as a

[jira] [Updated] (YARN-5910) Support for multi-cluster delegation tokens

2017-01-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5910: -- Attachment: YARN-5910.4.patch fixed failed UT. testRMAppSubmitWithValidTokens is removed, because it's not actu

[jira] [Commented] (YARN-6028) Add document for container metrics

2017-01-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827380#comment-15827380 ] Hadoop QA commented on YARN-6028: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2017-01-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827358#comment-15827358 ] Hadoop QA commented on YARN-5910: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6028) Add document for container metrics

2017-01-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827336#comment-15827336 ] Weiwei Yang commented on YARN-6028: --- Hello [~templedf] Appreciate your help to review th

[jira] [Updated] (YARN-6028) Add document for container metrics

2017-01-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-6028: -- Attachment: YARN-6028.03.patch > Add document for container metrics > --

[jira] [Commented] (YARN-3768) ArrayIndexOutOfBoundsException with empty environment variables

2017-01-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827329#comment-15827329 ] ASF GitHub Bot commented on YARN-3768: -- Github user bellemare commented on the issue:

[jira] [Commented] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827296#comment-15827296 ] Hudson commented on YARN-5831: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1113

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2017-01-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827292#comment-15827292 ] Sangjin Lee commented on YARN-5928: --- Can I ask you a small favor? Could you kindly regene

[jira] [Commented] (YARN-6093) Invalid AMRM token exception when using FederationRMFailoverProxyProvider at AMRMtoken renewal during a RM failover

2017-01-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827238#comment-15827238 ] Subru Krishnan commented on YARN-6093: -- Thanks [~botong] for the patch. At high level,

[jira] [Commented] (YARN-6093) Invalid AMRM token exception when using FederationRMFailoverProxyProvider at AMRMtoken renewal during a RM failover

2017-01-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827223#comment-15827223 ] Hadoop QA commented on YARN-6093: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-6105) Support for new REST end point /clusterids

2017-01-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827214#comment-15827214 ] Joep Rottinghuis commented on YARN-6105: +1 for separate jira, thanks for filing. +

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2017-01-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827213#comment-15827213 ] Sangjin Lee commented on YARN-5928: --- Awesome. Thanks. > Move ATSv2 HBase backend code in

[jira] [Commented] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-17 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827192#comment-15827192 ] Yufei Gu commented on YARN-5831: Thanks [~kasha] for the review and commit. Will wait for Y

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2017-01-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827173#comment-15827173 ] Haibo Chen commented on YARN-5928: -- Yes, I believe so. I have tried the standalone timelin

[jira] [Commented] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827170#comment-15827170 ] Karthik Kambatla commented on YARN-5831: Committed this to trunk, but it didn't app

[jira] [Updated] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5831: --- Fix Version/s: 3.0.0-alpha2 > Propagate allowPreemptionFrom flag all the way down to the app >

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2017-01-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827168#comment-15827168 ] Sangjin Lee commented on YARN-5928: --- Thanks for updating the patch [~haibochen]! I'm goin

[jira] [Commented] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827167#comment-15827167 ] Karthik Kambatla commented on YARN-5831: Checking this in. > Propagate allowPreem

[jira] [Assigned] (YARN-2162) Fair Scheduler :ability to optionally configure minResources and maxResources in terms of percentage

2017-01-17 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-2162: -- Assignee: Yufei Gu > Fair Scheduler :ability to optionally configure minResources and maxResources > in

[jira] [Commented] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827153#comment-15827153 ] Hadoop QA commented on YARN-5831: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-6093) Invalid AMRM token exception when using FederationRMFailoverProxyProvider at AMRMtoken renewal during a RM failover

2017-01-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6093: - Component/s: amrmproxy > Invalid AMRM token exception when using FederationRMFailoverProxyProvider

[jira] [Updated] (YARN-6093) Invalid AMRM token exception when using FederationRMFailoverProxyProvider at AMRMtoken renewal during a RM failover

2017-01-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6093: - Summary: Invalid AMRM token exception when using FederationRMFailoverProxyProvider at AMRMtoken ren

[jira] [Updated] (YARN-6093) Invalid AMRM token exception when using FederationRMFailoverProxyProvider at AMRMtoken renewal during a RM failover

2017-01-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6093: - Fix Version/s: (was: YARN-2915) > Invalid AMRM token exception when using FederationRMFailoverP

[jira] [Updated] (YARN-6093) Invalid AMRM token exception when using FederationRMFailoverProxyProvider at AMRMtoken renewal during a RM failover

2017-01-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6093: - Affects Version/s: YARN-2915 > Invalid AMRM token exception when using FederationRMFailoverProxyPro

[jira] [Comment Edited] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2017-01-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827098#comment-15827098 ] Haibo Chen edited comment on YARN-5928 at 1/18/17 12:06 AM: A n

[jira] [Updated] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2017-01-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5928: - Attachment: YARN-5928-YARN-5355.05.patch A newly rebased patch. > Move ATSv2 HBase backend code into a new

[jira] [Created] (YARN-6106) Add doc for tag 'allowPreemptionFrom' in Fair Scheduler

2017-01-17 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6106: -- Summary: Add doc for tag 'allowPreemptionFrom' in Fair Scheduler Key: YARN-6106 URL: https://issues.apache.org/jira/browse/YARN-6106 Project: Hadoop YARN Issue Type: Imp

[jira] [Commented] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827077#comment-15827077 ] Karthik Kambatla commented on YARN-5831: Yeah, let us track that in a different JIR

[jira] [Commented] (YARN-6076) Backport YARN-4752 (FS preemption changes) to branch-2

2017-01-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827069#comment-15827069 ] Karthik Kambatla commented on YARN-6076: I probably should mention that the backpor

[jira] [Commented] (YARN-5830) Avoid preempting AM containers

2017-01-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827067#comment-15827067 ] Karthik Kambatla commented on YARN-5830: Patch looks mostly good. Few nits: # Sched

[jira] [Commented] (YARN-5966) AMRMClient changes to support ExecutionType update

2017-01-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827042#comment-15827042 ] Subru Krishnan commented on YARN-5966: -- Thanks [~asuresh] for the patch. I looked at i

[jira] [Commented] (YARN-6016) Fix minor bugs in handling of local AMRMToken in AMRMProxy

2017-01-17 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827022#comment-15827022 ] Botong Huang commented on YARN-6016: Thanks Subru and Jian! > Fix minor bugs in handli

[jira] [Commented] (YARN-6076) Backport YARN-4752 (FS preemption changes) to branch-2

2017-01-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827008#comment-15827008 ] Karthik Kambatla commented on YARN-6076: The test failure is, I believe, unrelated.

[jira] [Commented] (YARN-6016) Fix minor bugs in handling of local AMRMToken in AMRMProxy

2017-01-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827004#comment-15827004 ] Hudson commented on YARN-6016: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #1113

[jira] [Commented] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-17 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826987#comment-15826987 ] Yufei Gu commented on YARN-5831: Thanks [~kasha] for the review. Uploaded the patch 005 for

[jira] [Updated] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-17 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5831: --- Attachment: YARN-5831.005.patch > Propagate allowPreemptionFrom flag all the way down to the app >

[jira] [Commented] (YARN-6099) Improve webservice to list aggregated log files

2017-01-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826966#comment-15826966 ] Hadoop QA commented on YARN-6099: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-6016) Fix minor bugs in handling of local AMRMToken in AMRMProxy

2017-01-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6016: - Summary: Fix minor bugs in handling of local AMRMToken in AMRMProxy (was: Bugs in AMRMProxy handli

[jira] [Updated] (YARN-6093) Invalid AMRM token exception when RM renew AMRMtoken and FederationRMFailoverProxyProvider failover

2017-01-17 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6093: --- Attachment: YARN-6093-YARN-2915.v2.patch > Invalid AMRM token exception when RM renew AMRMtoken and >

[jira] [Updated] (YARN-6096) getCpuFrequency for windows returning incorrect value

2017-01-17 Thread Roni Burd (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roni Burd updated YARN-6096: Attachment: yarn-6096-branch-release-2.7.3-RC2.001.patch fix for branch 2.7 > getCpuFrequency for windows re

[jira] [Updated] (YARN-5910) Support for multi-cluster delegation tokens

2017-01-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5910: -- Attachment: YARN-5910.3.patch Fixed jenkins issues > Support for multi-cluster delegation tokens > -

[jira] [Commented] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads

2017-01-17 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826911#comment-15826911 ] Yufei Gu commented on YARN-6061: Thanks [~kasha] for the review. Misunderstanding may be on

[jira] [Commented] (YARN-6028) Add document for container metrics

2017-01-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826908#comment-15826908 ] Daniel Templeton commented on YARN-6028: Thanks, [~cheersyang]. The changes look g

[jira] [Commented] (YARN-6071) Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only)

2017-01-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826878#comment-15826878 ] Wangda Tan commented on YARN-6071: -- Thanks for review and commit! [~templedf] > Fix incom

[jira] [Commented] (YARN-6094) Update the coprocessor to be a dynamically loaded one

2017-01-17 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826864#comment-15826864 ] Vrushali C commented on YARN-6094: -- Thanks [~sjlee0] for the review! Here are some answers

[jira] [Commented] (YARN-6071) Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only)

2017-01-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826858#comment-15826858 ] Hudson commented on YARN-6071: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #1112

[jira] [Commented] (YARN-6099) Improve webservice to list aggregated log files

2017-01-17 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826788#comment-15826788 ] Xuan Gong commented on YARN-6099: - Upload one patch for trunk and one patch for branch-2 to

[jira] [Commented] (YARN-6071) Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only)

2017-01-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826789#comment-15826789 ] Daniel Templeton commented on YARN-6071: Thank for the patch, [~leftnoteasy]! Look

[jira] [Updated] (YARN-6099) Improve webservice to list aggregated log files

2017-01-17 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6099: Attachment: YARN-6099.branch-2.v2.patch > Improve webservice to list aggregated log files > -

[jira] [Updated] (YARN-6099) Improve webservice to list aggregated log files

2017-01-17 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6099: Attachment: YARN-6099.trunk.2.patch > Improve webservice to list aggregated log files > -

[jira] [Commented] (YARN-6076) Backport YARN-4752 (FS preemption changes) to branch-2

2017-01-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826765#comment-15826765 ] Hadoop QA commented on YARN-6076: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (YARN-6105) Support for new REST end point /clusterids

2017-01-17 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-6105: --- Summary: Support for new REST end point /clusterids Key: YARN-6105 URL: https://issues.apache.org/jira/browse/YARN-6105 Project: Hadoop YARN Issue Type

[jira] [Commented] (YARN-6095) create a REST API that returns the clusters for a given app id

2017-01-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826725#comment-15826725 ] Rohith Sharma K S commented on YARN-6095: - bq. In either case, that should be a sep

[jira] [Commented] (YARN-6095) create a REST API that returns the clusters for a given app id

2017-01-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826724#comment-15826724 ] Varun Saxena commented on YARN-6095: bq. In either case, that should be a separate jira

[jira] [Commented] (YARN-6094) Update the coprocessor to be a dynamically loaded one

2017-01-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826665#comment-15826665 ] Sangjin Lee commented on YARN-6094: --- Thanks for the patch [~vrushalic]! As for the unit

[jira] [Commented] (YARN-6104) RegistrySecurity overrides zookeeper sasl system properties

2017-01-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826663#comment-15826663 ] Hadoop QA commented on YARN-6104: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-6095) create a REST API that returns the clusters for a given app id

2017-01-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826652#comment-15826652 ] Joep Rottinghuis commented on YARN-6095: Just to make sure we capture part of the d

[jira] [Updated] (YARN-6104) RegistrySecurity overrides zookeeper sasl system properties

2017-01-17 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6104: - Attachment: YARN-6104.002.patch Added unit test. > RegistrySecurity overrides zookeeper sasl syste

[jira] [Updated] (YARN-6103) Log updates for ZKRMStateStore

2017-01-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6103: --- Assignee: Daniel Sturman > Log updates for ZKRMStateStore > -- > >

[jira] [Commented] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2017-01-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826581#comment-15826581 ] Daniel Templeton commented on YARN-3637: Thanks for the patch, [~ctrezzo]. A coupl

[jira] [Comment Edited] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826542#comment-15826542 ] Karthik Kambatla edited comment on YARN-5831 at 1/17/17 6:22 PM:

[jira] [Commented] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826542#comment-15826542 ] Karthik Kambatla commented on YARN-5831: Patch is looking good. A few nits: # FSQue

[jira] [Commented] (YARN-4212) FairScheduler: Parent queues is not allowed to be 'Fair' policy if its children have the "drf" policy

2017-01-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826533#comment-15826533 ] Karthik Kambatla commented on YARN-4212: # SchedulingPolicy ## allowedParentPolicie

[jira] [Commented] (YARN-6104) RegistrySecurity overrides zookeeper sasl system properties

2017-01-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826526#comment-15826526 ] Hadoop QA commented on YARN-6104: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-6104) RegistrySecurity overrides zookeeper sasl system properties

2017-01-17 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6104: - Attachment: YARN-6104.001.patch > RegistrySecurity overrides zookeeper sasl system properties > ---

[jira] [Updated] (YARN-3884) RMContainerImpl transition from RESERVED to KILL apphistory status not updated

2017-01-17 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3884: --- Attachment: YARN-3884.0006.patch Attaching patch after rebase > RMContainerImpl transition fro

[jira] [Updated] (YARN-5641) Localizer leaves behind tarballs after container is complete

2017-01-17 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5641: -- Attachment: YARN-5641.007.patch Previous patch did some things that JUnit didn't like. This patch fixes t

[jira] [Created] (YARN-6104) RegistrySecurity overrides zookeeper sasl system properties

2017-01-17 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-6104: Summary: RegistrySecurity overrides zookeeper sasl system properties Key: YARN-6104 URL: https://issues.apache.org/jira/browse/YARN-6104 Project: Hadoop YARN

[jira] [Updated] (YARN-6103) Log updates for ZKRMStateStore

2017-01-17 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6103: --- Summary: Log updates for ZKRMStateStore (was: Logging update for ZKRMStateStore) > Log update

[jira] [Created] (YARN-6103) Logging update for ZKRMStateStore

2017-01-17 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-6103: -- Summary: Logging update for ZKRMStateStore Key: YARN-6103 URL: https://issues.apache.org/jira/browse/YARN-6103 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-6046) Documentation correction in YarnApplicationSecurity

2017-01-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6046: --- Assignee: Prashant Jha (was: Daniel Templeton) > Documentation correction in YarnApplicationSe

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-17 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826411#comment-15826411 ] Bibin A Chundatt commented on YARN-6072: [~zhz] {quote} does branch-2.7 have the i

[jira] [Commented] (YARN-5972) Support Pausing/Freezing of opportunistic containers

2017-01-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826339#comment-15826339 ] Arun Suresh commented on YARN-5972: --- My opinion is that PAUSED state should not be handle

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2017-01-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826046#comment-15826046 ] Hadoop QA commented on YARN-5889: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-01-17 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6102: --- Summary: On failover RM can crash due to unregistered event to AsyncDispatcher (was: RM can cr

[jira] [Updated] (YARN-6102) RM can crash due to unregistered event to AsyncDispatcher on transitionToStandby

2017-01-17 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6102: --- Summary: RM can crash due to unregistered event to AsyncDispatcher on transitionToStandby (was

[jira] [Commented] (YARN-6064) Support fromId for flowRuns and flow/flowRun apps REST API's

2017-01-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825939#comment-15825939 ] Varun Saxena commented on YARN-6064: Thanks [~rohithsharma] for the latest patch. LGTM.

[jira] [Updated] (YARN-5889) Improve user-limit calculation in capacity scheduler

2017-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5889: -- Attachment: YARN-5889.0005.patch Thanks [~leftnoteasy] Attaching new patch addressing the comments. > Improve us

[jira] [Commented] (YARN-6017) node manager physical memory leak

2017-01-17 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825870#comment-15825870 ] chenrongwei commented on YARN-6017: --- Thanks for Bibin A Chundatt 's answer. we used jdk 1

[jira] [Commented] (YARN-5188) FairScheduler performance bug

2017-01-17 Thread ChenFolin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825864#comment-15825864 ] ChenFolin commented on YARN-5188: - Hi, zhengchenyu I think just add a usage lock may resol

[jira] [Commented] (YARN-5830) Avoid preempting AM containers

2017-01-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825859#comment-15825859 ] Hadoop QA commented on YARN-5830: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-01-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825842#comment-15825842 ] Naganarasimha G R commented on YARN-6102: - To add to [~ajithshetty] 's point, Stopp

[jira] [Commented] (YARN-6017) node manager physical memory leak

2017-01-17 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825841#comment-15825841 ] Bibin A Chundatt commented on YARN-6017: [~chenrongwei] Any update on issue after t

[jira] [Updated] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-01-17 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated YARN-6102: -- Attachment: eventOrder.JPG attaching event order for reference > On failover RM can crash due to unregistered ev

[jira] [Commented] (YARN-5188) FairScheduler performance bug

2017-01-17 Thread ChenFolin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825820#comment-15825820 ] ChenFolin commented on YARN-5188: - zhangyubiao, It is ok. > FairScheduler performance bug

[jira] [Comment Edited] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-01-17 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825803#comment-15825803 ] Ajith S edited comment on YARN-6102 at 1/17/17 10:31 AM: - [~rohiths

[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-01-17 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825803#comment-15825803 ] Ajith S commented on YARN-6102: --- [~rohithsharma] As i mentioned, the nodeheart beat has been

[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825802#comment-15825802 ] Sunil G commented on YARN-6102: --- In resetDispatcher, {code} (1)removeService((Service)rmD

[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-01-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825774#comment-15825774 ] Rohith Sharma K S commented on YARN-6102: - Before dispatcher reset, active services

[jira] [Commented] (YARN-5830) Avoid preempting AM containers

2017-01-17 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825753#comment-15825753 ] Yufei Gu commented on YARN-5830: [~kasha], thanks a lot for your detailed review. Uploaded

[jira] [Updated] (YARN-5830) Avoid preempting AM containers

2017-01-17 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5830: --- Attachment: YARN-5830.004.patch > Avoid preempting AM containers > -- > >

[jira] [Commented] (YARN-5378) Accommodate app-id->cluster mapping

2017-01-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825742#comment-15825742 ] Varun Saxena commented on YARN-5378: We can probably move over this discussion to YARN-

[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-01-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825734#comment-15825734 ] Naganarasimha G R commented on YARN-6102: - Good catch [~ajithshetty], But i would n

[jira] [Updated] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-01-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6102: Target Version/s: 2.8.0 > On failover RM can crash due to unregistered event to AsyncDispatch

[jira] [Comment Edited] (YARN-5378) Accommodate app-id->cluster mapping

2017-01-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825717#comment-15825717 ] Varun Saxena edited comment on YARN-5378 at 1/17/17 9:38 AM: - b

[jira] [Updated] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-01-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6102: Affects Version/s: 2.8.0 2.7.3 > On failover RM can crash due to unreg

  1   2   >