[jira] [Commented] (YARN-2162) Fair Scheduler :ability to optionally configure minResources and maxResources in terms of percentage

2017-08-01 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109622#comment-16109622 ] Yufei Gu commented on YARN-2162: The test failures are unrelated. > Fair Scheduler :ability to optionally

[jira] [Commented] (YARN-6895) [FairScheduler] Preemption reservation may cause regular reservation leaks

2017-08-01 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109616#comment-16109616 ] Yufei Gu commented on YARN-6895: Thanks [~miklos.szeg...@cloudera.com] for the patch. One question, if a

[jira] [Commented] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109563#comment-16109563 ] Hadoop QA commented on YARN-6872: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-01 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109558#comment-16109558 ] Varun Saxena commented on YARN-6130: Seems that patch wont be picked up by Hadoop QA for

[jira] [Commented] (YARN-2162) Fair Scheduler :ability to optionally configure minResources and maxResources in terms of percentage

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109550#comment-16109550 ] Hadoop QA commented on YARN-2162: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109546#comment-16109546 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109539#comment-16109539 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-01 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6130: --- Attachment: YARN-6130-YARN-5355-branch-2.01.patch > [ATSv2 Security] Generate a delegation token for

[jira] [Updated] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-08-01 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6102: --- Attachment: YARN-6102-YARN-5355-branch-2.addendum.patch > RMActiveService context to be updated with

[jira] [Commented] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-08-01 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109510#comment-16109510 ] Varun Saxena commented on YARN-6102: Cherry picked this to YARN-5355-branch-2 too (along with branch-2

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-01 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: YARN-6900-YARN-2915-001.patch > ZooKeeper based implementation of the FederationStateStore >

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-01 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: (was: YARN-6900-YARN-2915-001.patch) > ZooKeeper based implementation of the

[jira] [Updated] (YARN-6903) Yarn-native-service framework core rewrite

2017-08-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6903: -- Attachment: YARN-6903.yarn-native-services.02.patch > Yarn-native-service framework core rewrite >

[jira] [Updated] (YARN-6903) Yarn-native-service framework core rewrite

2017-08-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6903: -- Attachment: (was: YARN-6903.yarn-native-services.02.patch) > Yarn-native-service framework core rewrite >

[jira] [Updated] (YARN-6903) Yarn-native-service framework core rewrite

2017-08-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6903: -- Attachment: YARN-6903.yarn-native-services.02.patch v2 fix some jenkins issues > Yarn-native-service framework

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.019.patch Quickly updating patch after addressing lock related comments from

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-01 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: YARN-6900-YARN-2915-001.patch > ZooKeeper based implementation of the FederationStateStore >

[jira] [Commented] (YARN-6901) A CapacityScheduler app->LeafQueue deadlock found in branch-2.8

2017-08-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109445#comment-16109445 ] Wangda Tan commented on YARN-6901: -- [~jlowe], You're right, I checked the code of the problematic

[jira] [Updated] (YARN-6901) A CapacityScheduler app->LeafQueue deadlock found in branch-2.8

2017-08-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6901: - Priority: Critical (was: Blocker) > A CapacityScheduler app->LeafQueue deadlock found in branch-2.8 >

[jira] [Assigned] (YARN-6874) TestHBaseStorageFlowRun.testWriteFlowRunMinMax fails intermittently

2017-08-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C reassigned YARN-6874: Assignee: Vrushali C > TestHBaseStorageFlowRun.testWriteFlowRunMinMax fails intermittently >

[jira] [Commented] (YARN-6874) TestHBaseStorageFlowRun.testWriteFlowRunMinMax fails intermittently

2017-08-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109434#comment-16109434 ] Vrushali C commented on YARN-6874: -- This seems to be happening often enough now. Also saw this in the

[jira] [Updated] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6872: -- Attachment: YARN-6872-addendum.001.patch when we use non-exclusive node labels also we could get same issue.

[jira] [Commented] (YARN-6876) Create an abstract log writer for extendability

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109423#comment-16109423 ] Hadoop QA commented on YARN-6876: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5349) TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittently

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109399#comment-16109399 ] Hadoop QA commented on YARN-5349: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-08-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109380#comment-16109380 ] Hudson commented on YARN-6872: -- ABORTED: Integrated in Jenkins build Hadoop-trunk-Commit #12090 (See

[jira] [Updated] (YARN-2162) Fair Scheduler :ability to optionally configure minResources and maxResources in terms of percentage

2017-08-01 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-2162: --- Attachment: YARN-2162.002.patch Uploaded patch v2 to address style issues and the unit test failure. > Fair

[jira] [Commented] (YARN-6322) Disable queue refresh when configuration mutation is enabled

2017-08-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109356#comment-16109356 ] Jonathan Hung commented on YARN-6322: - Thanks Xuan! > Disable queue refresh when configuration

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109343#comment-16109343 ] Vrushali C commented on YARN-6820: -- Will add the license to the new unit test file I added in this patch.

[jira] [Commented] (YARN-6920) fix TestNMClient failure due to YARN-6706

2017-08-01 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109281#comment-16109281 ] Haibo Chen commented on YARN-6920: -- Sure. Will take a look. > fix TestNMClient failure due to YARN-6706 >

[jira] [Commented] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109277#comment-16109277 ] Sunil G commented on YARN-6872: --- Test case failures are known. > Ensure apps could run given NodeLabels are

[jira] [Updated] (YARN-6921) Allow resource request to opt out of oversubscription

2017-08-01 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6921: - Issue Type: Sub-task (was: Task) Parent: YARN-1011 > Allow resource request to opt out of

[jira] [Created] (YARN-6921) Allow resource request to opt out of oversubscription

2017-08-01 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6921: Summary: Allow resource request to opt out of oversubscription Key: YARN-6921 URL: https://issues.apache.org/jira/browse/YARN-6921 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-6861) Reader API for sub application entities

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109260#comment-16109260 ] Hadoop QA commented on YARN-6861: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6802) Add Max AM Resource and AM Resource Usage to Leaf Queue View in FairScheduler WebUI

2017-08-01 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109246#comment-16109246 ] Yufei Gu commented on YARN-6802: Hi [~daemon], it doesn't apply since HADOOP-1187 is not in branch-2. >

[jira] [Comment Edited] (YARN-6920) fix TestNMClient failure due to YARN-6706

2017-08-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109197#comment-16109197 ] Arun Suresh edited comment on YARN-6920 at 8/1/17 4:31 PM: --- It looks like its

[jira] [Updated] (YARN-5349) TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittently

2017-08-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5349: - Attachment: YARN-5349.001.patch Attaching a patch that accounts for containers potentially being allocated

[jira] [Assigned] (YARN-5349) TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittently

2017-08-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-5349: Assignee: Jason Lowe Affects Version/s: 2.8.1 Target Version/s: 2.8.2 >

[jira] [Commented] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-08-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109213#comment-16109213 ] Daniel Templeton commented on YARN-6909: Either way is fine with me. > The performance advantages

[jira] [Updated] (YARN-6920) fix TestNMClient failure due to YARN-6706

2017-08-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6920: -- Summary: fix TestNMClient failure due to YARN-6706 (was: fix TestNMClient failure) > fix TestNMClient

[jira] [Commented] (YARN-6920) fix TestNMClient failure

2017-08-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109197#comment-16109197 ] Arun Suresh commented on YARN-6920: --- It looks like its been failing after YARN-6706. [~haibo.chen] Can

[jira] [Created] (YARN-6920) fix TestNMClient failure

2017-08-01 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-6920: - Summary: fix TestNMClient failure Key: YARN-6920 URL: https://issues.apache.org/jira/browse/YARN-6920 Project: Hadoop YARN Issue Type: Bug Reporter:

[jira] [Updated] (YARN-6876) Create an abstract log writer for extendability

2017-08-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6876: Attachment: YARN-6876-trunk.002.patch > Create an abstract log writer for extendability >

[jira] [Commented] (YARN-6875) New aggregated log file format for YARN log aggregation.

2017-08-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109148#comment-16109148 ] Xuan Gong commented on YARN-6875: - Thanks for the suggestion. [~leftnoteasy] The approach looks fine. But

[jira] [Commented] (YARN-6322) Disable queue refresh when configuration mutation is enabled

2017-08-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109134#comment-16109134 ] Xuan Gong commented on YARN-6322: - Committed into YARN-5734 branch. Thanks, Jonathan! > Disable queue

[jira] [Updated] (YARN-6861) Reader API for sub application entities

2017-08-01 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6861: Attachment: YARN-6861-YARN-5355.002.patch As per discussion offline with Varun and Vrushali,

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-08-01 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109100#comment-16109100 ] Konstantinos Karanasos commented on YARN-6593: -- Thanks for the feedback, [~jianhe]. bq.

[jira] [Commented] (YARN-6494) add mounting of HDFS Short-Circuit path for docker containers

2017-08-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109066#comment-16109066 ] Eric Badger commented on YARN-6494: --- bq. It seems there are several use cases where a default bind list

[jira] [Commented] (YARN-6494) add mounting of HDFS Short-Circuit path for docker containers

2017-08-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109065#comment-16109065 ] Shane Kumpf commented on YARN-6494: --- [~ebadger] thanks for the feedback and I agree with your points.

[jira] [Created] (YARN-6919) Add default volume mount list

2017-08-01 Thread Eric Badger (JIRA)
Eric Badger created YARN-6919: - Summary: Add default volume mount list Key: YARN-6919 URL: https://issues.apache.org/jira/browse/YARN-6919 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-6789) new api to get all supported resources from RM

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109057#comment-16109057 ] Sunil G commented on YARN-6789: --- cc/ [~leftnoteasy] > new api to get all supported resources from RM >

[jira] [Updated] (YARN-6918) YarnAuthorizationProvider remove permission on queue delete

2017-08-01 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6918: --- Description: On queue removal during refresh acls need to removed from Yarn >

[jira] [Updated] (YARN-6918) YarnAuthorizationProvider remove permission on queue delete

2017-08-01 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6918: --- Description: On queue removal during refresh acl for deleted queue need to removed from

[jira] [Commented] (YARN-6914) Application application_1501553373419_0001 failed 2 times due to AM Container for appattempt_1501553373419_0001_000002 exited with exitCode: -1000

2017-08-01 Thread abhishek bharani (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109048#comment-16109048 ] abhishek bharani commented on YARN-6914: Below is the information from NM Logs : 2017-08-01

[jira] [Created] (YARN-6918) YarnAuthorizationProvider remove permission on queue delete

2017-08-01 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-6918: -- Summary: YarnAuthorizationProvider remove permission on queue delete Key: YARN-6918 URL: https://issues.apache.org/jira/browse/YARN-6918 Project: Hadoop YARN

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109045#comment-16109045 ] Sunil G commented on YARN-6788: --- Test case failures are not related cc/ [~leftnoteasy] [~templedf] >

[jira] [Updated] (YARN-6789) new api to get all supported resources from RM

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6789: -- Attachment: YARN-6789-YARN-3926.001.patch > new api to get all supported resources from RM >

[jira] [Updated] (YARN-6789) new api to get all supported resources from RM

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6789: -- Attachment: (was: YARN-6789.001.patch) > new api to get all supported resources from RM >

[jira] [Updated] (YARN-6789) new api to get all supported resources from RM

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6789: -- Attachment: YARN-6789.001.patch Attaching an initial version of patch. > new api to get all supported resources

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109033#comment-16109033 ] Hadoop QA commented on YARN-6788: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6916) Moving logging APIs over to slf4j in hadoop-yarn-server-common

2017-08-01 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109001#comment-16109001 ] Bibin A Chundatt commented on YARN-6916: [~ajisakaa] Could you rebase the patch > Moving logging

[jira] [Commented] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-08-01 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108993#comment-16108993 ] Bibin A Chundatt commented on YARN-6872: {quote} During recovery of containers from node manager,

[jira] [Commented] (YARN-6914) Application application_1501553373419_0001 failed 2 times due to AM Container for appattempt_1501553373419_0001_000002 exited with exitCode: -1000

2017-08-01 Thread abhishek bharani (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108990#comment-16108990 ] abhishek bharani commented on YARN-6914: /Users/abhishekbharani/Desktop/nodemanager.log >

[jira] [Issue Comment Deleted] (YARN-6914) Application application_1501553373419_0001 failed 2 times due to AM Container for appattempt_1501553373419_0001_000002 exited with exitCode: -1000

2017-08-01 Thread abhishek bharani (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] abhishek bharani updated YARN-6914: --- Comment: was deleted (was: /Users/abhishekbharani/Desktop/nodemanager.log) > Application

[jira] [Commented] (YARN-6494) add mounting of HDFS Short-Circuit path for docker containers

2017-08-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108978#comment-16108978 ] Eric Badger commented on YARN-6494: --- bq. At a minimum, we'd need the ability to turn this off for

[jira] [Created] (YARN-6917) Queue path is recomputed from scratch on every allocation

2017-08-01 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-6917: Summary: Queue path is recomputed from scratch on every allocation Key: YARN-6917 URL: https://issues.apache.org/jira/browse/YARN-6917 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6901) A CapacityScheduler app->LeafQueue deadlock found in branch-2.8

2017-08-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108904#comment-16108904 ] Jason Lowe commented on YARN-6901: -- bq. This may not be possible, ideally moving an app from one queue to

[jira] [Commented] (YARN-5648) [ATSv2 Security] Client side changes for authentication

2017-08-01 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108893#comment-16108893 ] Varun Saxena commented on YARN-5648: Had to add an addendum for YARN-5355-branch-2. Attaching the patch

[jira] [Updated] (YARN-5648) [ATSv2 Security] Client side changes for authentication

2017-08-01 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5648: --- Attachment: YARN-5648-YARN-5355-branch-2.addendum.01.patch > [ATSv2 Security] Client side changes for

[jira] [Commented] (YARN-6894) RM Apps API returns only active apps when query parameter queue used

2017-08-01 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108883#comment-16108883 ] Gergely Novák commented on YARN-6894: - It's kind of logical, that if you define the _queue_ parameter

[jira] [Commented] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108810#comment-16108810 ] Hadoop QA commented on YARN-6872: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5219) When an export var command fails in launch_container.sh, the full container launch should fail

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108807#comment-16108807 ] Hadoop QA commented on YARN-5219: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5219) When an export var command fails in launch_container.sh, the full container launch should fail

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5219: -- Attachment: YARN-5219.007.patch Thanks [~suma.shivaprasad] Updating new patch as per the comments > When an

[jira] [Commented] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108730#comment-16108730 ] Sunil G commented on YARN-5742: --- Kicking this jira again. For YARN UI, there is an ongoing work for showing

[jira] [Resolved] (YARN-6898) RM node labels page should display total used resources of each label.

2017-08-01 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R resolved YARN-6898. - Resolution: Won't Fix As discussed above, this information is already available in the

[jira] [Updated] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6872: -- Attachment: YARN-6872.003.patch During recovery of containers from node manager, if the recovered container has

[jira] [Commented] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108700#comment-16108700 ] Hadoop QA commented on YARN-6872: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6872: -- Attachment: YARN-6872.002.patch Attaching new patch addressing Jian's comments > Ensure apps could run given

[jira] [Commented] (YARN-6505) Define the strings used in SLS JSON input file format

2017-08-01 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108614#comment-16108614 ] Gergely Novák commented on YARN-6505: - Thanks [~yufeigu] for your comments, I addressed them all: # IMO

[jira] [Commented] (YARN-6505) Define the strings used in SLS JSON input file format

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108606#comment-16108606 ] Hadoop QA commented on YARN-6505: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6802) Add Max AM Resource and AM Resource Usage to Leaf Queue View in FairScheduler WebUI

2017-08-01 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108575#comment-16108575 ] YunFan Zhou commented on YARN-6802: --- [~yufeigu] Hi Yufei, I tested it and found that my patch seems to be

[jira] [Updated] (YARN-6505) Define the strings used in SLS JSON input file format

2017-08-01 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-6505: Labels: incompatible newbie (was: newbie) > Define the strings used in SLS JSON input file format >

[jira] [Updated] (YARN-6505) Define the strings used in SLS JSON input file format

2017-08-01 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-6505: Attachment: YARN-6505.003.patch > Define the strings used in SLS JSON input file format >

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108544#comment-16108544 ] Hadoop QA commented on YARN-6820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108522#comment-16108522 ] Hadoop QA commented on YARN-6820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5977) ContainerManagementProtocol changes to support change of container ExecutionType

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108515#comment-16108515 ] Hadoop QA commented on YARN-5977: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6916) Moving logging APIs over to slf4j in hadoop-yarn-server-common

2017-08-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108488#comment-16108488 ] Hadoop QA commented on YARN-6916: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6916) Moving logging APIs over to slf4j in hadoop-yarn-server-common

2017-08-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6916: Attachment: YARN-6712.01.patch > Moving logging APIs over to slf4j in hadoop-yarn-server-common >

[jira] [Created] (YARN-6916) Moving logging APIs over to slf4j in hadoop-yarn-server-common

2017-08-01 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created YARN-6916: --- Summary: Moving logging APIs over to slf4j in hadoop-yarn-server-common Key: YARN-6916 URL: https://issues.apache.org/jira/browse/YARN-6916 Project: Hadoop YARN

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-08-01 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108487#comment-16108487 ] YunFan Zhou commented on YARN-6842: --- [~Naganarasimha] Thank Naganarasimha G R. Maybe I do need a

[jira] [Assigned] (YARN-6712) Moving logging APIs over to slf4j in hadoop-yarn

2017-08-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned YARN-6712: --- Assignee: (was: Akira Ajisaka) Summary: Moving logging APIs over to slf4j in

[jira] [Commented] (YARN-6712) Moving logging APIs over to slf4j in hadoop-yarn-server-common

2017-08-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108482#comment-16108482 ] Akira Ajisaka commented on YARN-6712: - Given YARN-6873 is a sub-task of this issue, I'll make this

[jira] [Commented] (YARN-6898) RM node labels page should display total used resources of each label.

2017-08-01 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108479#comment-16108479 ] YunFan Zhou commented on YARN-6898: --- [~sunilg] [~Naganarasimha] Thanks a lot. According to your

[jira] [Updated] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6820: - Attachment: YARN-6820-YARN-5355.0001.patch > Restrict read access to timelineservice v2 data >

[jira] [Updated] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6820: - Attachment: (was: YARN-6820-YARN-5355.0001.patch) > Restrict read access to timelineservice v2 data >

[jira] [Commented] (YARN-3254) HealthReport should include disk full information

2017-08-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108472#comment-16108472 ] Sunil G commented on YARN-3254: --- In {{DirectoryCollection.isDiskUsageOverPercentageLimit()}}, we use

[jira] [Updated] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6820: - Attachment: YARN-6820-YARN-5355.0001.patch > Restrict read access to timelineservice v2 data >

[jira] [Updated] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6820: - Attachment: (was: YARN-6888-YARN-5355.0001.patch) > Restrict read access to timelineservice v2 data >

[jira] [Updated] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6820: - Attachment: YARN-6888-YARN-5355.0001.patch Attaching v 001. Looking for early feedback on the

[jira] [Commented] (YARN-6873) Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryservice

2017-08-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108460#comment-16108460 ] Akira Ajisaka commented on YARN-6873: - +1 for adding a helper method. Thanks Wenxin. > Moving logging

[jira] [Commented] (YARN-6873) Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryservice

2017-08-01 Thread Wenxin He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108458#comment-16108458 ] Wenxin He commented on YARN-6873: - Is it a good idea to add a helper method in hadoop-common to determine

<    1   2   3   >