[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263926#comment-16263926 ] Hadoop QA commented on YARN-7213: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263883#comment-16263883 ] Hadoop QA commented on YARN-6669: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263882#comment-16263882 ] Hadoop QA commented on YARN-6647: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-22 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263818#comment-16263818 ] Bibin A Chundatt edited comment on YARN-6647 at 11/23/17 6:17 AM: -- Thank

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263850#comment-16263850 ] Haibo Chen commented on YARN-7213: -- The patch includes changes to the final HBase FilterList that is built

[jira] [Updated] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7213: - Attachment: YARN-7213.prelim.patch > [Umbrella] Test and validate HBase-2.0.x with Atsv2 >

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263838#comment-16263838 ] Haibo Chen commented on YARN-7213: -- Sorry for the delay, [~openinx]. The issue turns out to be a misuse of

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Description: Changes include: - Make registry client to programmatically generate the jaas conf for secure

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.06.patch fixed the findbugs warning > Support security for YARN service framework >

[jira] [Commented] (YARN-7544) Configuration cleanup associated to support absolute resources in a queue

2017-11-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263827#comment-16263827 ] Sunil G commented on YARN-7544: --- Yes. TestNodeLabelContainerAllocation failures are not related. There is an

[jira] [Updated] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-22 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6647: --- Attachment: YARN-6647.004.patch > RM can crash during transitionToStandby due to

[jira] [Updated] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-22 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6647: --- Attachment: (was: YARN-6647.004.patch) > RM can crash during transitionToStandby due to

[jira] [Updated] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-22 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6647: --- Attachment: YARN-6647.004.patch Thank you [~jlowe] for review *Change in latest patch* #

[jira] [Commented] (YARN-7559) TestNodeLabelContainerAllocation failing intermittently

2017-11-22 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263806#comment-16263806 ] Bibin A Chundatt commented on YARN-7559: Duplicate of YARN-7507 > TestNodeLabelContainerAllocation

[jira] [Commented] (YARN-7290) canContainerBePreempted can return true when it shouldn't

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263800#comment-16263800 ] Hadoop QA commented on YARN-7290: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-11-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263778#comment-16263778 ] Arun Suresh commented on YARN-6483: --- Actually - closing this for now. The branch-2 version might need

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-11-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6483: -- Target Version/s: 3.1.0 (was: 3.1.0, 2.9.1) > Add nodes transitioning to DECOMMISSIONING state to the

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-11-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263759#comment-16263759 ] Arun Suresh commented on YARN-6483: --- Committed this to trunk and branch-3.0 Will cherry-pick this to

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-11-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6483: -- Affects Version/s: (was: 3.1.0) Target Version/s: 3.1.0, 2.9.1 > Add nodes transitioning to

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-11-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263757#comment-16263757 ] Hudson commented on YARN-6483: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13274 (See

[jira] [Commented] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263756#comment-16263756 ] Yufei Gu commented on YARN-7541: Thanks for working on this, [~templedf]. The logic looks perfect to me.

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263750#comment-16263750 ] Hadoop QA commented on YARN-7556: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-11-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6483: -- Summary: Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the

[jira] [Created] (YARN-7559) TestNodeLabelContainerAllocation failing intermittently

2017-11-22 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7559: - Summary: TestNodeLabelContainerAllocation failing intermittently Key: YARN-7559 URL: https://issues.apache.org/jira/browse/YARN-7559 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7330) Add support to show GPU in UI including metrics

2017-11-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263711#comment-16263711 ] Hudson commented on YARN-7330: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13273 (See

[jira] [Updated] (YARN-7290) canContainerBePreempted can return true when it shouldn't

2017-11-22 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Rand updated YARN-7290: -- Attachment: YARN-7290.005.patch Thanks, [~yufeigu]. Attaching a new patch which removes the list of

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263698#comment-16263698 ] Eric Yang commented on YARN-5534: - [~ebadger] This is currently committed to trunk (3.1.0). > Allow user

[jira] [Updated] (YARN-5534) Allow user provided Docker volume mount list

2017-11-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-5534: Fix Version/s: 3.1.0 > Allow user provided Docker volume mount list >

[jira] [Updated] (YARN-7330) Add support to show GPU in UI including metrics

2017-11-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7330: -- Summary: Add support to show GPU in UI including metrics (was: Add support to show GPU on UI/metrics) > Add

[jira] [Commented] (YARN-7538) Performance improvement related to absolute min-max resources

2017-11-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263679#comment-16263679 ] Sunil G commented on YARN-7538: --- Thanks [~leftnoteasy], Changes seems fine. I am checking the reason for

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263673#comment-16263673 ] Hadoop QA commented on YARN-6669: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7290) canContainerBePreempted can return true when it shouldn't

2017-11-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263655#comment-16263655 ] Yufei Gu commented on YARN-7290: Thanks for the new patch, [~Steven Rand]. I like the idea to put the map

[jira] [Updated] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-11-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7556: --- Attachment: YARN-7556.003.patch Fixed whitespace and checkstyle and one of the unit test

[jira] [Updated] (YARN-7558) YARN log command fails to get logs for running containers if the url authentication is enabled.

2017-11-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7558: - Target Version/s: 2.9.1, 3.0.1 > YARN log command fails to get logs for running containers if the url >

[jira] [Assigned] (YARN-7558) YARN log command fails to get logs for running containers if the url authentication is enabled.

2017-11-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-7558: --- Assignee: Xuan Gong > YARN log command fails to get logs for running containers if the url >

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263642#comment-16263642 ] Hadoop QA commented on YARN-7556: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7558) YARN log command fails to get logs for running containers if the url authentication is enabled.

2017-11-22 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-7558: --- Summary: YARN log command fails to get logs for running containers if the url authentication is enabled. Key: YARN-7558 URL: https://issues.apache.org/jira/browse/YARN-7558

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263640#comment-16263640 ] Hadoop QA commented on YARN-7556: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Description: Changes include: - Make registry client to programmatically generate the jaas conf for secure

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.05.patch Added the security implementation between client and AM, client and AM uses

[jira] [Commented] (YARN-7524) Remove unused FairSchedulerEventLog

2017-11-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263587#comment-16263587 ] Wilfred Spiegelenburg commented on YARN-7524: - thank you for the commit [~yufeigu] > Remove

[jira] [Updated] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-11-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7556: --- Attachment: YARN-7556.002.patch Whoops. Got ahead of myself. Patch #1 wasn't complete. >

[jira] [Created] (YARN-7557) It should be possible to specify resource types in the fair scheduler increment value

2017-11-22 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7557: -- Summary: It should be possible to specify resource types in the fair scheduler increment value Key: YARN-7557 URL: https://issues.apache.org/jira/browse/YARN-7557

[jira] [Updated] (YARN-7555) Support multiple resource types in YARN native services

2017-11-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7555: - Attachment: YARN-7555.wip-001.patch Attached ver.1 WIP patch. > Support multiple resource types in YARN

[jira] [Commented] (YARN-7538) Performance improvement related to absolute min-max resources

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263532#comment-16263532 ] Hadoop QA commented on YARN-7538: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7495) Improve robustness of the AggregatedLogDeletionService

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263531#comment-16263531 ] Hadoop QA commented on YARN-7495: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-11-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7556: --- Attachment: YARN-7556.001.patch > Fair scheduler configuration should allow resource types in

[jira] [Created] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-11-22 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7556: -- Summary: Fair scheduler configuration should allow resource types in the minResources and maxResources properties Key: YARN-7556 URL:

[jira] [Created] (YARN-7555) Support multiple resource types in YARN native services

2017-11-22 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7555: Summary: Support multiple resource types in YARN native services Key: YARN-7555 URL: https://issues.apache.org/jira/browse/YARN-7555 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263487#comment-16263487 ] Hadoop QA commented on YARN-7541: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7524) Remove unused FairSchedulerEventLog

2017-11-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263481#comment-16263481 ] Hudson commented on YARN-7524: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13272 (See

[jira] [Commented] (YARN-7491) Make sure AM is not scheduled on an opportunistic container

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263447#comment-16263447 ] Hadoop QA commented on YARN-7491: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263428#comment-16263428 ] Eric Badger commented on YARN-5534: --- [~eyang], can you set the fix version for the branches that you

[jira] [Commented] (YARN-2497) Fair scheduler should support strict node labels

2017-11-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263415#comment-16263415 ] Daniel Templeton commented on YARN-2497: I'm going on an long break, so in case anyone wants to

[jira] [Commented] (YARN-7363) ContainerLocalizer don't have a valid log4j config in case of Linux container executor

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263388#comment-16263388 ] Hadoop QA commented on YARN-7363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7538) Performance improvement related to absolute min-max resources

2017-11-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7538: - Attachment: YARN-7538-YARN-5881.004.patch Fixed UT failures and other potential issues, attached ver.4

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-22 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263334#comment-16263334 ] Juan Rodríguez Hortalá commented on YARN-6483: -- Thanks again [~asuresh]. I have tried to

[jira] [Commented] (YARN-7363) ContainerLocalizer don't have a valid log4j config in case of Linux container executor

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263329#comment-16263329 ] Miklos Szegedi commented on YARN-7363: -- +1 (non-binding). Thank you for the patch [~yufeigu]. >

[jira] [Commented] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263328#comment-16263328 ] Jason Lowe commented on YARN-6647: -- I think this change should be safe for pulling into 3.0.0. > RM can

[jira] [Updated] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7541: --- Attachment: YARN-7541.003.patch New patch fixes whitespace issue. Unit test failures are

[jira] [Commented] (YARN-7544) Configuration cleanup associated to support absolute resources in a queue

2017-11-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263319#comment-16263319 ] Wangda Tan commented on YARN-7544: -- Thanks [~sunilg], change looks good. Could you confirm if failed tests

[jira] [Commented] (YARN-7544) Configuration cleanup associated to support absolute resources in a queue

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263310#comment-16263310 ] Hadoop QA commented on YARN-7544: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7538) Performance improvement related to absolute min-max resources

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263288#comment-16263288 ] Hadoop QA commented on YARN-7538: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263286#comment-16263286 ] Hadoop QA commented on YARN-7541: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7491) Make sure AM is not scheduled on an opportunistic container

2017-11-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7491: - Attachment: YARN-7491-YARN-1011.00.patch > Make sure AM is not scheduled on an opportunistic container >

[jira] [Commented] (YARN-7538) Performance improvement related to absolute min-max resources

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263257#comment-16263257 ] Hadoop QA commented on YARN-7538: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6921) Allow resource request to opt out of oversubscription in Fair Scheduler

2017-11-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6921: - Fix Version/s: YARN-1011 > Allow resource request to opt out of oversubscription in Fair Scheduler >

[jira] [Updated] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7337: - Fix Version/s: YARN-1011 > Expose per-node over-allocation info in Node Report >

[jira] [Updated] (YARN-6750) Add a configuration to cap how much a NM can be overallocated

2017-11-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6750: - Fix Version/s: YARN-1011 > Add a configuration to cap how much a NM can be overallocated >

[jira] [Updated] (YARN-7363) ContainerLocalizer don't have a valid log4j config in case of Linux container executor

2017-11-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7363: --- Attachment: YARN-7363.004.patch Uploaded v4 for test failures and the style issue. > ContainerLocalizer don't

[jira] [Commented] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263163#comment-16263163 ] Daniel Templeton commented on YARN-6647: Since we're respinning the 3.0.0 RC, is this something we

[jira] [Commented] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263156#comment-16263156 ] Jason Lowe commented on YARN-6647: -- Thanks for updating the patch! +1 lgtm. The test failure is not

[jira] [Updated] (YARN-7544) Configuration cleanup associated to support absolute resources in a queue

2017-11-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7544: -- Attachment: YARN-7544-YARN-5881.002.patch Thanks [~leftnoteasy]. Attaching v2 patch. > Configuration cleanup

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-22 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263101#comment-16263101 ] Shane Kumpf commented on YARN-5534: --- Thanks [~eyang] for the commit. Also, thanks to [~ebadger],

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263084#comment-16263084 ] Hudson commented on YARN-5534: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13269 (See

[jira] [Updated] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7541: --- Attachment: YARN-7541.002.patch This patch should resolve the test failures, and YARN-7513

[jira] [Comment Edited] (YARN-6921) Allow resource request to opt out of oversubscription in Fair Scheduler

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262916#comment-16262916 ] Miklos Szegedi edited comment on YARN-6921 at 11/22/17 6:22 PM: Thank you

[jira] [Updated] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7505: --- Target Version/s: 3.0.0 (was: 3.0.1) Since we're respinning the 3.0.0 RC, I'm going to take a

[jira] [Comment Edited] (YARN-6921) Allow resource request to opt out of oversubscription in Fair Scheduler

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262916#comment-16262916 ] Miklos Szegedi edited comment on YARN-6921 at 11/22/17 6:21 PM: +1 Thank

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263062#comment-16263062 ] Sunil G commented on YARN-7330: --- Committing shortly if no objections. Thanks [~leftnoteasy] > Add support to

[jira] [Commented] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263057#comment-16263057 ] Sunil G commented on YARN-7541: --- Sure. I think this will be better to go for GA. > Node updates don't update

[jira] [Updated] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7541: --- Target Version/s: 3.0.0 Since we're respinning the 3.0.0 RC, I'd really like to get this one

[jira] [Updated] (YARN-7538) Performance improvement related to absolute min-max resources

2017-11-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7538: -- Attachment: YARN-7538-YARN-5881.003.patch Uploading v3 patch with more optimizations. cc/ [~wangda] >

[jira] [Commented] (YARN-6921) Allow resource request to opt out of oversubscription in Fair Scheduler

2017-11-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263041#comment-16263041 ] Haibo Chen commented on YARN-6921: -- Thanks for the review, [~miklos.szeg...@cloudera.com]! > Allow

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263014#comment-16263014 ] Eric Yang commented on YARN-5534: - +1 looks good for 007. I will commit this shortly. > Allow user

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262983#comment-16262983 ] Arun Suresh commented on YARN-6483: --- Thanks [~juanrh]... The patch LGTM - I like the testcases as well.

[jira] [Updated] (YARN-7538) Performance improvement related to absolute min-max resources

2017-11-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7538: -- Attachment: YARN-7538-YARN-5881.002.patch Thanks [~leftnoteasy]. Attaching perf patch. > Performance

[jira] [Commented] (YARN-7496) CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit calculations

2017-11-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262978#comment-16262978 ] Sunil G commented on YARN-7496: --- +1 from me as well. > CS Intra-queue preemption user-limit calculations are

[jira] [Commented] (YARN-6750) Add a configuration to cap how much a NM can be overallocated

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262941#comment-16262941 ] Miklos Szegedi commented on YARN-6750: -- +1 Thank you for the contribution [~haibochen]. I prefer

[jira] [Commented] (YARN-6921) Allow resource request to opt out of oversubscription in Fair Scheduler

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262916#comment-16262916 ] Miklos Szegedi commented on YARN-6921: -- Thank you for the contribution, [~haibochen]. I will commit

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262900#comment-16262900 ] Hadoop QA commented on YARN-5534: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262892#comment-16262892 ] Miklos Szegedi commented on YARN-7337: -- +1. Thank you for the contribution [~haibochen]. I will commit

[jira] [Comment Edited] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259899#comment-16259899 ] Miklos Szegedi edited comment on YARN-7337 at 11/22/17 4:33 PM: Thank you

[jira] [Commented] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262784#comment-16262784 ] Varun Vasudev commented on YARN-7430: - Backported to branch-3.0.0. Thanks for the quick repsonse

[jira] [Updated] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-7430: Fix Version/s: (was: 3.0.1) 3.0.0 > Enable user re-mapping for Docker

[jira] [Commented] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262776#comment-16262776 ] Andrew Wang commented on YARN-7430: --- Sure, please backport. Thanks for the attention Varun! > Enable

[jira] [Updated] (YARN-7508) NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode

2017-11-22 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7508: --- Summary: NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode (was: NPE in

[jira] [Updated] (YARN-5534) Allow user provided Docker volume mount list

2017-11-22 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-5534: -- Attachment: YARN-5534.007.patch Thanks for the review, [~miklos.szeg...@cloudera.com]. AFAIK, only NUL

[jira] [Commented] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262435#comment-16262435 ] Varun Vasudev commented on YARN-7430: - [~andrew.wang] - given that you're cutting a new RC for 3.0 , do