[jira] [Commented] (YARN-7492) Set up SASS for UI styling

2017-11-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254875#comment-16254875 ] Sunil G commented on YARN-7492: --- +1 Committing shortly. > Set up SASS for UI styling >

[jira] [Resolved] (YARN-6067) Applications API Service HA

2017-11-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved YARN-6067. - Resolution: Duplicate > Applications API Service HA > --- > > Key:

[jira] [Reopened] (YARN-6067) Applications API Service HA

2017-11-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened YARN-6067: - > Applications API Service HA > --- > > Key: YARN-6067 >

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-15 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254861#comment-16254861 ] Zheng Hu commented on YARN-7213: With my pleasure to debug

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.003.patch fix UT and whitespace error > Add HDFSSchedulerConfigurationStore

[jira] [Updated] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-11-15 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7461: --- Attachment: YARN-7461.003.patch Updating the patch to skip ratio calculation for resource types whose left

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-15 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254817#comment-16254817 ] Rohith Sharma K S commented on YARN-7213: - thanks [~haibo.chen] for updating wip patch! # In

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254806#comment-16254806 ] Jian He commented on YARN-7218: --- Got a question, is YARN-7505 related to this ? > ApiServer REST API naming

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254799#comment-16254799 ] Hadoop QA commented on YARN-7213: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7274) Ability to disable elasticity at leaf queue level

2017-11-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254775#comment-16254775 ] Wangda Tan commented on YARN-7274: -- Thanks [~Zian Chen] for posting proposal, I'm fine with the approach

[jira] [Commented] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254774#comment-16254774 ] Hadoop QA commented on YARN-7505: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254772#comment-16254772 ] Wangda Tan commented on YARN-7330: -- Thanks [~sunilg] for helping update the patch. bq. Attaching v9

[jira] [Commented] (YARN-6486) FairScheduler: Deprecate continuous scheduling

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254741#comment-16254741 ] Hadoop QA commented on YARN-6486: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254726#comment-16254726 ] Daniel Templeton commented on YARN-7505: The most correct approach is to rev the endpoint version

[jira] [Updated] (YARN-6918) Remove acls after queue delete to avoid memory leak

2017-11-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6918: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-5724) > Remove acls after

[jira] [Commented] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254698#comment-16254698 ] Sunil G commented on YARN-7505: --- [~templedf], I agree that the first response which you mentioned with maps

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254693#comment-16254693 ] Ted Yu commented on YARN-7213: -- [~openinx]: You have made many changes to Filters. Mind giving Haibo a hand ?

[jira] [Updated] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7505: --- Attachment: YARN-7505.002.patch Looks like the {{LabelsToNodeInfo}} DAO also violates the

[jira] [Commented] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254648#comment-16254648 ] Hadoop QA commented on YARN-7503: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

2017-11-15 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254641#comment-16254641 ] Zian Chen commented on YARN-6124: - Hi [~eepayne] Thank you for your previous comments. Actually, I got the

[jira] [Updated] (YARN-6486) FairScheduler: Deprecate continuous scheduling

2017-11-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-6486: Attachment: YARN-6486.001.patch Patch marking all continuous scheduling public

[jira] [Comment Edited] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-15 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254635#comment-16254635 ] Haibo Chen edited comment on YARN-7213 at 11/16/17 2:01 AM: Upload a WIP patch

[jira] [Updated] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-15 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7213: - Attachment: YARN-7213.wip.patch Upload a WIP patch that simply upgrade HBase to the latest branch-2 HEAD.

[jira] [Updated] (YARN-6486) FairScheduler: Deprecate continuous scheduling

2017-11-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-6486: Summary: FairScheduler: Deprecate continuous scheduling (was: FairScheduler:

[jira] [Commented] (YARN-5366) Improve handling of the Docker container life cycle

2017-11-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254598#comment-16254598 ] Eric Yang commented on YARN-5366: - {{--rm}} will remove container when docker is restarted. If a system

[jira] [Commented] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-15 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254577#comment-16254577 ] Jonathan Hung commented on YARN-7503: - Thanks, specifying component instance jvm opts on launch_command

[jira] [Updated] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-15 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7503: Attachment: YARN-7503.002.patch > Configurable heap size / JVM opts in service AM >

[jira] [Comment Edited] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

2017-11-15 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254564#comment-16254564 ] Zian Chen edited comment on YARN-6124 at 11/16/17 12:55 AM: [~leftnoteasy] I

[jira] [Commented] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

2017-11-15 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254564#comment-16254564 ] Zian Chen commented on YARN-6124: - [~leftnoteasy] I think I found the root cause for the bug in the

[jira] [Commented] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254512#comment-16254512 ] Jian He commented on YARN-7503: --- The patch looks good to me. "yarn.service.java.opts", how about call it

[jira] [Commented] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254511#comment-16254511 ] Jian He commented on YARN-7503: --- Thanks Jonathan, bq. This is just parsed on the AM. For the component

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254495#comment-16254495 ] Hadoop QA commented on YARN-7448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2017-11-15 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-4813: -- Attachment: YARN-4813.000.patch Attaching the patch, but I'm still exploring what's a rate limit that

[jira] [Commented] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254490#comment-16254490 ] Hadoop QA commented on YARN-7503: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-15 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254425#comment-16254425 ] Jonathan Hung commented on YARN-7503: - Attached 001 patch which adds {{yarn.service.java.opts}}

[jira] [Updated] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-15 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7503: Attachment: YARN-7503.001.patch > Configurable heap size / JVM opts in service AM >

[jira] [Created] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-15 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7506: Summary: Overhaul the design of the Linux container-executor regarding Docker and future runtimes Key: YARN-7506 URL: https://issues.apache.org/jira/browse/YARN-7506

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254382#comment-16254382 ] ASF GitHub Bot commented on YARN-6483: -- Github user juanrh commented on a diff in the pull request:

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7448: -- Attachment: YARN-7448-YARN-6592.002.patch Fixing checkstyle - the findbugs is extant > [API] Add

[jira] [Commented] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254340#comment-16254340 ] Hadoop QA commented on YARN-7505: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254323#comment-16254323 ] Arun Suresh commented on YARN-7438: --- [~leftnoteasy], Some more comments: * We should change the name of

[jira] [Commented] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-15 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254284#comment-16254284 ] Billie Rinaldi commented on YARN-7486: -- I am +1 for patch 02. I think this is ready to commit. > Race

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254274#comment-16254274 ] ASF GitHub Bot commented on YARN-6483: -- Github user juanrh commented on a diff in the pull request:

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-15 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254273#comment-16254273 ] Juan Rodríguez Hortalá commented on YARN-6483: -- Thanks a lot for the comments [~asuresh], I'll

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254253#comment-16254253 ] Hadoop QA commented on YARN-7218: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7505: --- Attachment: YARN-7505.001.patch With this patch, the output now looks like: % curl

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254213#comment-16254213 ] Hadoop QA commented on YARN-7448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-15 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254205#comment-16254205 ] Haibo Chen commented on YARN-7390: -- +1. Will commit it later today if there is no objection > All

[jira] [Created] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-15 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7505: -- Summary: RM REST endpoints generate malformed JSON Key: YARN-7505 URL: https://issues.apache.org/jira/browse/YARN-7505 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254179#comment-16254179 ] Hadoop QA commented on YARN-7486: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254173#comment-16254173 ] Jian He commented on YARN-7486: --- Thanks for changing the patch, I agree, opened YARN-7504 for it. > Race

[jira] [Created] (YARN-7504) Separate log file for service rest API

2017-11-15 Thread Jian He (JIRA)
Jian He created YARN-7504: - Summary: Separate log file for service rest API Key: YARN-7504 URL: https://issues.apache.org/jira/browse/YARN-7504 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254131#comment-16254131 ] ASF GitHub Bot commented on YARN-6483: -- Github user xslogic commented on a diff in the pull request:

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254132#comment-16254132 ] Arun Suresh commented on YARN-6483: --- Left some comments on the pull request. > Add nodes transitioning

[jira] [Commented] (YARN-7487) Make sure volume includes GPU base libraries exists after created by plugin

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254121#comment-16254121 ] Hadoop QA commented on YARN-7487: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254103#comment-16254103 ] ASF GitHub Bot commented on YARN-6483: -- Github user xslogic commented on a diff in the pull request:

[jira] [Updated] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-15 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7486: - Attachment: YARN-7486.02.patch On thinking about this more, instead of making the logging changes

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254070#comment-16254070 ] Arun Suresh commented on YARN-7448: --- [~kkaranasos] / [~leftnoteasy] - quick rev ? > [API] Add

[jira] [Commented] (YARN-2497) Fair scheduler should support strict node labels

2017-11-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254064#comment-16254064 ] Daniel Templeton commented on YARN-2497: Looks like I was a bit too naive in this patch. I missed

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7448: -- Attachment: YARN-7448-YARN-6592.001.patch Uploading initial patch. > [API] Add SchedulingRequest to the

[jira] [Updated] (YARN-2497) Fair scheduler should support strict node labels

2017-11-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-2497: --- Summary: Fair scheduler should support strict node labels (was: Changes for fair scheduler to

[jira] [Commented] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254061#comment-16254061 ] Hadoop QA commented on YARN-7390: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2017-11-15 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254037#comment-16254037 ] Gergo Repas commented on YARN-4813: --- My tests suggest that the "Request is a replay" error is indeed

[jira] [Commented] (YARN-7361) Improve the docker container runtime documentation

2017-11-15 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254032#comment-16254032 ] Shane Kumpf commented on YARN-7361: --- Thanks for the commit [~jlowe]! > Improve the docker container

[jira] [Commented] (YARN-6903) Yarn-native-service framework core rewrite

2017-11-15 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254020#comment-16254020 ] Jonathan Hung commented on YARN-6903: - Thanks - YARN-7503 for reference. > Yarn-native-service

[jira] [Created] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-15 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-7503: --- Summary: Configurable heap size / JVM opts in service AM Key: YARN-7503 URL: https://issues.apache.org/jira/browse/YARN-7503 Project: Hadoop YARN Issue Type:

[jira] [Assigned] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2017-11-15 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas reassigned YARN-4813: - Assignee: Gergo Repas > TestRMWebServicesDelegationTokenAuthentication.testDoAs fails

[jira] [Commented] (YARN-6903) Yarn-native-service framework core rewrite

2017-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254015#comment-16254015 ] Jian He commented on YARN-6903: --- I'm working on other items now. Sure, please go ahead. Thank you ! >

[jira] [Commented] (YARN-6903) Yarn-native-service framework core rewrite

2017-11-15 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254007#comment-16254007 ] Jonathan Hung commented on YARN-6903: - Hi [~jianhe]/[~billie.rinaldi], noticed there's some unfinished

[jira] [Commented] (YARN-7414) FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight()

2017-11-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253982#comment-16253982 ] Hudson commented on YARN-7414: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13239 (See

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-11-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253981#comment-16253981 ] Hudson commented on YARN-6953: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13239 (See

[jira] [Commented] (YARN-7361) Improve the docker container runtime documentation

2017-11-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253983#comment-16253983 ] Hudson commented on YARN-7361: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13239 (See

[jira] [Updated] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7218: Attachment: YARN-7218.004.patch - Remove YarnJacksonJaxbProvider change because this breaks some existing

[jira] [Commented] (YARN-2331) Distinguish shutdown during supervision vs. shutdown for rolling upgrade

2017-11-15 Thread Karthik Palaniappan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253971#comment-16253971 ] Karthik Palaniappan commented on YARN-2331: --- Ah, thanks for the quick response. > Distinguish

[jira] [Commented] (YARN-2331) Distinguish shutdown during supervision vs. shutdown for rolling upgrade

2017-11-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253956#comment-16253956 ] Jason Lowe commented on YARN-2331: -- There is documentation of the property at

[jira] [Created] (YARN-7502) Nodemanager restart docs should describe nodemanager supervised property

2017-11-15 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7502: Summary: Nodemanager restart docs should describe nodemanager supervised property Key: YARN-7502 URL: https://issues.apache.org/jira/browse/YARN-7502 Project: Hadoop YARN

[jira] [Updated] (YARN-7487) Make sure volume includes GPU base libraries exists after created by plugin

2017-11-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7487: - Attachment: YARN-7487.002.patch Attached ver.2 patch, fixed unit tests, etc. > Make sure volume includes

[jira] [Assigned] (YARN-7467) FSLeafQueue unnecessarily calls ComputeFairShares.computeShare() to calculate fair share for apps

2017-11-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-7467: -- Assignee: Daniel Templeton > FSLeafQueue unnecessarily calls

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-15 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253912#comment-16253912 ] Juan Rodríguez Hortalá commented on YARN-6483: -- Hi, Any thoughts on this proposal?

[jira] [Commented] (YARN-7361) Improve the docker container runtime documentation

2017-11-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253911#comment-16253911 ] Jason Lowe commented on YARN-7361: -- Thanks for updating the patch! +1 lgtm. Committing this. > Improve

[jira] [Resolved] (YARN-7414) FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight()

2017-11-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-7414. Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253883#comment-16253883 ] Hadoop QA commented on YARN-7159: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7414) FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight()

2017-11-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253865#comment-16253865 ] Daniel Templeton commented on YARN-7414: +1 > FairScheduler#getAppWeight() should be moved into

[jira] [Updated] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-15 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7390: --- Attachment: YARN-7390.005.patch Uploaded patch v5, which split to two classes. Thanks [~haibo.chen]. > All

[jira] [Commented] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-15 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253856#comment-16253856 ] Haibo Chen commented on YARN-7460: -- Also, the volatile variables are there long before YARN-4511, so I

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253850#comment-16253850 ] Daniel Templeton commented on YARN-7119: My feedback: # On ResourceUtils:L438, you're quietly

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253831#comment-16253831 ] Eric Badger commented on YARN-7430: --- Hey [~eyang], thanks for the updated explanation. bq. This JIRA is

[jira] [Commented] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253828#comment-16253828 ] Eric Payne commented on YARN-7469: -- Thanks [~sunilg]! That would be great! > Capacity Scheduler

[jira] [Commented] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253818#comment-16253818 ] Sunil G commented on YARN-7438: --- Thanks [~leftnoteasy] for the effort here. Some general comments: #

[jira] [Updated] (YARN-7485) Add LOG.isDebugEnabled() guard for LOG.debug("")

2017-11-15 Thread Mehran Hassani (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehran Hassani updated YARN-7485: - Description: I am conducting research on log related bugs. I tried to make a tool to fix

[jira] [Updated] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-11-15 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6953: --- Attachment: YARN-6953.009.patch > Clean up ResourceUtils.setMinimumAllocationForMandatoryResources()

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-11-15 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253771#comment-16253771 ] Manikandan R commented on YARN-6953: Sorry for the delay. Rebased patch. > Clean up

[jira] [Commented] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253749#comment-16253749 ] Sunil G commented on YARN-7469: --- Thanks [~eepayne]. This makes sense. I am good with v1 patch. I could

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-15 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253728#comment-16253728 ] Manikandan R commented on YARN-7119: [~dan...@cloudera.com] Can you take a look? > yarn rmadmin

[jira] [Commented] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253721#comment-16253721 ] Eric Payne commented on YARN-7469: -- bq. now min container is the dead zone here I filed YARN-7501 to

[jira] [Created] (YARN-7501) Capacity Scheduler Intra-queue preemption should have a "dead zone" around user limit

2017-11-15 Thread Eric Payne (JIRA)
Eric Payne created YARN-7501: Summary: Capacity Scheduler Intra-queue preemption should have a "dead zone" around user limit Key: YARN-7501 URL: https://issues.apache.org/jira/browse/YARN-7501 Project:

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253705#comment-16253705 ] Hadoop QA commented on YARN-7330: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7495) Improve robustness of the AggregatedLogDeletionService

2017-11-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253703#comment-16253703 ] Jason Lowe commented on YARN-7495: -- Thanks for the patch! Looks good overall. The readability would be

[jira] [Comment Edited] (YARN-7414) FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight()

2017-11-15 Thread Soumabrata Chakraborty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253641#comment-16253641 ] Soumabrata Chakraborty edited comment on YARN-7414 at 11/15/17 3:37 PM:

[jira] [Updated] (YARN-7414) FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight()

2017-11-15 Thread Soumabrata Chakraborty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Soumabrata Chakraborty updated YARN-7414: - Attachment: YARN-7414.003.patch Attach patch 3 > FairScheduler#getAppWeight()

  1   2   >