[jira] [Updated] (YARN-7957) [UI2] YARN service delete option disappears after stopping application

2018-10-04 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7957: - Summary: [UI2] YARN service delete option disappears after stopping application (was: [UI2] Yarn

[jira] [Updated] (YARN-8644) Improve unit test for RMAppImpl.FinalTransition

2018-10-04 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8644: - Attachment: YARN-8644.011.patch > Improve unit test for RMAppImpl.FinalTransition > --

[jira] [Commented] (YARN-7957) [UI2] Yarn service delete option disappears after stopping application

2018-10-04 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639335#comment-16639335 ] Sunil Govindan commented on YARN-7957: --  +1. Committing shortly. > [UI2] Yarn servic

[jira] [Commented] (YARN-8644) Improve unit test for RMAppImpl.FinalTransition

2018-10-04 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639310#comment-16639310 ] Szilard Nemeth commented on YARN-8644: -- Uploaded new patch that fixes checkstyle and

[jira] [Commented] (YARN-8644) Improve unit test for RMAppImpl.FinalTransition

2018-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639259#comment-16639259 ] Hadoop QA commented on YARN-8644: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8788) mvn package -Pyarn-ui fails on JDK9

2018-10-04 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639234#comment-16639234 ] Akira Ajisaka commented on YARN-8788: - Attached the patch in the pull request to trigg

[jira] [Updated] (YARN-8788) mvn package -Pyarn-ui fails on JDK9

2018-10-04 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8788: Attachment: 421.patch > mvn package -Pyarn-ui fails on JDK9 > --- >

[jira] [Assigned] (YARN-8849) DynoYARN: A simulation and testing infrastructure for YARN clusters

2018-10-04 Thread Keqiu Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keqiu Hu reassigned YARN-8849: -- Assignee: Keqiu Hu > DynoYARN: A simulation and testing infrastructure for YARN clusters >

[jira] [Updated] (YARN-8849) DynoYARN: A simulation and testing infrastructure for YARN clusters

2018-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8849: -- Description: Traditionally, YARN workload simulation is performed using SLS (Scheduler Load Simulator)

[jira] [Created] (YARN-8850) Make certain aspects of the NM pluggable to support a DynoYARN cluster

2018-10-04 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-8850: - Summary: Make certain aspects of the NM pluggable to support a DynoYARN cluster Key: YARN-8850 URL: https://issues.apache.org/jira/browse/YARN-8850 Project: Hadoop YARN

[jira] [Created] (YARN-8849) DynoYARN: A simulation and testing infrastructure for YARN clusters

2018-10-04 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-8849: - Summary: DynoYARN: A simulation and testing infrastructure for YARN clusters Key: YARN-8849 URL: https://issues.apache.org/jira/browse/YARN-8849 Project: Hadoop YARN

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-04 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639218#comment-16639218 ] Szilard Nemeth commented on YARN-8842: -- About your second comment: I think it does ma

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639178#comment-16639178 ] Eric Yang commented on YARN-8569: - [~suma.shivaprasad] Thanks for the review, appinfo.json

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-04 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639205#comment-16639205 ] Suma Shivaprasad commented on YARN-8569: [~eyang] app.json sounds good. Thanks >

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-04 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639171#comment-16639171 ] Szilard Nemeth commented on YARN-8842: -- Hi [~wilfreds]! Thanks for the comments. 1. G

[jira] [Updated] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-04 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8842: - Attachment: YARN-8842.002.patch > Update QueueMetrics with custom resource values > -

[jira] [Commented] (YARN-7994) Add support for network-alias in docker run for user defined networks

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639164#comment-16639164 ] Eric Yang commented on YARN-7994: - [~suma.shivaprasad] Sorry, I digressed from the topic.

[jira] [Created] (YARN-8848) Improvements to YARN over-allocation (YARN-1011)

2018-10-04 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-8848: - Summary: Improvements to YARN over-allocation (YARN-1011) Key: YARN-8848 URL: https://issues.apache.org/jira/browse/YARN-8848 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-6723) NM overallocation based on over-time rather than snapshot utilization

2018-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6723: -- Parent Issue: YARN-8848 (was: YARN-1011) > NM overallocation based on over-time rather than snapshot ut

[jira] [Updated] (YARN-6690) Consolidate NM overallocation thresholds with ResourceTypes

2018-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6690: -- Parent Issue: YARN-8848 (was: YARN-1011) > Consolidate NM overallocation thresholds with ResourceTypes

[jira] [Commented] (YARN-8845) hadoop.registry.rm.enabled is not used

2018-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639141#comment-16639141 ] Hadoop QA commented on YARN-8845: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (YARN-8847) Add resource-types.xml to configuration when refreshing maximum allocation

2018-10-04 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung resolved YARN-8847. - Resolution: Invalid Actually, upon closer inspection it's handled in AdminService. Seems this was

[jira] [Updated] (YARN-8847) Add resource-types.xml to configuration when refreshing maximum allocation

2018-10-04 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8847: Attachment: YARN-8847.001.patch > Add resource-types.xml to configuration when refreshing maximum al

[jira] [Commented] (YARN-8847) Add resource-types.xml to configuration when refreshing maximum allocation

2018-10-04 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639115#comment-16639115 ] Jonathan Hung commented on YARN-8847: - 001 adds resource-types.xml to conf prior to fe

[jira] [Updated] (YARN-8847) Add resource-types.xml to configuration when refreshing maximum allocation

2018-10-04 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8847: Issue Type: Sub-task (was: Improvement) Parent: YARN-7069 > Add resource-types.xml to confi

[jira] [Created] (YARN-8847) Add resource-types.xml to configuration when refreshing maximum allocation

2018-10-04 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-8847: --- Summary: Add resource-types.xml to configuration when refreshing maximum allocation Key: YARN-8847 URL: https://issues.apache.org/jira/browse/YARN-8847 Project: Hadoop

[jira] [Created] (YARN-8846) Allow Applications to demand Guaranteed Containers

2018-10-04 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-8846: - Summary: Allow Applications to demand Guaranteed Containers Key: YARN-8846 URL: https://issues.apache.org/jira/browse/YARN-8846 Project: Hadoop YARN Issue Type: Su

[jira] [Assigned] (YARN-8846) Allow Applications to demand Guaranteed Containers

2018-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-8846: - Assignee: Arun Suresh > Allow Applications to demand Guaranteed Containers >

[jira] [Updated] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8250: -- Issue Type: Improvement (was: Sub-task) Parent: (was: YARN-1011) > Create another implement

[jira] [Commented] (YARN-8790) Authentication Filter change to force security check

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639039#comment-16639039 ] Eric Yang commented on YARN-8790: - Using curl as sanity test with YARN-8763 patch 004, and

[jira] [Assigned] (YARN-8790) Authentication Filter change to force security check

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-8790: --- Assignee: Eric Yang > Authentication Filter change to force security check > ---

[jira] [Commented] (YARN-7994) Add support for network-alias in docker run for user defined networks

2018-10-04 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639034#comment-16639034 ] Suma Shivaprasad commented on YARN-7994: [~eyang] The proposal here was to add sup

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-04 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639012#comment-16639012 ] Suma Shivaprasad commented on YARN-8569: Thanks [~eyang] . I agree with [~leftnot

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639025#comment-16639025 ] Eric Yang commented on YARN-7644: - Trunk build issues seem to have been resolved, triggeri

[jira] [Comment Edited] (YARN-7935) Expose container's hostname to applications running within the docker container

2018-10-04 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639019#comment-16639019 ] Suma Shivaprasad edited comment on YARN-7935 at 10/4/18 11:14 PM: --

[jira] [Commented] (YARN-7935) Expose container's hostname to applications running within the docker container

2018-10-04 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639019#comment-16639019 ] Suma Shivaprasad commented on YARN-7935: This is no longer needed since the contai

[jira] [Updated] (YARN-8845) hadoop.registry.rm.enabled is not used

2018-10-04 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-8845: -- Attachment: YARN-8845.000.patch > hadoop.registry.rm.enabled is not used > -

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639006#comment-16639006 ] Eric Yang commented on YARN-8763: - [~Zian Chen] DefaultContainerExecutor execContainer met

[jira] [Updated] (YARN-8845) hadoop.registry.rm.enabled is not used

2018-10-04 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-8845: -- Affects Version/s: 3.1.1 > hadoop.registry.rm.enabled is not used >

[jira] [Assigned] (YARN-8845) hadoop.registry.rm.enabled is not used

2018-10-04 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned YARN-8845: - Assignee: Íñigo Goiri > hadoop.registry.rm.enabled is not used >

[jira] [Updated] (YARN-8644) Improve unit test for RMAppImpl.FinalTransition

2018-10-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8644: - Summary: Improve unit test for RMAppImpl.FinalTransition (was: Add more test coverage for RMAppImpl.Final

[jira] [Commented] (YARN-8644) Improve unit test for RMAppImpl.FinalTransition

2018-10-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638959#comment-16638959 ] Haibo Chen commented on YARN-8644: -- +1 on the latest patch pending Jenkins. > Improve un

[jira] [Commented] (YARN-8659) RMWebServices returns only RUNNING apps when filtered with queue

2018-10-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638932#comment-16638932 ] Haibo Chen commented on YARN-8659: -- Thanks [~snemeth] for the analysis. I agree with your

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

2018-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638918#comment-16638918 ] Hadoop QA commented on YARN-8763: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8732) Add unit tests of min/max allocation for custom resource types in FairScheduler

2018-10-04 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638916#comment-16638916 ] Szilard Nemeth commented on YARN-8732: -- Thanks [~haibochen]! Okay, will pay attention

[jira] [Updated] (YARN-8644) Add more test coverage for RMAppImpl.FinalTransition

2018-10-04 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8644: - Attachment: YARN-8644.010.patch > Add more test coverage for RMAppImpl.FinalTransition > -

[jira] [Commented] (YARN-8644) Add more test coverage for RMAppImpl.FinalTransition

2018-10-04 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638902#comment-16638902 ] Szilard Nemeth commented on YARN-8644: -- Hi [~haibochen]! Referring to your previous c

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638901#comment-16638901 ] Eric Yang commented on YARN-8763: - [~Zian Chen] +1 on patch 4. One small improvement that

[jira] [Comment Edited] (YARN-7644) NM gets backed up deleting docker containers

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638819#comment-16638819 ] Eric Yang edited comment on YARN-7644 at 10/4/18 9:06 PM: -- [~csin

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638874#comment-16638874 ] Hadoop QA commented on YARN-8777: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-04 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638840#comment-16638840 ] Eric Badger commented on YARN-7644: --- Personally, I think that {{org.apache.hadoop.yarn.

[jira] [Commented] (YARN-8750) Refactor TestQueueMetrics

2018-10-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638835#comment-16638835 ] Hudson commented on YARN-8750: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #151

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638819#comment-16638819 ] Eric Yang commented on YARN-7644: - [~csingh] ContainerCleanup a a runnable, and it is a ut

[jira] [Commented] (YARN-8732) Add unit tests of min/max allocation for custom resource types in FairScheduler

2018-10-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638802#comment-16638802 ] Hudson commented on YARN-8732: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #151

[jira] [Commented] (YARN-8750) Refactor TestQueueMetrics

2018-10-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638786#comment-16638786 ] Haibo Chen commented on YARN-8750: -- Thansk [~snemeth] for the contribution. I have commit

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638762#comment-16638762 ] Eric Yang commented on YARN-8777: - Unit test failure is addressed in YARN-8844. Patch 7 f

[jira] [Updated] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8777: Attachment: YARN-8777.007.patch > Container Executor C binary change to execute interactive docker command >

[jira] [Commented] (YARN-8732) Add unit tests of min/max allocation for custom resource types in FairScheduler

2018-10-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638759#comment-16638759 ] Haibo Chen commented on YARN-8732: -- Thanks [~snemeth]. I have corrected two indentation i

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-10-04 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638734#comment-16638734 ] Zian Chen commented on YARN-8777: - Hi [~eyang], thanks for patch 006. Seems we still have

[jira] [Commented] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2018-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638735#comment-16638735 ] Hadoop QA commented on YARN-4254: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

2018-10-04 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638730#comment-16638730 ] Zian Chen commented on YARN-8763: - [~eyang], just uploaded patch 004, please help review i

[jira] [Updated] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

2018-10-04 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8763: Attachment: YARN-8763.004.patch > Add WebSocket logic to the Node Manager web server to establish servlet >

[jira] [Commented] (YARN-8844) TestNMProxy unit test is failing

2018-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638711#comment-16638711 ] Hadoop QA commented on YARN-8844: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-8845) hadoop.registry.rm.enabled is not used

2018-10-04 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638640#comment-16638640 ] Íñigo Goiri commented on YARN-8845: --- [~steve_l], you were working on YARN-2571 to integr

[jira] [Commented] (YARN-8844) TestNMProxy unit test is failing

2018-10-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638666#comment-16638666 ] Hudson commented on YARN-8844: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #151

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

2018-10-04 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638658#comment-16638658 ] Zian Chen commented on YARN-8763: - Thanks for the comments, Eric, I'll update the patch la

[jira] [Assigned] (YARN-8844) TestNMProxy unit test is failing

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-8844: --- Assignee: Eric Yang > TestNMProxy unit test is failing > > >

[jira] [Created] (YARN-8845) hadoop.registry.rm.enabled is not used

2018-10-04 Thread JIRA
Íñigo Goiri created YARN-8845: - Summary: hadoop.registry.rm.enabled is not used Key: YARN-8845 URL: https://issues.apache.org/jira/browse/YARN-8845 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-8758) Support getting PreemptionMessage when using AMRMClientAsync

2018-10-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638632#comment-16638632 ] Hudson commented on YARN-8758: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #151

[jira] [Updated] (YARN-8844) TestNMProxy unit test is failing

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8844: Attachment: YARN-8844.001.patch > TestNMProxy unit test is failing > > >

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638615#comment-16638615 ] Hadoop QA commented on YARN-8777: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (YARN-8758) Support getting PreemptionMessage when using AMRMClientAsync

2018-10-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638618#comment-16638618 ] Wangda Tan edited comment on YARN-8758 at 10/4/18 5:54 PM: --- Comm

[jira] [Commented] (YARN-8844) TestNMProxy unit test is failing

2018-10-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638606#comment-16638606 ] Wangda Tan commented on YARN-8844: -- Fix LGTM, thanks [~eyang]. > TestNMProxy unit test i

[jira] [Commented] (YARN-8844) TestNMProxy unit test is failing

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638596#comment-16638596 ] Eric Yang commented on YARN-8844: - The test is design to pass, when Socket exception is th

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8468: - Component/s: scheduler > Enable the use of queue based maximum container allocation limit and > implement

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8468: - Fix Version/s: (was: 3.3.0) > Enable the use of queue based maximum container allocation limit and >

[jira] [Commented] (YARN-8448) AM HTTPS Support

2018-10-04 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638522#comment-16638522 ] Robert Kanter commented on YARN-8448: - Test failures seem unrelated - they all pass lo

[jira] [Commented] (YARN-7225) Add queue and partition info to RM audit log

2018-10-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638556#comment-16638556 ] Eric Payne commented on YARN-7225: -- {quote} - In the capacity scheduler, the AM Released

[jira] [Updated] (YARN-7225) Add queue and partition info to RM audit log

2018-10-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7225: - Attachment: YARN-7225.002.patch > Add queue and partition info to RM audit log > -

[jira] [Commented] (YARN-8834) Provide Java client for fetching entities from TimelineReader

2018-10-04 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638541#comment-16638541 ] Vrushali C commented on YARN-8834: -- Add from id and limit . Suggestion by [~rohithsharma]

[jira] [Updated] (YARN-8844) TestNMProxy unit test is failing

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8844: Description: TestNMProxy has been failing in trunk for the last two or three weeks. Investigating the fail

[jira] [Commented] (YARN-8549) Adding a NoOp timeline writer and reader plugin classes for ATSv2

2018-10-04 Thread Prabha Manepalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638524#comment-16638524 ] Prabha Manepalli commented on YARN-8549: [~vrushalic] As [~suma.shivaprasad] sugg

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638503#comment-16638503 ] Eric Yang commented on YARN-8777: - Patch 6 fixes white space, and cc return code check. T

[jira] [Created] (YARN-8844) TestNMProxy unit test is failing

2018-10-04 Thread Eric Yang (JIRA)
Eric Yang created YARN-8844: --- Summary: TestNMProxy unit test is failing Key: YARN-8844 URL: https://issues.apache.org/jira/browse/YARN-8844 Project: Hadoop YARN Issue Type: Bug Components

[jira] [Updated] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-10-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8777: Attachment: YARN-8777.006.patch > Container Executor C binary change to execute interactive docker command >

[jira] [Commented] (YARN-6989) Ensure timeline service v2 codebase gets UGI from HttpServletRequest in a consistent way

2018-10-04 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638418#comment-16638418 ] Vrushali C commented on YARN-6989: -- +1 LGTM Committing shortly Thanks [~abmodi] for the

[jira] [Commented] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2018-10-04 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638385#comment-16638385 ] Bibin A Chundatt commented on YARN-4254: Thank you [~jlowe] for review Attached

[jira] [Updated] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2018-10-04 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4254: --- Attachment: YARN-4254.003.patch > ApplicationAttempt stuck for ever due to UnknowHostexception

[jira] [Commented] (YARN-8834) Provide Java client for fetching entities from TimelineReader

2018-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638339#comment-16638339 ] Hadoop QA commented on YARN-8834: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8843) updateNodeResource does not support units for memory

2018-10-04 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638344#comment-16638344 ] Íñigo Goiri commented on YARN-8843: --- [~sunilg], the behavior is broken. If you try the u

[jira] [Commented] (YARN-8843) updateNodeResource does not support units for memory

2018-10-04 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638349#comment-16638349 ] Íñigo Goiri commented on YARN-8843: --- I see YARN-7159 is in 3.2. I tested with 3.1.1 and

[jira] [Commented] (YARN-8843) updateNodeResource does not support units for memory

2018-10-04 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638350#comment-16638350 ] Sunil Govindan commented on YARN-8843: -- Thanks. As per my understanding, this should

[jira] [Updated] (YARN-6668) Use cgroup to get container resource utilization

2018-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6668: -- Issue Type: Improvement (was: Sub-task) Parent: (was: YARN-1011) > Use cgroup to get contai

[jira] [Commented] (YARN-8843) updateNodeResource does not support units for memory

2018-10-04 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638329#comment-16638329 ] Sunil Govindan commented on YARN-8843: -- [~elgoiri] is this change needed? Internally

[jira] [Updated] (YARN-6843) Add unit test for NM to preempt OPPORTUNISTIC containers under high utilization

2018-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6843: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1011) > Add unit test for NM to preempt

[jira] [Updated] (YARN-6806) Scheduler-agnostic RM changes support oversubscription

2018-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6806: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1011) > Scheduler-agnostic RM changes su

[jira] [Updated] (YARN-6800) Add opportunity to start containers while periodically checking for preemption

2018-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6800: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1011) > Add opportunity to start contain

[jira] [Updated] (YARN-6796) Add unit test for NM to launch OPPORTUNISTIC container for overallocation

2018-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6796: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1011) > Add unit test for NM to launch O

[jira] [Updated] (YARN-7015) Handle Container ExecType update (Promotion/Demotion) in cgroups resource handlers

2018-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7015: -- Issue Type: Improvement (was: Sub-task) Parent: (was: YARN-1011) > Handle Container ExecTyp

[jira] [Updated] (YARN-6674) Add memory cgroup settings for opportunistic containers

2018-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6674: -- Issue Type: Improvement (was: Bug) > Add memory cgroup settings for opportunistic containers >

  1   2   >