[jira] [Commented] (YARN-9085) Guaranteed and MaxCapacity CSQueueMetrics

2018-12-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16711044#comment-16711044 ] Zhe Zhang commented on YARN-9085: - Thanks [~jhung]! This is a useful metric. Patch LGTM ov

[jira] [Commented] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-12-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710981#comment-16710981 ] Botong Huang commented on YARN-9013: Thanks [~giovanni.fumarola] for the review. Commi

[jira] [Commented] (YARN-9085) Guaranteed and MaxCapacity CSQueueMetrics

2018-12-05 Thread Keqiu Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710980#comment-16710980 ] Keqiu Hu commented on YARN-9085: +1, this makes life easier to collect configured queue in

[jira] [Commented] (YARN-9085) Guaranteed and MaxCapacity CSQueueMetrics

2018-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710967#comment-16710967 ] Hadoop QA commented on YARN-9085: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710928#comment-16710928 ] Hadoop QA commented on YARN-8714: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710904#comment-16710904 ] Weiwei Yang commented on YARN-9057: --- Thanks [~eyang]! > CSI jar file should not bundle

[jira] [Updated] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-12-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8714: --- Attachment: YARN-8714-trunk.004.patch > [Submarine] Support files/tarballs to be localized for a train

[jira] [Commented] (YARN-9085) Guaranteed and MaxCapacity CSQueueMetrics

2018-12-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710879#comment-16710879 ] Jonathan Hung commented on YARN-9085: - Attached 001 patch which adds [Guaranteed|MaxCa

[jira] [Updated] (YARN-9085) Guaranteed and MaxCapacity CSQueueMetrics

2018-12-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9085: Attachment: YARN-9085.001.patch > Guaranteed and MaxCapacity CSQueueMetrics > --

[jira] [Updated] (YARN-9085) Guaranteed and MaxCapacity CSQueueMetrics

2018-12-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9085: Affects Version/s: 2.9.3 > Guaranteed and MaxCapacity CSQueueMetrics > -

[jira] [Created] (YARN-9085) Guaranteed and MaxCapacity CSQueueMetrics

2018-12-05 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-9085: --- Summary: Guaranteed and MaxCapacity CSQueueMetrics Key: YARN-9085 URL: https://issues.apache.org/jira/browse/YARN-9085 Project: Hadoop YARN Issue Type: Improve

[jira] [Commented] (YARN-9025) TestFairScheduler#testChildMaxResources is flaky

2018-12-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710819#comment-16710819 ] Hudson commented on YARN-9025: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #155

[jira] [Commented] (YARN-9025) Make TestFairScheduler#testChildMaxResources more reliable, as it is flaky now

2018-12-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710803#comment-16710803 ] Haibo Chen commented on YARN-9025: -- +1 on the latest patch. Checking it in shortly. > Ma

[jira] [Assigned] (YARN-9025) TestFairScheduler#testChildMaxResources is flaky

2018-12-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-9025: Assignee: Szilard Nemeth (was: Haibo Chen) > TestFairScheduler#testChildMaxResources is flaky > --

[jira] [Assigned] (YARN-9025) TestFairScheduler#testChildMaxResources is flaky

2018-12-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-9025: Assignee: Haibo Chen (was: Szilard Nemeth) > TestFairScheduler#testChildMaxResources is flaky > --

[jira] [Updated] (YARN-9025) TestFairScheduler#testChildMaxResources is flaky

2018-12-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-9025: - Summary: TestFairScheduler#testChildMaxResources is flaky (was: Make TestFairScheduler#testChildMaxResour

[jira] [Commented] (YARN-9051) Integrate multiple CustomResourceTypesConfigurationProvider implementations into one

2018-12-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710796#comment-16710796 ] Haibo Chen commented on YARN-9051: -- Thanks [~snemeth] for the patch. Looks good overall.

[jira] [Updated] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-12-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9071: Target Version/s: 3.1.2, 3.3.0, 3.2.1 (was: 3.3.0) Fix Version/s: 3.2.1 3.1.2

[jira] [Commented] (YARN-9019) Ratio calculation of ResourceCalculator implementations could return NaN

2018-12-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710772#comment-16710772 ] Hudson commented on YARN-9019: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #155

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-12-05 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710746#comment-16710746 ] Chandni Singh commented on YARN-9071: - Hi [~eyang], Would like this to be backported

[jira] [Commented] (YARN-9019) Ratio calculation of ResourceCalculator implementations could return NaN

2018-12-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710731#comment-16710731 ] Haibo Chen commented on YARN-9019: -- +1 checking in shortly > Ratio calculation of Resour

[jira] [Commented] (YARN-8985) Improve debug log in FSParentQueue when assigning container

2018-12-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710738#comment-16710738 ] Hudson commented on YARN-8985: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #155

[jira] [Updated] (YARN-8985) Improve debug log in FSParentQueue when assigning container

2018-12-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8985: - Summary: Improve debug log in FSParentQueue when assigning container (was: FSParentQueue: debug log missi

[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

2018-12-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710723#comment-16710723 ] Haibo Chen commented on YARN-8985: -- +1 and checking it in shortly. > FSParentQueue: debu

[jira] [Commented] (YARN-8994) Fix race condition between move app and queue cleanup in Fair Scheduler

2018-12-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710722#comment-16710722 ] Hudson commented on YARN-8994: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #155

[jira] [Commented] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

2018-12-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710720#comment-16710720 ] Haibo Chen commented on YARN-8738: -- Thanks [~snemeth] for the patch. Two nits:  1) we ca

[jira] [Updated] (YARN-8994) Fix race condition between move app and queue cleanup in Fair Scheduler

2018-12-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8994: - Summary: Fix race condition between move app and queue cleanup in Fair Scheduler (was: Fix for race condi

[jira] [Commented] (YARN-8994) Fix for race condition in move app and queue cleanup in FS

2018-12-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710701#comment-16710701 ] Haibo Chen commented on YARN-8994: -- +1 on the patch. Committing to trunk shortly. > Fix

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-12-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710694#comment-16710694 ] Hudson commented on YARN-9071: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #155

[jira] [Updated] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-12-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9071: Affects Version/s: 3.2.0 3.1.1 Target Version/s: 3.3.0 Fix Version/s: 3.3

[jira] [Comment Edited] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-12-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710608#comment-16710608 ] Eric Yang edited comment on YARN-9071 at 12/5/18 9:59 PM: -- Readin

[jira] [Updated] (YARN-8822) Nvidia-docker v2 support

2018-12-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8822: - Priority: Critical (was: Major) > Nvidia-docker v2 support > > >

[jira] [Commented] (YARN-8822) Nvidia-docker v2 support

2018-12-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710646#comment-16710646 ] Wangda Tan commented on YARN-8822: -- [~Charo Zhang], Thanks for the patch, apologize miss

[jira] [Updated] (YARN-8822) Nvidia-docker v2 support

2018-12-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8822: - Fix Version/s: (was: 3.1.2) > Nvidia-docker v2 support > > >

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710642#comment-16710642 ] Hudson commented on YARN-9057: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #155

[jira] [Updated] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9057: Target Version/s: 3.3.0 > CSI jar file should not bundle third party dependencies >

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710623#comment-16710623 ] Eric Yang commented on YARN-9057: - Thank you for the patch [~cheersyang]. +1 for patch 00

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-12-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710608#comment-16710608 ] Eric Yang commented on YARN-9071: - Readiness check and container launch are asynchronous. 

[jira] [Created] (YARN-9084) Service Upgrade: With default readiness check, the status of upgrade is reported to be successful prematurely

2018-12-05 Thread Chandni Singh (JIRA)
Chandni Singh created YARN-9084: --- Summary: Service Upgrade: With default readiness check, the status of upgrade is reported to be successful prematurely Key: YARN-9084 URL: https://issues.apache.org/jira/browse/YARN

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710595#comment-16710595 ] Hadoop QA commented on YARN-9071: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (YARN-8914) Add xtermjs to YARN UI2

2018-12-05 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710533#comment-16710533 ] Akhil PB edited comment on YARN-8914 at 12/5/18 7:30 PM: - [~eyang]

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

2018-12-05 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710533#comment-16710533 ] Akhil PB commented on YARN-8914: [~eyang] {quote}Serializer change seems not necessary, ca

[jira] [Commented] (YARN-9075) Dynamically add or remove auxiliary services

2018-12-05 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710477#comment-16710477 ] Billie Rinaldi commented on YARN-9075: -- Thanks for taking a look, [~cheersyang]! bq.

[jira] [Updated] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-12-05 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-9071: Attachment: YARN-9071.006.patch > NM and service AM don't have updated status for reinitialized cont

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-12-05 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710460#comment-16710460 ] Chandni Singh commented on YARN-9071: - Addressed checkstyle warnings in patch 7. > NM

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

2018-12-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710441#comment-16710441 ] Eric Yang commented on YARN-8914: - [~akhilpb] Thanks for patch 9.  My version of patch 8 a

[jira] [Commented] (YARN-9075) Dynamically add or remove auxiliary services

2018-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710319#comment-16710319 ] Weiwei Yang commented on YARN-9075: --- Hi [~billie.rinaldi] I like this idea very much, I

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

2018-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710263#comment-16710263 ] Weiwei Yang commented on YARN-9050: --- Hi [~Tao Yang], thanks for creating this, certainly

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710226#comment-16710226 ] Hadoop QA commented on YARN-8714: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-12-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8714: --- Attachment: YARN-8714-trunk.003.patch > [Submarine] Support files/tarballs to be localized for a train

[jira] [Commented] (YARN-8828) When config ReservationSystem ,the RM start failed.

2018-12-05 Thread Lee chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16709944#comment-16709944 ] Lee chen commented on YARN-8828: Do you fix this problem, I face this problem ,too. > Wh

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

2018-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16709930#comment-16709930 ] Hadoop QA commented on YARN-8914: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||