[jira] [Commented] (YARN-8981) Virtual IP address support

2018-11-11 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683355#comment-16683355 ] Xun Liu commented on YARN-8981: --- hi, [~Tagar] The virtual IP inside the YARN cluster is alr

[jira] [Comment Edited] (YARN-2823) NullPointerException in RM HA enabled 3-node cluster

2018-11-11 Thread Paul Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683225#comment-16683225 ] Paul Lin edited comment on YARN-2823 at 11/12/18 6:57 AM: -- [~imst

[jira] [Assigned] (YARN-8406) Do the improvement to the FSLeafQueue about calculating fair share for apps

2018-11-11 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi reassigned YARN-8406: --- Assignee: zhuqi > Do the improvement to the FSLeafQueue about calculating fair share for apps > -

[jira] [Updated] (YARN-9010) Fix the incorrect trailing slash deletion in constructor method of CGroupsHandlerImpl

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9010: --- Attachment: YARN-9010-trunk-001.patch > Fix the incorrect trailing slash deletion in constructor metho

[jira] [Commented] (YARN-8881) Add basic pluggable device plugin framework

2018-11-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683291#comment-16683291 ] Hadoop QA commented on YARN-8881: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-8881) Add basic pluggable device plugin framework

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683297#comment-16683297 ] Zhankun Tang commented on YARN-8881: [~leftnoteasy], [~cheersyang] . Please help to re

[jira] [Created] (YARN-9010) Fix the incorrect trailing slash deletion in constructor method of CGroupsHandlerImpl

2018-11-11 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-9010: -- Summary: Fix the incorrect trailing slash deletion in constructor method of CGroupsHandlerImpl Key: YARN-9010 URL: https://issues.apache.org/jira/browse/YARN-9010 Project

[jira] [Updated] (YARN-9010) Fix the incorrect trailing slash deletion in constructor method of CGroupsHandlerImpl

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9010: --- Description: In constructor method of CGroupsHandlerImpl: {code:java} this.cGroupPrefix = conf.get(Yar

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

2018-11-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683284#comment-16683284 ] Sunil Govindan commented on YARN-8877: -- In this context, {{attributes: null}} looks f

[jira] [Updated] (YARN-8902) [CSI] Add volume manager that manages CSI volume lifecycle

2018-11-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8902: - Summary: [CSI] Add volume manager that manages CSI volume lifecycle (was: Add volume manager that

[jira] [Commented] (YARN-8902) [CSI] Add volume manager that manages CSI volume lifecycle

2018-11-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683282#comment-16683282 ] Hudson commented on YARN-8902: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #154

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

2018-11-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683272#comment-16683272 ] Weiwei Yang commented on YARN-8877: --- Hi [~sunilg] Thanks for the comments. {quote}toInd

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

2018-11-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683247#comment-16683247 ] Sunil Govindan commented on YARN-8877: -- Hi [~cheersyang]  Some minor nits: 1. toInd

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-11-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683236#comment-16683236 ] Sunil Govindan commented on YARN-8902: -- Thanks [~cheersyang] Looks good to me. +1. C

[jira] [Commented] (YARN-8997) [Submarine] Small refactors of modifier, condition check and redundant local variables

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683232#comment-16683232 ] Zhankun Tang commented on YARN-8997: [~giovanni.fumarola] , no unit test needed for th

[jira] [Commented] (YARN-8997) [Submarine] Small refactors of modifier, condition check and redundant local variables

2018-11-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683231#comment-16683231 ] Hadoop QA commented on YARN-8997: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-2823) NullPointerException in RM HA enabled 3-node cluster

2018-11-11 Thread Paul Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683225#comment-16683225 ] Paul Lin commented on YARN-2823: [~imstefanlee] Hi, I'm facing the same issue with Flink a

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683219#comment-16683219 ] Hadoop QA commented on YARN-9001: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8997) [Submarine] Small refactors of modifier, condition check and redundant local variables

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8997: --- Attachment: YARN-8997-trunk-002.patch > [Submarine] Small refactors of modifier, condition check and r

[jira] [Updated] (YARN-8997) [Submarine] Small refactors of modifier, condition check and redundant local variables

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8997: --- Description: In YarnServiceJobSubmitter#needHdfs. Below code can be simplified to just one line. {cod

[jira] [Updated] (YARN-8997) [Submarine] Small refactors of modifier, condition check and redundant local variables

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8997: --- Summary: [Submarine] Small refactors of modifier, condition check and redundant local variables (was

[jira] [Updated] (YARN-8997) [Submarine] Small refactors of modifier,

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8997: --- Summary: [Submarine] Small refactors of modifier, (was: [Submarine] Simplify the logic in YarnServic

[jira] [Comment Edited] (YARN-8998) [Submarine] Simplify the condition check in CliUtils#argsForHelp

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683199#comment-16683199 ] Zhankun Tang edited comment on YARN-8998 at 11/12/18 4:19 AM: --

[jira] [Resolved] (YARN-8999) [Submarine] Remove redundant local variables

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-8999. Resolution: Duplicate Merge this with YARN-8997 > [Submarine] Remove redundant local variables > --

[jira] [Comment Edited] (YARN-8998) [Submarine] Simplify the condition check in CliUtils#argsForHelp

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683199#comment-16683199 ] Zhankun Tang edited comment on YARN-8998 at 11/12/18 4:16 AM: --

[jira] [Resolved] (YARN-8998) [Submarine] Simplify the condition check in CliUtils#argsForHelp

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-8998. Resolution: Duplicate Merge this with YARN-8996 > [Submarine] Simplify the condition check in CliUt

[jira] [Commented] (YARN-8997) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683193#comment-16683193 ] Zhankun Tang commented on YARN-8997: [~giovanni.fumarola] , Sure. Thanks for the revie

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

2018-11-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683177#comment-16683177 ] Weiwei Yang commented on YARN-8925: --- Hi [~Tao Yang] Can you help to fix "Variable 'xxx'

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-11 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9001: --- Attachment: YARN-9001.003.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs > ---

[jira] [Updated] (YARN-8881) Add basic pluggable device plugin framework

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8881: --- Attachment: YARN-8881-trunk.008.patch > Add basic pluggable device plugin framework >

[jira] [Commented] (YARN-9009) Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs

2018-11-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683158#comment-16683158 ] Zhankun Tang commented on YARN-9009: [~OrDTesters] , The patch looks good to me. Could

[jira] [Updated] (YARN-9009) Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs

2018-11-11 Thread OrDTesters (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] OrDTesters updated YARN-9009: - Description: In TestEntityGroupFSTimelineStore, testCleanLogs fails when run after  testMoveToDone. testC

[jira] [Updated] (YARN-9009) Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs

2018-11-11 Thread OrDTesters (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] OrDTesters updated YARN-9009: - Description: In TestEntityGroupFSTimelineStore, testCleanLogs fails when run after  testMoveToDone. This

[jira] [Commented] (YARN-9009) Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs

2018-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683137#comment-16683137 ] ASF GitHub Bot commented on YARN-9009: -- GitHub user OrDTesters opened a pull request:

[jira] [Created] (YARN-9009) Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs

2018-11-11 Thread OrDTesters (JIRA)
OrDTesters created YARN-9009: Summary: Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs Key: YARN-9009 URL: https://issues.apache.org/jira/browse/YARN-9009 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

2018-11-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682986#comment-16682986 ] Hudson commented on YARN-8933: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #154

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

2018-11-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682964#comment-16682964 ] Botong Huang commented on YARN-8933: Thanks [~bibinchundatt] for the comments and revi

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

2018-11-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Fix Version/s: 3.3.0 2.10.0 > [AMRMProxy] Fix potential empty fields in allocation

[jira] [Commented] (YARN-8980) Mapreduce application container start fail after AM restart.

2018-11-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682962#comment-16682962 ] Botong Huang commented on YARN-8980: I agree. I am also worried about container leaks,

[jira] [Comment Edited] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

2018-11-11 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682851#comment-16682851 ] Tao Yang edited comment on YARN-9007 at 11/11/18 11:53 AM: --- Add

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

2018-11-11 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682851#comment-16682851 ] Tao Yang commented on YARN-9007: Add "for queue and reserved container preemption" to the

[jira] [Updated] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

2018-11-11 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9007: --- Summary: CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved c

[jira] [Updated] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue/reserved

2018-11-11 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9007: --- Summary: CS preemption monitor should only select GUARANTEED containers as candidates for queue/reserved (was

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

2018-11-11 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682846#comment-16682846 ] Tao Yang commented on YARN-9007: Thanks [~sunilg] for your attention. IIUC, intra-queue/in

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

2018-11-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682820#comment-16682820 ] Hadoop QA commented on YARN-8933: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

2018-11-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682811#comment-16682811 ] Sunil Govindan commented on YARN-9007: -- Thanks [~Tao Yang]. Few high level thoughts.