[jira] [Commented] (YARN-7720) Race condition between second app attempt and UAM timeout when first attempt node is down

2023-05-17 Thread Botong Huang (Jira)
[ https://issues.apache.org/jira/browse/YARN-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723495#comment-17723495 ] Botong Huang commented on YARN-7720: Yeah, as I said in the initial description as wel

[jira] [Comment Edited] (YARN-7720) Race condition between second app attempt and UAM timeout when first attempt node is down

2023-05-17 Thread Botong Huang (Jira)
[ https://issues.apache.org/jira/browse/YARN-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572705#comment-17572705 ] Botong Huang edited comment on YARN-7720 at 5/17/23 2:42 PM: -

[jira] [Commented] (YARN-7899) [AMRMProxy] Stateful FederationInterceptor for pending requests

2022-12-27 Thread Botong Huang (Jira)
[ https://issues.apache.org/jira/browse/YARN-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17652348#comment-17652348 ] Botong Huang commented on YARN-7899: [~walhl] "cancel pending request in one sub-clust

[jira] [Commented] (YARN-7720) Race condition between second app attempt and UAM timeout when first attempt node is down

2022-07-28 Thread Botong Huang (Jira)
[ https://issues.apache.org/jira/browse/YARN-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572711#comment-17572711 ] Botong Huang commented on YARN-7720: [~slfan1989] yes please > Race condition between

[jira] [Commented] (YARN-9689) Router does not support kerberos proxy when in secure mode

2019-10-22 Thread Botong Huang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16957445#comment-16957445 ] Botong Huang commented on YARN-9689: +1 lgtm > Router does not support kerberos proxy

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2019-09-24 Thread Botong Huang (Jira)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937004#comment-16937004 ] Botong Huang commented on YARN-7599: Hi [~qiuliang988], did you mean "GPG couldn't par

[jira] [Assigned] (YARN-7652) Handle AM register requests asynchronously in FederationInterceptor

2019-07-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang reassigned YARN-7652: -- Assignee: Botong Huang (was: hunshenshi) > Handle AM register requests asynchronously in Feder

[jira] [Commented] (YARN-9689) Router does not support kerberos proxy when in secure mode

2019-07-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890402#comment-16890402 ] Botong Huang commented on YARN-9689: +[~giovanni.fumarola] for help > Router does not

[jira] [Updated] (YARN-9108) fix FederationIntercepter merge home and secondary allocate response typo

2018-12-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-9108: --- Fix Version/s: 3.3.0 2.10.0 > fix FederationIntercepter merge home and secondary al

[jira] [Commented] (YARN-9108) fix FederationIntercepter merge home and secondary allocate response typo

2018-12-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727565#comment-16727565 ] Botong Huang commented on YARN-9108: +1. Committing to trunk and branch-2. Thanks [~Ce

[jira] [Updated] (YARN-9108) fix FederationIntercepter merge home and secondary allocate response typo

2018-12-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-9108: --- Summary: fix FederationIntercepter merge home and secondary allocate response typo (was: FederationIn

[jira] [Commented] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-12-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710981#comment-16710981 ] Botong Huang commented on YARN-9013: Thanks [~giovanni.fumarola] for the review. Commi

[jira] [Updated] (YARN-7720) Race condition between second app attempt and UAM timeout when first attempt node is down

2018-11-30 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7720: --- Attachment: YARN-7720.v2.patch > Race condition between second app attempt and UAM timeout when first

[jira] [Updated] (YARN-7720) Race condition between second app attempt and UAM timeout when first attempt node is down

2018-11-30 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7720: --- Attachment: YARN-9013-YARN-7402.v2.patch > Race condition between second app attempt and UAM timeout w

[jira] [Updated] (YARN-7720) Race condition between second app attempt and UAM timeout when first attempt node is down

2018-11-30 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7720: --- Attachment: (was: YARN-9013-YARN-7402.v2.patch) > Race condition between second app attempt and UA

[jira] [Updated] (YARN-7720) Race condition between second app attempt and UAM timeout when first attempt node is down

2018-11-30 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7720: --- Attachment: YARN-7720.v1.patch > Race condition between second app attempt and UAM timeout when first

[jira] [Commented] (YARN-9049) Add application submit data to state store

2018-11-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16703500#comment-16703500 ] Botong Huang commented on YARN-9049: Understood. Let me ask this way: forget about imp

[jira] [Comment Edited] (YARN-9049) Add application submit data to state store

2018-11-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16703500#comment-16703500 ] Botong Huang edited comment on YARN-9049 at 11/29/18 4:57 PM: --

[jira] [Commented] (YARN-8934) [GPG] Add JvmMetricsInfo and pause monitor

2018-11-28 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16702496#comment-16702496 ] Botong Huang commented on YARN-8934: Thanks [~BilwaST] for the patch. Committing to YA

[jira] [Commented] (YARN-9049) Add application submit data to state store

2018-11-28 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16702430#comment-16702430 ] Botong Huang commented on YARN-9049: Thanks [~bibinchundatt] for the patch! I just hav

[jira] [Commented] (YARN-8934) [GPG] Add JvmMetricsInfo and pause monitor

2018-11-27 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16700980#comment-16700980 ] Botong Huang commented on YARN-8934: Overall lgtm, one more small thing besides Bibin'

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-13 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685911#comment-16685911 ] Botong Huang commented on YARN-8898: +[~giovanni.fumarola] as well > Fix FederationIn

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-13 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685637#comment-16685637 ] Botong Huang commented on YARN-8898: For the record, I was leaning towards Solution 2

[jira] [Updated] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-9013: --- Attachment: YARN-9013-YARN-7402.v2.patch > [GPG] fix order of steps cleaning Registry entries in Appli

[jira] [Updated] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-9013: --- Attachment: YARN-9013-YARN-7402.v1.patch > [GPG] fix order of steps cleaning Registry entries in Appli

[jira] [Updated] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-9013: --- Parent Issue: YARN-7402 (was: YARN-5597) > [GPG] fix order of steps cleaning Registry entries in Appl

[jira] [Updated] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-9013: --- Issue Type: Sub-task (was: Task) Parent: YARN-5597 > [GPG] fix order of steps cleaning Regist

[jira] [Created] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Botong Huang (JIRA)
Botong Huang created YARN-9013: -- Summary: [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner Key: YARN-9013 URL: https://issues.apache.org/jira/browse/YARN-9013 Project: Hadoop YARN

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

2018-11-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682964#comment-16682964 ] Botong Huang commented on YARN-8933: Thanks [~bibinchundatt] for the comments and revi

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

2018-11-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Fix Version/s: 3.3.0 2.10.0 > [AMRMProxy] Fix potential empty fields in allocation

[jira] [Commented] (YARN-8980) Mapreduce application container start fail after AM restart.

2018-11-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682962#comment-16682962 ] Botong Huang commented on YARN-8980: I agree. I am also worried about container leaks,

[jira] [Commented] (YARN-8980) Mapreduce application container start fail after AM restart.

2018-11-10 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682485#comment-16682485 ] Botong Huang commented on YARN-8980: Thanks [~bibinchundatt] for reporting. This is al

[jira] [Comment Edited] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

2018-11-08 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680622#comment-16680622 ] Botong Huang edited comment on YARN-8933 at 11/8/18 11:53 PM: --

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

2018-11-08 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680622#comment-16680622 ] Botong Huang commented on YARN-8933: Good questions, there are several aspects:  # Wh

[jira] [Comment Edited] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

2018-11-08 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675623#comment-16675623 ] Botong Huang edited comment on YARN-8933 at 11/8/18 12:25 AM: --

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-08 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680065#comment-16680065 ] Botong Huang commented on YARN-8984: bq. ContainerPBImpl#getAllocationTags() will new

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

2018-11-07 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Attachment: YARN-8933.v3.patch > [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

2018-11-07 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Summary: [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to Fede

[jira] [Comment Edited] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-07 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678606#comment-16678606 ] Botong Huang edited comment on YARN-8984 at 11/7/18 6:27 PM: -

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-07 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678606#comment-16678606 ] Botong Huang commented on YARN-8984: Took a quick look. It is expected for AMRMClient

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-07 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678554#comment-16678554 ] Botong Huang commented on YARN-8984: +[~kkaranasos] > AMRMClient#OutstandingSchedRequ

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677330#comment-16677330 ] Botong Huang commented on YARN-8898: Technically most of these info are already there

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

2018-11-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675623#comment-16675623 ] Botong Huang commented on YARN-8933: Ah good catch, and thx for reviewing! > [AMRMPr

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675609#comment-16675609 ] Botong Huang commented on YARN-8898: bq. Better option could be pushing along with App

[jira] [Commented] (YARN-7631) ResourceRequest with different Capacity (Resource) overrides each other in RM and thus lost

2018-11-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675566#comment-16675566 ] Botong Huang commented on YARN-7631: Please consider directly using _ResourceRequestSe

[jira] [Updated] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-11-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8893: --- Fix Version/s: 2.10.0 > [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client >

[jira] [Commented] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-11-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16673807#comment-16673807 ] Botong Huang commented on YARN-8893: Thanks [~giovanni.fumarola] for the review! Commi

[jira] [Commented] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-11-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16673748#comment-16673748 ] Botong Huang commented on YARN-8893: This is also a proper shutdown and close connecti

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-10-25 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16664064#comment-16664064 ] Botong Huang commented on YARN-8898: I meant I don't have the code. Feel free to take

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

2018-10-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661702#comment-16661702 ] Botong Huang commented on YARN-8933: TestContainerManager failure is not related and t

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-10-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661487#comment-16661487 ] Botong Huang commented on YARN-8898: Hi [~bibinchundatt], good questions. bq. Applica

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

2018-10-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Attachment: YARN-8933.v2.patch > [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

2018-10-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Summary: [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential null AvailableResource and NumClusterNode in allocation response

2018-10-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Attachment: YARN-8933.v1.patch > [AMRMProxy] Fix potential null AvailableResource and NumClusterNode i

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential null AvailableResource and NumClusterNode in allocation response

2018-10-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Issue Type: Sub-task (was: Task) Parent: YARN-5597 > [AMRMProxy] Fix potential null Available

[jira] [Created] (YARN-8933) [AMRMProxy] Fix potential null AvailableResource and NumClusterNode in allocation response

2018-10-22 Thread Botong Huang (JIRA)
Botong Huang created YARN-8933: -- Summary: [AMRMProxy] Fix potential null AvailableResource and NumClusterNode in allocation response Key: YARN-8933 URL: https://issues.apache.org/jira/browse/YARN-8933 Pr

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential null AvailableResource and NumClusterNode in allocation response

2018-10-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Component/s: federation amrmproxy > [AMRMProxy] Fix potential null AvailableResource

[jira] [Commented] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-10-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659262#comment-16659262 ] Botong Huang commented on YARN-8893: The cetest failure in NM is being tracked in YARN

[jira] [Commented] (YARN-8862) [GPG] Add Yarn Registry cleanup in ApplicationCleaner

2018-10-18 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655696#comment-16655696 ] Botong Huang commented on YARN-8862: Committed to YARN-7402. Thanks [~bibinchundatt] a

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-17 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Attachment: YARN-8862-YARN-7402.v6.patch > [GPG] add Yarn Registry cleanup in ApplicationCleaner > ---

[jira] [Commented] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-17 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654120#comment-16654120 ] Botong Huang commented on YARN-8862: Thanks [~bibinchundatt] and [~giovanni.fumarola]

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-17 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Attachment: YARN-8862-YARN-7402.v5.patch > [GPG] add Yarn Registry cleanup in ApplicationCleaner > ---

[jira] [Updated] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-10-17 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8893: --- Attachment: YARN-8893.v2.patch > [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client > ---

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-10-17 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653757#comment-16653757 ] Botong Huang commented on YARN-8898: Good catch, thanks for reporting! > Fix Federati

[jira] [Updated] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-10-16 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8893: --- Attachment: YARN-8893.v1.patch > [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client > ---

[jira] [Updated] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-10-16 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8893: --- Component/s: federation amrmproxy > [AMRMProxy] Fix thread leak in AMRMClientRelayer

[jira] [Updated] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-10-16 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8893: --- Issue Type: Sub-task (was: Task) Parent: YARN-5597 > [AMRMProxy] Fix thread leak in AMRMClien

[jira] [Created] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-10-16 Thread Botong Huang (JIRA)
Botong Huang created YARN-8893: -- Summary: [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client Key: YARN-8893 URL: https://issues.apache.org/jira/browse/YARN-8893 Project: Hadoop YARN

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-16 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Attachment: YARN-8862-YARN-7402.v4.patch > [GPG] add Yarn Registry cleanup in ApplicationCleaner > ---

[jira] [Updated] (YARN-8481) AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters

2018-10-16 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8481: --- Issue Type: Sub-task (was: Bug) Parent: YARN-5597 > AMRMProxyPolicies should accept heartbeat

[jira] [Commented] (YARN-8855) Application fails if one of the sublcluster is down.

2018-10-10 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645703#comment-16645703 ] Botong Huang commented on YARN-8855: Hi [~bibinchundatt], yes YARN-7652 can be the rea

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-10 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Attachment: YARN-8862-YARN-7402.v3.patch > [GPG] add Yarn Registry cleanup in ApplicationCleaner > ---

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Attachment: YARN-8862-YARN-7402.v2.patch > [GPG] add Yarn Registry cleanup in ApplicationCleaner > ---

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Attachment: YARN-8862-YARN-7402.v1.patch > [GPG] add Yarn Registry cleanup in ApplicationCleaner > ---

[jira] [Created] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Botong Huang (JIRA)
Botong Huang created YARN-8862: -- Summary: [GPG] add Yarn Registry cleanup in ApplicationCleaner Key: YARN-8862 URL: https://issues.apache.org/jira/browse/YARN-8862 Project: Hadoop YARN Issue Typ

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Issue Type: Sub-task (was: Task) Parent: YARN-7402 > [GPG] add Yarn Registry cleanup in Appli

[jira] [Commented] (YARN-7652) Handle AM register requests asynchronously in FederationInterceptor

2018-10-09 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16643789#comment-16643789 ] Botong Huang commented on YARN-7652: Thanks [~goiri] for the review and commit! > Han

[jira] [Commented] (YARN-8855) Application fails if one of the sublcluster is down.

2018-10-08 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642204#comment-16642204 ] Botong Huang commented on YARN-8855: Thanks [~rahulanand90] for reporting it! Which fe

[jira] [Updated] (YARN-7652) Handle AM register requests asynchronously in FederationInterceptor

2018-10-07 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7652: --- Attachment: YARN-7652.v2.patch > Handle AM register requests asynchronously in FederationInterceptor >

[jira] [Commented] (YARN-8837) TestNMProxy.testNMProxyRPCRetry Improvement

2018-10-06 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640751#comment-16640751 ] Botong Huang commented on YARN-8837: Nvm, it is fixed in YARN-8844 now. Please address

[jira] [Updated] (YARN-7652) Handle AM register requests asynchronously in FederationInterceptor

2018-10-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7652: --- Attachment: YARN-7652.v1.patch > Handle AM register requests asynchronously in FederationInterceptor >

[jira] [Updated] (YARN-5597) YARN Federation improvements

2018-10-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-5597: --- Attachment: YARN-7652.v1.patch > YARN Federation improvements > > >

[jira] [Updated] (YARN-5597) YARN Federation improvements

2018-10-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-5597: --- Attachment: (was: YARN-7652.v1.patch) > YARN Federation improvements > ---

[jira] [Commented] (YARN-8760) [AMRMProxy] Fix concurrent re-register due to YarnRM failover in AMRMClientRelayer

2018-10-01 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16634695#comment-16634695 ] Botong Huang commented on YARN-8760: Thanks [~giovanni.fumarola] for the review and co

[jira] [Commented] (YARN-8837) TestNMProxy.testNMProxyRPCRetry Improvement

2018-10-01 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16634523#comment-16634523 ] Botong Huang commented on YARN-8837: Other than improving surfacing the exception mess

[jira] [Commented] (YARN-8760) [AMRMProxy] Fix concurrent re-register due to YarnRM failover in AMRMClientRelayer

2018-10-01 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16634229#comment-16634229 ] Botong Huang commented on YARN-8760: TestNMProxy failure is irrelevant and is tracked

[jira] [Updated] (YARN-8760) [AMRMProxy] Fix concurrent re-register due to YarnRM failover in AMRMClientRelayer

2018-09-27 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8760: --- Attachment: YARN-8760.v1.patch > [AMRMProxy] Fix concurrent re-register due to YarnRM failover in > A

[jira] [Commented] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-27 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630739#comment-16630739 ] Botong Huang commented on YARN-8696: Thanks [~giovanni.fumarola] for the review and co

[jira] [Updated] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8696: --- Attachment: YARN-8696-branch-2.v6.patch > [AMRMProxy] FederationInterceptor upgrade: home sub-cluster

[jira] [Updated] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8696: --- Attachment: (was: YARN-8696-branch-2.v6.patch) > [AMRMProxy] FederationInterceptor upgrade: home s

[jira] [Resolved] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang resolved YARN-7599. Resolution: Fixed > [GPG] ApplicationCleaner in Global Policy Generator > --

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16624388#comment-16624388 ] Botong Huang commented on YARN-7599: Committed to YARN-7402. Thanks [~bibinchundatt] f

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16624053#comment-16624053 ] Botong Huang commented on YARN-7599: Ah good point. v8 uploaded. Will commit pending o

[jira] [Updated] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7599: --- Attachment: YARN-7599-YARN-7402.v8.patch > [GPG] ApplicationCleaner in Global Policy Generator > -

[jira] [Updated] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8696: --- Attachment: YARN-8696-branch-2.v6.patch > [AMRMProxy] FederationInterceptor upgrade: home sub-cluster

[jira] [Updated] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-20 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7599: --- Attachment: YARN-7599-YARN-7402.v7.patch > [GPG] ApplicationCleaner in Global Policy Generator > -

[jira] [Updated] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-19 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8696: --- Attachment: YARN-8696.v6.patch > [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat

[jira] [Updated] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-19 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7599: --- Attachment: YARN-7599-YARN-7402.v6.patch > [GPG] ApplicationCleaner in Global Policy Generator > -

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-19 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621216#comment-16621216 ] Botong Huang commented on YARN-7599: Thanks [~bibinchundatt] for the comment! v6 patch

[jira] [Commented] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-19 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621060#comment-16621060 ] Botong Huang commented on YARN-8696: Unit test failure in TestCapacityOverTimePolicy i

  1   2   3   4   5   6   7   8   >