[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16618519#comment-16618519 ]
Bibin A Chundatt edited comment on YARN-7599 at 9/18/18 3:30 PM: ----------------------------------------------------------------- Thank you [~botong] for updated patch {quote} I should have excluded all apps that are still in YarnRM memory. That should eliminate the race condition you mentioned. What do you think? {quote} Yes , I agree with the same for fixing race. One concern is the response size. Since all applications are fetched from overall cluster. we could be fetching at worst case 5k x subclusters applications. was (Author: bibinchundatt): Thank you [~botong] for updated patch {quote} I should have excluded all apps that are still in YarnRM memory. That should eliminate the race condition you mentioned. What do you think? {quote} Yes , I aggree with the same. > [GPG] ApplicationCleaner in Global Policy Generator > --------------------------------------------------- > > Key: YARN-7599 > URL: https://issues.apache.org/jira/browse/YARN-7599 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Botong Huang > Assignee: Botong Huang > Priority: Minor > Labels: federation, gpg > Attachments: YARN-7599-YARN-7402.v1.patch, > YARN-7599-YARN-7402.v2.patch, YARN-7599-YARN-7402.v3.patch, > YARN-7599-YARN-7402.v4.patch > > > In Federation, we need a cleanup service for StateStore as well as Yarn > Registry. For the former, we need to remove old application records. For the > latter, failed and killed applications might leave records in the Yarn > Registry (see YARN-6128). We plan to do both cleanup work in > ApplicationCleaner in GPG -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org