[ https://issues.apache.org/jira/browse/YARN-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15374202#comment-15374202 ]
Varun Saxena commented on YARN-5353: ------------------------------------ Committed this to trunk, branch-2, branch-2.8, branch-2.7 and branch-2.6 Thanks [~jlowe] for fixing the issue. > ResourceManager can leak delegation tokens when they are shared across apps > --------------------------------------------------------------------------- > > Key: YARN-5353 > URL: https://issues.apache.org/jira/browse/YARN-5353 > Project: Hadoop YARN > Issue Type: Bug > Components: resourcemanager > Affects Versions: 2.7.0, 2.6.1 > Reporter: Jason Lowe > Assignee: Jason Lowe > Priority: Critical > Fix For: 2.8.0, 2.6.5, 2.7.4 > > Attachments: YARN-5353.001.patch > > > Recently saw a ResourceManager go into heavy GC. Heap dump showed that there > were millions of delegation tokens on the heap. It looks like most of them > belonged to the appTokens map in DelegationTokenRenewer. When an app > completes and tokens are removed for it, I noticed that the appTokens entry > for the app is not cleaned up if tokens were shared with other active apps. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org