[ https://issues.apache.org/jira/browse/MAPREDUCE-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley updated MAPREDUCE-5351: ---------------------------------- Resolution: Fixed Status: Resolved (was: Patch Available) Both patch and addendum patch have been applied by Arun, to both branch-1.2 and branch-1. Resolving as Fixed. Thanks, Sandy! > JobTracker memory leak caused by CleanupQueue reopening FileSystem > ------------------------------------------------------------------ > > Key: MAPREDUCE-5351 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5351 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: jobtracker > Affects Versions: 1.1.2 > Reporter: Sandy Ryza > Assignee: Sandy Ryza > Priority: Critical > Fix For: 1.2.1 > > Attachments: MAPREDUCE-5351-1.patch, MAPREDUCE-5351-2.patch, > MAPREDUCE-5351-addendum-1.patch, MAPREDUCE-5351-addendum.patch, > MAPREDUCE-5351.patch > > > When a job is completed, closeAllForUGI is called to close all the cached > FileSystems in the FileSystem cache. However, the CleanupQueue may run after > this occurs and call FileSystem.get() to delete the staging directory, adding > a FileSystem to the cache that will never be closed. > People on the user-list have reported this causing their JobTrackers to OOME > every two weeks. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira