[ https://issues.apache.org/jira/browse/MAPREDUCE-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daryn Sharp updated MAPREDUCE-4229: ----------------------------------- Resolution: Fixed Fix Version/s: 0.23.5 2.0.3-alpha 3.0.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) I've committed to trunk, branch-2, and branch-23. Thanks Miomir and Bobby! > Intern counter names in the JT > ------------------------------ > > Key: MAPREDUCE-4229 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4229 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: jobtracker > Affects Versions: 1.0.2, 3.0.0, 2.0.2-alpha > Reporter: Todd Lipcon > Fix For: 3.0.0, 2.0.3-alpha, 0.23.5 > > Attachments: MAPREDUCE-4229-branch-0.23.patch, > MAPREDUCE-4229-branch-0.23.patch, MAPREDUCE-4229.patch, mr-4229.txt, > MR-4229.txt > > > In our experience, most of the memory in production JTs goes to storing > counter names (String objects and character arrays). Since most counter names > are reused again and again, it would be a big memory savings to keep a hash > set of already-used counter names within a job, and refer to the same object > from all tasks. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira