[
https://issues.apache.org/jira/browse/MAPREDUCE-2855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kumar Vavilapalli updated MAPREDUCE-2855:
-----------------------------------------------
Resolution: Fixed
Fix Version/s: 0.23.2
Release Note: Passing a cached class-loader to ResourceBundle creator to
minimize counter names lookup time.
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Just committed to trunk, branch-0.23 and branch-0.23.2. Thanks Sid for the
patch and the validation!
Thanks Todd for filing the ticket and suggesting a fix!
> ResourceBundle lookup during counter name resolution takes a lot of time
> ------------------------------------------------------------------------
>
> Key: MAPREDUCE-2855
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2855
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.23.0
> Reporter: Todd Lipcon
> Assignee: Siddharth Seth
> Labels: mrv2
> Fix For: 0.23.2
>
> Attachments: MR2855.txt
>
>
> Loading a job status page in trunk takes a lot of time, and it seems like
> most of the time is spent resolving counter names. Looking through the JDK
> source, ResourceBundle.getBundle(String) ends up calling getClassContext()
> which is not very efficient. I think if we pass our own classloader manually
> it will be faster. In Counters.incrAllCounters, we may also be able to avoid
> setting the counter name if one is already set.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
