[ https://issues.apache.org/jira/browse/MAPREDUCE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400780#comment-13400780 ]
Arun C Murthy commented on MAPREDUCE-4365: ------------------------------------------ Jie - You can just add the profiler params to mapred.(map,reduce).child.java.opts and the TT will add it to the tasks' jvm launch cmd. > Shipping Profiler Libraries by DistributedCache > ----------------------------------------------- > > Key: MAPREDUCE-4365 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4365 > Project: Hadoop Map/Reduce > Issue Type: New Feature > Affects Versions: 1.0.3 > Reporter: Jie Li > > Hadoop profiling is great for performance tuning and debugging, but currently > we can only use Java built-in profilers such as HProf, and for other > profilers we need to install them on all slave nodes first, which is > inconvenient for large clusters and sometimes impossible for production > clusters. > Supporting shipping profiler libraries using DistributedCache will solve this > problem. For example, in mapred.task.profile.params, we specify a profiler > library from the DistributedCache using special place holders such as > <foo.jar>, and Hadoop can look at the DistributedCache to replace <foo.jar> > with the localized path before launching the child jvm. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira