Re: Profiling Hadoop Map Reduce with the 20.2 API

2010-08-16 Thread Hemanth Yamijala
David, >   It looks like calling configuration.setBoolean("mapred.task.profile", > true) will enable profiling with the 20.2 APIs.  I am able to see the > profiling output when I check the web interface.  Thanks for your help!  Is > there a good place to document this setting so others can find th

Re: Profiling Hadoop Map Reduce with the 20.2 API

2010-08-16 Thread David Jurgens
Hi Hemanth, It looks like calling configuration.setBoolean("mapred.task.profile", true) will enable profiling with the 20.2 APIs. I am able to see the profiling output when I check the web interface. Thanks for your help! Is there a good place to document this setting so others can find this

Re: Profiling Hadoop Map Reduce with the 20.2 API

2010-08-12 Thread Hemanth Yamijala
Hi, >   I recently started developing with Hadoop using the 20.2 API.  I'm looking > to profile one of my jobs but I haven't been able to find any documentation > about how to do this.  For the earlier (deprecated) API, there's some > documentation on how to profile with the JobConf class > (http:

Profiling Hadoop Map Reduce with the 20.2 API

2010-08-12 Thread David Jurgens
Hi, I recently started developing with Hadoop using the 20.2 API. I'm looking to profile one of my jobs but I haven't been able to find any documentation about how to do this. For the earlier (deprecated) API, there's some documentation on how to profile with the JobConf class ( http://hadoop.