On Thu, Jul 29, 2010 at 2:25 PM, Devajyoti Sarkar <[email protected]> wrote: > Hi, > > Is there a list of configuration parameters that can be set per job. > Specifically, can one set: > > - mapred.tasktracker.map.tasks.maximum > - mapred.tasktracker.reduce.tasks.maximum > - mapred.map.multithreadedrunner.threads > - mapred.child.java.opts > - mapred.task.timeout I'm not sure if the tasktracker options can be set from a job-level. I might be wrong, cause I've not tried this. > > Also, I am trying to migrate from 0.18.3 to 0.20.2. In the new API JobConf > is deprecated. How does one set the per job configuration parameters that > were available in JobConf (e.g. mapred.map.max.attempts, etc.). You would use the 'Configuration' class directly (before a Job object is made from it). Or use Job.getConfiguration() to access it from your 'Job' object. > > I guess there must be documentation on this but I could not find it. I > appreciate any advice you may have.
These things are also covered across the API, and many many wikis and blogs from the community. Here's a good, light article for porting driver/map/reduce to new API: http://sonerbalkir.blogspot.com/2010/01/new-hadoop-api-020x.html > > Cheers, > Dev > -- Harsh J www.harshj.com
