Re: mapred.map.tasks and mapred.reduce.tasks parameter meaning

2012-02-23 Thread kaveh minooie
had trouble figuring out was that I wanted different number of map tasks for fetch jobs and I found out that the best way to indicate that is using the -numFetchers switch with the generate command http://wiki.apache.org/nutch/bin/nutch_generate -- Kaveh Minooie www.plutoz.com

RE: Dynamic changing of slaves

2012-02-22 Thread kaveh
sounds like what you r looking for is a custom scheduler. along the line of obviously not the FairScheduler, but it could give u some idea -Original Message- From: "theta" Sent: Wednesday, February 22, 2012 10:32am To: core-u...@hadoop.apache.org Subject: Dynamic changing of slaves