On Tue, Oct 7, 2008 at 1:12 PM, Andy Li <[EMAIL PROTECTED]> wrote: > I think there should be some documents where it indicates that the > "setNumMapTaks" and "setNumReduceTaks" > will be override by the splitting. It was misleading at the first time > when > I use them. I expect that the files will be > split into blocks/chunks and each block/chunk will be assign to a Mapper. > The maximum Mapper count will be controlled > by the number specified in "setNumMapTaks" and "setNumReduceTaks". >
check the document: http://hadoop.apache.org/core/docs/r0.18.1/api/org/apache/hadoop/mapred/JobConf.html#setNumMapTasks(int) http://hadoop.apache.org/core/docs/r0.18.1/api/org/apache/hadoop/mapred/JobConf.html#setNumReduceTasks(int) > > Unfortunately, this was not the exact expectation base on the method name. > =( > Anyone know if this is the correct answer to this problem? or they are > actually 2 different things? > > Thanks, > -Andy >
