Hi,

Try setting number of map tasks in the program itself. For example, in the
Wordcount example, you can set the number of maptasks in run method as

conf.setNumMapTasks<no. of map tasks>

I hope this answers your first query.

Regards,
V.V.Chaitanya Krishna
IIIT,Hyderabad


On Wed, Jul 16, 2008 at 1:47 AM, Wei Jiang <[EMAIL PROTECTED]> wrote:

> Hi all,
>
> I am a new user with hadoop and have some questions about it.
>
> 1)about setting the number of maps/reduces:  With running hadoop on a
> 8-node
> cluster, I set mapred.map.tasks to 64 and
> mapred.tasktracker.map.tasks.maximum to 8, but by examining the counter
> "launched map tasks" from the output, I found that hadoop launched from 96
> to110 map tasks in different jobs. The size of the dataset is 6.4GB and the
> dfs.block.size is set to be 64MB. Why is the number of launched map tasks
> different in different running jobs with the same dataset size and block
> size? Is there a way to make the hadoop launch the same number of map tasks
> as specified exactly?
>
> 2)about the launched map tasks. Does the number of launched map tasks imply
> that hadoop would spawn a new thread for each map task? How can I know the
> number of threads launched by hadoop in a particular job?
>
> Thanks very much~~
>
> --
> ---
> Wei
>

Reply via email to