Re: controlling no. of mapper tasks

2011-06-22 Thread Allen Wittenauer
On Jun 20, 2011, at 12:24 PM, praveen.pe...@nokia.com praveen.pe...@nokia.com wrote: Hi there, I know client can send mapred.reduce.tasks to specify no. of reduce tasks and hadoop honours it but mapred.map.tasks is not honoured by Hadoop. Is there any way to control number of map tasks?

Re: controlling no. of mapper tasks

2011-06-20 Thread David Rosenstrauch
On 06/20/2011 03:24 PM, praveen.pe...@nokia.com wrote: Hi there, I know client can send mapred.reduce.tasks to specify no. of reduce tasks and hadoop honours it but mapred.map.tasks is not honoured by Hadoop. Is there any way to control number of map tasks? What I noticed is that Hadoop is

RE: controlling no. of mapper tasks

2011-06-20 Thread GOEKE, MATTHEW (AG/1000)
at the default mapred-site.xml for your version). Matt -Original Message- From: praveen.pe...@nokia.com [mailto:praveen.pe...@nokia.com] Sent: Monday, June 20, 2011 2:44 PM To: mapreduce-user@hadoop.apache.org Subject: RE: controlling no. of mapper tasks Hi David, I think Hadoop is looking

Re: controlling no. of mapper tasks

2011-06-20 Thread David Rosenstrauch
: controlling no. of mapper tasks On 06/20/2011 03:24 PM, praveen.pe...@nokia.com wrote: Hi there, I know client can send mapred.reduce.tasks to specify no. of reduce tasks and hadoop honours it but mapred.map.tasks is not honoured by Hadoop. Is there any way to control number of map tasks? What I

RE: controlling no. of mapper tasks

2011-06-20 Thread GOEKE, MATTHEW (AG/1000)
...@nokia.com [mailto:praveen.pe...@nokia.com] Sent: Monday, June 20, 2011 3:13 PM To: mapreduce-user@hadoop.apache.org Subject: RE: controlling no. of mapper tasks Hi David, Thanks for the response. I didn't specify anything for no. of concurrent mappers but I do see that it shows as 10 on 50030

Re: controlling no. of mapper tasks

2011-06-20 Thread sridhar basam
On Mon, Jun 20, 2011 at 4:13 PM, praveen.pe...@nokia.com wrote: Hi David, Thanks for the response. I didn't specify anything for no. of concurrent mappers but I do see that it shows as 10 on 50030 (for 5 node cluster). So I believe hadoop is defaulting to no. of cores in the cluster which is