Re: No. of Map and reduce tasks

2011-05-31 Thread Mohit Anchlia
that helps From: James Seigel ja...@tynt.com To: common-user@hadoop.apache.org common-user@hadoop.apache.org Sent: Thu, 26 May, 2011 6:04:07 PM Subject: Re: No. of Map and reduce tasks Set input split size really low,  you might get something. I'd rather you

No. of Map and reduce tasks

2011-05-26 Thread Mohit Anchlia
How can I tell how the map and reduce tasks were spread accross the cluster? I looked at the jobtracker web page but can't find that info. Also, can I specify how many map or reduce tasks I want to be launched? From what I understand is that it's based on the number of input files passed

Re: No. of Map and reduce tasks

2011-05-26 Thread jagaran das
: No. of Map and reduce tasks How can I tell how the map and reduce tasks were spread accross the cluster? I looked at the jobtracker web page but can't find that info. Also, can I specify how many map or reduce tasks I want to be launched? From what I understand is that it's based on the number of input

Re: No. of Map and reduce tasks

2011-05-26 Thread Mohit Anchlia
Subject: No. of Map and reduce tasks How can I tell how the map and reduce tasks were spread accross the cluster? I looked at the jobtracker web page but can't find that info. Also, can I specify how many map or reduce tasks I want to be launched? From what I understand is that it's based

Re: No. of Map and reduce tasks

2011-05-26 Thread James Seigel
Anchlia mohitanch...@gmail.com To: common-user@hadoop.apache.org Sent: Thu, 26 May, 2011 2:48:20 PM Subject: No. of Map and reduce tasks How can I tell how the map and reduce tasks were spread accross the cluster? I looked at the jobtracker web page but can't find that info. Also, can I

Re: No. of Map and reduce tasks

2011-05-26 Thread Mohit Anchlia
: Thu, 26 May, 2011 2:48:20 PM Subject: No. of Map and reduce tasks How can I tell how the map and reduce tasks were spread accross the cluster? I looked at the jobtracker web page but can't find that info. Also, can I specify how many map or reduce tasks I want to be launched? From what I

Re: No. of Map and reduce tasks

2011-05-26 Thread James Seigel
To: common-user@hadoop.apache.org Sent: Thu, 26 May, 2011 2:48:20 PM Subject: No. of Map and reduce tasks How can I tell how the map and reduce tasks were spread accross the cluster? I looked at the jobtracker web page but can't find that info. Also, can I specify how many map or reduce tasks I want

Re: No. of Map and reduce tasks

2011-05-26 Thread jagaran das
PM Subject: Re: No. of Map and reduce tasks Set input split size really low, you might get something. I'd rather you fire up some nix commands and pack together that file onto itself a bunch if times and the put it back into hdfs and let 'er rip Sent from my mobile. Please excuse the typos

separate JVM flags for map and reduce tasks

2010-04-22 Thread Vasilis Liaskovitis
task. I am assuming this is definitely possible, though I haven't verified in the code. So , if one wants to pass different jvm options to map tasks and reduce tasks, perhaps jobs.reuse.jvm.num.task should be set to 1 (never reuse) ? thanks for your help, - Vasilis