that helps
From: James Seigel ja...@tynt.com
To: common-user@hadoop.apache.org common-user@hadoop.apache.org
Sent: Thu, 26 May, 2011 6:04:07 PM
Subject: Re: No. of Map and reduce tasks
Set input split size really low, you might get something.
I'd rather you
How can I tell how the map and reduce tasks were spread accross the
cluster? I looked at the jobtracker web page but can't find that info.
Also, can I specify how many map or reduce tasks I want to be launched?
From what I understand is that it's based on the number of input files
passed
: No. of Map and reduce tasks
How can I tell how the map and reduce tasks were spread accross the
cluster? I looked at the jobtracker web page but can't find that info.
Also, can I specify how many map or reduce tasks I want to be launched?
From what I understand is that it's based on the number of input
Subject: No. of Map and reduce tasks
How can I tell how the map and reduce tasks were spread accross the
cluster? I looked at the jobtracker web page but can't find that info.
Also, can I specify how many map or reduce tasks I want to be launched?
From what I understand is that it's based
Anchlia mohitanch...@gmail.com
To: common-user@hadoop.apache.org
Sent: Thu, 26 May, 2011 2:48:20 PM
Subject: No. of Map and reduce tasks
How can I tell how the map and reduce tasks were spread accross the
cluster? I looked at the jobtracker web page but can't find that info.
Also, can I
: Thu, 26 May, 2011 2:48:20 PM
Subject: No. of Map and reduce tasks
How can I tell how the map and reduce tasks were spread accross the
cluster? I looked at the jobtracker web page but can't find that info.
Also, can I specify how many map or reduce tasks I want to be launched?
From what I
To: common-user@hadoop.apache.org
Sent: Thu, 26 May, 2011 2:48:20 PM
Subject: No. of Map and reduce tasks
How can I tell how the map and reduce tasks were spread accross the
cluster? I looked at the jobtracker web page but can't find that info.
Also, can I specify how many map or reduce tasks I want
PM
Subject: Re: No. of Map and reduce tasks
Set input split size really low, you might get something.
I'd rather you fire up some nix commands and pack together that file
onto itself a bunch if times and the put it back into hdfs and let 'er
rip
Sent from my mobile. Please excuse the typos
task. I am assuming this is definitely possible, though I
haven't verified in the code.
So , if one wants to pass different jvm options to map tasks and
reduce tasks, perhaps jobs.reuse.jvm.num.task should be set to 1
(never reuse) ?
thanks for your help,
- Vasilis