is it possible to set the number of reduce tasks in the wordcount
example when I launch the job by command line?
Thanks
Have you tried setting *mapred.reduce.tasks *property?
Regards,
Shahab
On Wed, Sep 25, 2013 at 6:01 PM, xeon xeonmailingl...@gmail.com wrote:
is it possible to set the number of reduce tasks in the wordcount example
when I launch the job by command line?
Thanks
In yarn 2.0.5, where I set this?
On 09/25/2013 11:16 PM, Shahab Yunus wrote:
Have you tried setting *mapred.reduce.tasks *property?
Regards,
Shahab
On Wed, Sep 25, 2013 at 6:01 PM, xeon xeonmailingl...@gmail.com
mailto:xeonmailingl...@gmail.com wrote:
is it possible to set the number
See an example here:
http://www.crobak.org/2011/12/getting-started-with-apache-hadoop-0-23-0/
For the 'pi' program. Basically you will specify it through the command
line interface.
On Wed, Sep 25, 2013 at 6:17 PM, xeon xeonmailingl...@gmail.com wrote:
In yarn 2.0.5, where I set this?
On
You can invoke the setNumReduceTasks on the Job object that you use to run the
MR job.
http://hadoop.apache.org/docs/r2.0.6-alpha/api/org/apache/hadoop/mapreduce/Job.html#setNumReduceTasks(int)
Or else you can set the property mapreduce.job.reduces in mapred-site.xml
mapreduce.job.reduces
Yeah, thanks Krishna for pointing out Yarn specific property name.
Regards,
Shahab
On Wed, Sep 25, 2013 at 6:54 PM, Krishna Pisupat
krishna.pisu...@gmail.comwrote:
You can invoke the setNumReduceTasks on the Job object that you use to run
the MR job.
