gt; Date: Sun, 5 Oct 2014 15:05:05 +0200
> From: gor...@pragsis.com
> To: user@hadoop.apache.org
> Subject: Re: How to get the max number of reducers in Yarn
>
>
> Thanks for all your answers.
>
> So, if I don't ask for any concrete number of reduce, and I don&#x
2014 15:36:48
Asunto: Re: How to get the max number of reducers in Yarn
Hi.
(For Hadoop 2.2.0)
Nope. Number of mappers depends on number of splits (392 line of
JobSubmitter).
Number of reducers depends on property mapreduce.job.reduces.
So, you can setup like this:
final Configuration configur
Hi.
(For Hadoop 2.2.0)
Nope. Number of mappers depends on number of splits (392 line of
JobSubmitter).
Number of reducers depends on property mapreduce.job.reduces.
So, you can setup like this:
final Configuration configuration = new Configuration();
configuration.set("mapreduce.job.reduces"
In the MR1, the max reducer is a static value set in the mapred-site.xml. That
is the value you get in the API.
In the YARN, there is no such static value any more, so you can set any value
you like, it is up to RM to decide at runtime, how many reducer tasks are
available or can be granted to y
