Re: Best way to limit the number of concurrent tasks per job on hadoop 0.20.2

capacity scheduler has been backported to 0.20.2 as part of https://issues.apache.org/jira/browse/MAPREDUCE-1105 . Note that you'll also need https://issues.apache.org/jira/browse/MAPREDUCE-1160 which fixes a logging bug in the JobTracker. Otherwise your logs will fill up. -- Renaud Delbru

Re: Best way to limit the number of concurrent tasks per job on hadoop 0.20.2

Thanks, we will try to test it next week. -- Renaud Delbru On 27/01/11 11:31, Steve Loughran wrote: On 27/01/11 10:51, Renaud Delbru wrote: Hi Koji, thanks for sharing the information, Is the 0.20-security branch planned to be a official release at some point ? Cheers If you can play with

Re: Best way to limit the number of concurrent tasks per job on hadoop 0.20.2

Hi Koji, thanks for sharing the information, Is the 0.20-security branch planned to be a official release at some point ? Cheers -- Renaud Delbru On 27/01/11 01:50, Koji Noguchi wrote: Hi Renaud, Hopefully it’ll be in 0.20-security branch that Arun is trying to push. Related (very abstract

Re: Best way to limit the number of concurrent tasks per job on hadoop 0.20.2

As it seems that the capacity and fair schedulers in hadoop 0.20.2 do not allow a hard upper limit in number of concurrent tasks, do anybody know any other solutions to achieve this ? -- Renaud Delbru On 25/01/11 11:49, Renaud Delbru wrote: Hi, we would like to limit the number of maximum

Re: Best way to limit the number of concurrent tasks per job on hadoop 0.20.2

configuration parameters 'maxMaps'. Am I right, or did we miss something ? cheers -- Renaud Delbru On 25/01/11 15:20, Harsh J wrote: Capacity Scheduler (or a version of it) does ship with the 0.20 release of Hadoop and is usable. It can be used to assign queues with a limited capacit

Best way to limit the number of concurrent tasks per job on hadoop 0.20.2

). [1] http://hadoop.apache.org/common/docs/r0.20.2/capacity_scheduler.html Regards, -- Renaud Delbru

Re: Hadoop Index Contrib

Hi Otis, issue has been opened [1], and first patch submitted. [1] https://issues.apache.org/jira/browse/MAPREDUCE-1722 -- Renaud Delbru On 21/04/10 19:16, Otis Gospodnetic wrote: Hi Renaud, I think you should just open a new one unless one specifically for that already exists (I'm gue

Re: Hadoop Index Contrib

Hi Otis, can you point me to an issue in JIRA where I can post the patch, or do I open a new issue ? Cheers -- Renaud Delbru On 21/04/10 13:48, Otis Gospodnetic wrote: Hi Renaud, I'm interested in the updated version, so +1 for getting your patch in JIRA. I'm not sure if there

Hadoop Index Contrib

for my need. If a person in charge of this contrib coudl contact me in person, I'll be happy to share the code with him. Cheers -- Renaud Delbru