Hi Matt, I'd like to propose backporting some of the new fair scheduler features that have been out for almost 2 years now (in the 0.21 branch and trunk) into 0.20.205, especially https://issues.apache.org/jira/browse/MAPREDUCE-551 and https://issues.apache.org/jira/browse/MAPREDUCE-706. I will try to put together a patch for this. It should be a matter of taking the trunk fairscheduler directory and just tweaking anything that might be required to compile on 0.20.205; I don't think there are other major differences.
Matei On Sep 1, 2011, at 11:48 AM, Arun C Murthy wrote: > Thanks for the input guys - I'll look at MAPREDUCE-2601,MAPREDUCE-2779 & > HADOOP-7602. > > Arun > > On Sep 1, 2011, at 11:02 AM, John George wrote: > >> Hi Matt, >> I would like to bring HADOOP-7602 to your attention. I just filed it today >> and have a patch uploaded, but I think it should go in to 205. >> Thank you for considering. >> >> Regads, >> John George >> >> >> On 9/1/11 11:08 AM, "Rottinghuis, Joep" <jrottingh...@ebay.com> wrote: >> >>> Could you please add MAPREDUCE-2779 to the list as well? >>> This one has a patch as well. >>> >>> Thanks, >>> >>> Joep >>> ________________________________________ >>> From: Rottinghuis, Joep [jrottingh...@ebay.com] >>> Sent: Thursday, September 01, 2011 9:04 AM >>> To: general@hadoop.apache.org >>> Subject: RE: Content request for 0.20.205 Sustaining Release >>> >>> Hi Matt, >>> >>> IMHO MAPREDUCE-2610 should be included in 205 as well. >>> We applied it to our branch because our users had problems with getting >>> queue >>> information. >>> >>> Thanks, >>> >>> Joep >>> ________________________________________ >>> From: Matt Foley [mfo...@hortonworks.com] >>> Sent: Wednesday, August 31, 2011 11:16 AM >>> To: general@hadoop.apache.org >>> Subject: Re: Content request for 0.20.205 Sustaining Release >>> >>> Thank you, Nathan. And thanks for combining these requests, it's much >>> easier to review a single list than 10 or more emails. >>> >>> Does anyone else have requests for items to include in 0.20.205 - either >>> already submitted to 0.20-security, or pending work? >>> >>> Thanks, >>> --Matt >>> >>> On Wed, Aug 31, 2011 at 8:25 AM, Nathan Roberts >>> <nrobe...@yahoo-inc.com>wrote: >>> >>>> Hi Matt, >>>> >>>> My colleagues with experience running 0.20.203 (as well as many previous >>>> releases of Hadoop) in Yahoo!'s production environment are requesting that >>>> the following items be included as high priority sustaining improvements in >>>> 0.20.205. Rather than contributors sending in several separate requests to >>>> this mailing list, this email aggregates contributions from the following >>>> individuals: Daryn Sharp, Jeffrey Naisbitt, Kihwal Lee, Sherry Chen, Thomas >>>> Graves, Bharath Mundlapudi, Robert Joseph Evans, Anupam Seth, Eric Payne, >>>> John George. >>>> >>>> Recommendations and suggestions for this list of jiras came from folks with >>>> significant experience working with large scale Hadoop clusters within >>>> Yahoo! production environments, including Service Engineering teams, >>>> Quality >>>> Engineering teams, Solutions Engineering teams, and Development teams. >>>> >>>> Notes on the items listed below: >>>> >>>> * All the Jiras listed with the exception of HADOOP-7510, >>>> MAPREDUCE-2764, MAPREDUCE-2915, and HDFS-2257 have been committed to >>>> 0.20-security. These remaining four jiras are in-progress and should wrap >>>> up >>>> over the next few days. >>>> * All of the jiras listed have been fixed in trunk with the following >>>> exceptions: >>>> * The four jiras listed above which are still being worked >>>> * MAPREDUCE-2780 - Similar to previous bullet. In progress now. >>>> * MAPREDUCE-2324 - Has a strong interaction with MR279 so filed >>>> MAPREDUCE-2723 to make sure this is handled correctly in yarn >>>> * MAPREDUCE-2729, MAPREDUCE-2621 - Don't make sense after integration >>>> of MR279 >>>> >>>> Thank you for considering this list of Jiras for inclusion in 0.20.205. >>>> Nathan Roberts >>>> >>>> ==== >>>> [list elided, please see archives at http://tinyurl.com/3k537hs ] >> >
