Hadoop 0.22 update

2011-08-01 Thread Nigel Daley
Quick update on Hadoop 0.22. Candidate build of 0.22 is still blocked by a couple key issues: * https://issues.apache.org/jira/browse/MAPREDUCE-2178 * MapReduce build problem in our CI environment * HDFS & MapReduce test failures in our CI environment A couple people have expressed to me their i

Re: Hadoop 0.22 update

2011-08-02 Thread Milind.Bhandarkar
Having talked to various folks in the community about their willingness to stabilize and use 0.22 and make it production-quality, here is what I propose: 1. Cut a release 0.22.0 without mapreduce-2178 patch, with hadoop.security.authentication set to simple (I.e. No authentication). Make sure that

Re: Hadoop 0.22 update

2011-08-02 Thread Eli Collins
On Tue, Aug 2, 2011 at 12:19 PM, wrote: > Having talked to various folks in the community about their willingness to > stabilize and use 0.22 and make it production-quality, here is what I > propose: > > 1. Cut a release 0.22.0 without mapreduce-2178 patch, with > hadoop.security.authentication s

Re: Hadoop 0.22 update

2011-08-02 Thread Konstantin Boudnik
0.22 seems to be loaded enough to add value even with a couple of the bugs like mentioned. This is a significant step towards field-testing of 0.23 and so on and will give to applications on top of Hadoop a chance to with latest Apache release of what Hadoop might look like in the near future. +1

Re: Hadoop 0.22 update

2011-08-02 Thread Allen Wittenauer
On Aug 2, 2011, at 12:19 PM, wrote: > 1. Cut a release 0.22.0 without mapreduce-2178 patch, with > hadoop.security.authentication set to simple (I.e. No authentication). > Make sure that MR-2178 is highlighted as known-issue in the top-level dir > (create a KNOWN-ISSUES.txt ?), and carry out a

Re: Hadoop 0.22 update

2011-08-02 Thread Eli Collins
On Tue, Aug 2, 2011 at 12:25 PM, Eli Collins wrote: > On Tue, Aug 2, 2011 at 12:19 PM,   wrote: >> Having talked to various folks in the community about their willingness to >> stabilize and use 0.22 and make it production-quality, here is what I >> propose: >> >> 1. Cut a release 0.22.0 without m

Re: Hadoop 0.22 update

2011-08-02 Thread Devaraj Das
+1 to removing the TaskController code for the 0.22 release. In the MR-279 branch, the security issues identified in MAPREDUCE-2178 have been taken care of (to my knowledge). On Aug 2, 2011, at 12:58 PM, Eli Collins wrote: > On Tue, Aug 2, 2011 at 12:25 PM, Eli Collins wrote: >> On Tue, Aug 2

Re: Hadoop 0.22 update

2011-08-02 Thread Milind.Bhandarkar
Eli, I hope we don't have to remove the TaskTracker *grin*. Devaraj/Allen, You mean LinuxTaskController only, right ? The default is DefaultTaskController, which is not relevant to these discussions. +1. This is the easiest way to get 0.22.0 out. - Milind --- Milind Bhandarkar Greenplum Labs,

Re: Hadoop 0.22 update

2011-08-02 Thread Devaraj Das
Yes... I meant the LTC. On Aug 2, 2011, at 1:23 PM, wrote: > Eli, > > I hope we don't have to remove the TaskTracker *grin*. > > Devaraj/Allen, > > You mean LinuxTaskController only, right ? > > The default is DefaultTaskController, which is not relevant to these > discussions. > > +1. Th

Re: Hadoop 0.22 update

2011-08-02 Thread Matt Foley
+1 (non-binding). Sounds good to me. --Matt On Tue, Aug 2, 2011 at 1:27 PM, Devaraj Das wrote: > Yes... I meant the LTC. > > On Aug 2, 2011, at 1:23 PM, wrote: > > > Eli, > > > > I hope we don't have to remove the TaskTracker *grin*. > > > > Devaraj/Allen, > > > > You mean LinuxTaskControlle

Re: Hadoop 0.22 update

2011-08-02 Thread Eli Collins
On Tue, Aug 2, 2011 at 1:23 PM, wrote: > Eli, > > I hope we don't have to remove the TaskTracker *grin*. > > Devaraj/Allen, > > You mean LinuxTaskController only, right ? > Yup, meant the LTC. Thanks, Eli

Re: Hadoop 0.22 update

2011-08-02 Thread Nigel Daley
+1. n. On Aug 2, 2011, at 1:35 PM, Matt Foley wrote: > +1 (non-binding). Sounds good to me. > --Matt > > > On Tue, Aug 2, 2011 at 1:27 PM, Devaraj Das wrote: > >> Yes... I meant the LTC. >> >> On Aug 2, 2011, at 1:23 PM, wrote: >> >>> Eli, >>> >>> I hope we don't have to remove the Tas

Re: Hadoop 0.22 update

2011-08-03 Thread Milind.Bhandarkar
Nigel, I have created https://issues.apache.org/jira/browse/MAPREDUCE-2767, and uploaded the patch. Please review. Thanks. - milind --- Milind Bhandarkar Greenplum Labs, EMC ((Disclaimer: Opinions expressed in this email are those of the author, and do not necessarily represent the views of any

Re: Hadoop 0.22 update

2011-08-10 Thread onezero . jung
나의 iPad에서 보냄 2011. 8. 2. 오후 3:33 Nigel Daley 작성: > Quick update on Hadoop 0.22. Candidate build of 0.22 is still blocked by a > couple key issues: > * https://issues.apache.org/jira/browse/MAPREDUCE-2178 > * MapReduce build problem in our CI environment > * HDFS & MapReduce test failures in