I don't think HADOOP-9972 is a must-do for the next Apache release, whatever version number it ends up having. It's just adding a new API, not changing any existing ones, and it can be done entirely in generic code. (The globber doesn't involve FileSystem or AFS subclasses).
My understanding is that GA is about stabilizing APIs rather than achieving feature completeness on symlinks. Colin On Wed, Oct 2, 2013 at 6:01 PM, Andrew Wang <andrew.w...@cloudera.com> wrote: > If we're serious about not breaking compatibility after GA, then we need to > slow down and make sure we get these new APIs right, or can add them in a > compatible fashion. > > HADOOP-9984 ended up being a bigger change than initially expected, and we > need to break compatibility with out-of-tree FileSystems to do it properly. > I would like to see HADOOP-9972 in as well (globLinkStatus), and there are > open questions on HADOOP-9984 about changing PathFilter and > FileStatus.getPath() semantics (which would be incompatible). Yes, we could > just +1 HADOOP-9984 and stamp 2.2.0 on it, but I think it looks bad to then > immediately turn around and release an incompatible 2.3. > > My preference is still for a 2.1.2 with the above API questions resolved, > then an actual API-stable 2.2.0 GA. This is already punting out all the > other related FS/tooling changes that we think can be done compatibly but > are still pretty crucial: shell, distcp, webhdfs, hftp; it'd be great to > get help on any of these. > > Thanks, > Andrew > > > On Wed, Oct 2, 2013 at 2:56 PM, Roman Shaposhnik <r...@apache.org> wrote: > >> On Tue, Oct 1, 2013 at 5:15 PM, Vinod Kumar Vavilapalli >> <vino...@hortonworks.com> wrote: >> > +1. We should get an RC as soon as possible so that we can get all the >> downstream components to sign off. >> > The earlier the better. >> >> On this very note -- would there be any interest in joining efforts >> with the Bigtop integration aimed at Hadoop 2.2.x based release >> of all the Hadoop ecosystem projects? >> >> Our current plan is to release Bigtop 0.7.0 within a couple of weeks. >> That will be the last stable 2.0.x-based release. Bigtop 0.8.0 is supposed >> to >> be based on Hadoop 2.x that gets us (Bigtop community) as close as possible >> to the Hadoop's GA. Here's more on what we'll be doing with Bigtop 0.8.0: >> >> http://comments.gmane.org/gmane.comp.apache.incubator.bigtop.devel/10769 >> >> Of course, on the Bigtop side of things we're stuck with all the necessary >> integration work anyway, but if there's anything at all that folks are >> willing >> to help us and the bigger Hadoop community with that would be very >> much appreciated. I think both communities will benefit from this type >> of collaboration. >> >> On a practical side of things, as soon as the branch for 2.2.0 gets cut >> Bigtop can start publishing a complete set of Hadoop ecosystem >> artifacts built against that particular version and easily install-able >> on all of our supported systems. We can also start publishing VMs >> so that folks on OSes other than Linux can help us with testing. >> >> Thanks, >> Roman. >>
