On Fri, Apr 20, 2012 at 7:28 AM, Daryn Sharp <da...@yahoo-inc.com> wrote:

> I believe it's premature to release a non-alpha. branch-2.0 does not
> contain a full working implementation of host-based tokens that was
> introduced in 1.x (yes, it was done out of order...).  This is a very
> important feature that prevents tokens from being invalidated when a host's
> ip changes.  The token implementation in 2.0 requires daemons to be
> restarted and/or jobs resubmitted when the ip of an NN is changed (ex. an
> upgrade).  Host-based tokens prevents the need to restart all cluster that
> access a remote cluster that is upgraded.
>

I think blocking the release of a non-alpha on this feature is a bit nutty.
Not to undermine the work, but it only affects users who run security and
want to be able to move a NN/JT from one IP to another without killing
currently running jobs. Only a small fraction of the user base enables
security at all, and an even smaller fraction regularly wants to migrate a
master to a new IP mid-job.


>
> I've been actively working on the yarn side and close to completion.
>  Until that's complete, I feel we should consider 2.x an alpha so there's
> not an omission of a major feature.
>

I'd call it a minor feature.

-Todd


>
> On Apr 19, 2012, at 1:45 PM, Arun C Murthy wrote:
>
> > Yep, makes sense - I'll roll an rc0 for 2.0 after.
> >
> > However, we should consider whether HDFS protocols are 'ready' for us to
> commit to them for the foreseeable future, my sense is that it's a tad
> early - particularly with auto-failover not complete.
> >
> > Thus, we have a couple of options:
> > a) Call the first release here as *2.0.0-alpha* version (lots of ASF
> projects do this).
> > b) Just go with 2.0.0 and deem 2.0.x or 2.1.x as the first stable
> release and fwd-compatible release later.
> >
> > Given this is a major release (unlike something obscure like
> hadoop-0.23.0) I'm inclined to go with a) i.e. hadoop-2.0.0-alpha.
> >
> > Thoughts?
> >
> > Arun
> >
> > On Apr 19, 2012, at 12:24 AM, Eli Collins wrote:
> >
> >> Hey Arun,
> >>
> >> This vote passed a week or so ago, let's make it official?
> >>
> >> Also, are you still planning to roll a hadoop-2.0.0-rc0 of branch-2
> >> this week?  I think we should do that soon, if you're not planning to
> >> do this holler and I'd be happy to.  There's only 1 blocker left
> >> (http://bit.ly/I55LAd) and it's patch available, I think we should
> >> role an rc from branch-2 when it's merged.
> >>
> >> Thanks,
> >> Eli
> >>
> >> On Thu, Mar 29, 2012 at 4:07 PM, Arun C Murthy <a...@hortonworks.com>
> wrote:
> >>> 0.23.2 is just  a small set of bug-fixes on top of 0.23.1 and doesn't
> have NN HA etc.
> >>>
> >>> As I've noted separately, I plan to put out a hadoop-2.0.0-rc0 in a
> couple weeks with NN HA, PB for HDFS etc.
> >>>
> >>> thanks,
> >>> Arun
> >>>
> >>> On Mar 29, 2012, at 3:55 PM, Ted Yu wrote:
> >>>
> >>>> What are the issues fixed / features added in 0.23.2 compared to
> 0.23.1 ?
> >>>>
> >>>> Thanks
> >>>>
> >>>> On Thu, Mar 29, 2012 at 3:45 PM, Arun C Murthy <a...@hortonworks.com>
> wrote:
> >>>>
> >>>>> I've created a release candidate for hadoop-0.23.2 that I would like
> to
> >>>>> release.
> >>>>>
> >>>>> It is available at:
> http://people.apache.org/~acmurthy/hadoop-0.23.2-rc0/
> >>>>>
> >>>>> The maven artifacts are available via repository.apache.org.
> >>>>>
> >>>>> Please try the release and vote; the vote will run for the usual 7
> days.
> >>>>>
> >>>>> thanks,
> >>>>> Arun
> >>>>>
> >>>>> --
> >>>>> Arun C. Murthy
> >>>>> Hortonworks Inc.
> >>>>> http://hortonworks.com/
> >>>>>
> >>>>>
> >>>>>
> >>>
> >>> --
> >>> Arun C. Murthy
> >>> Hortonworks Inc.
> >>> http://hortonworks.com/
> >>>
> >>>
> >
> > --
> > Arun C. Murthy
> > Hortonworks Inc.
> > http://hortonworks.com/
> >
> >
>
>


-- 
Todd Lipcon
Software Engineer, Cloudera

Reply via email to