Re: [DISCUSS] Hadoop 3 and our dependencies generally

[Mike Drob]

There is a 3.0.0-alpha4 release currently available as a non-snapshot
version.

I'm not sure it comes with API stability guarantees at all, IIRC the Hadoop
community is planning on providing that for their betas.

Mike

On Thu, Aug 3, 2017 at 12:17 PM, Christopher  wrote:

> +1 from me, too, but I'd like to review what actually changes in master for
> the migration to happen. I don't know much about Hadoop 3. I'm curious what
> the releases will look like (AFAIK, it's only snapshot builds right now; is
> that correct?), how our dependencies will change, and what API stability
> guarantees it offers.
>
> On Thu, Aug 3, 2017 at 12:59 PM Josh Elser  wrote:
>
> > +1 sounds like a good idea to me.
> >
> > On 8/3/17 10:08 AM, Sean Busbey wrote:
> > > Hi Folks!
> > >
> > > I think we need to start being more formal in planning for Hadoop 3.
> > > They're up to 3.0.0-alpha4 and are pushing towards API-locking
> betas[1].
> > >
> > > What do folks think about starting to push on an Accumulo 2.0 release
> > that
> > > only supports Hadoop 3? It would let us move faster, which we'll need
> to
> > do
> > > if we want to get any API changes in to the Hadoop 3 line.
> > >
> > > If we get started soon we can probably make it parity on beta/GA status
> > > with the Hadoop 3 line. That would give us a beta for Accumulo Summit
> and
> > > GA by end of the year.
> > >
> > > Going to just Hadoop 3+ would also be a sufficient dependency break
> that
> > we
> > > could do a pass updating any lagging dependencies to latest major
> > version.
> > >
> > >
> > > [1]:
> > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release
> > >
> >
>

Re: [DISCUSS] Hadoop 3 and our dependencies generally

[Christopher]

+1 from me, too, but I'd like to review what actually changes in master for
the migration to happen. I don't know much about Hadoop 3. I'm curious what
the releases will look like (AFAIK, it's only snapshot builds right now; is
that correct?), how our dependencies will change, and what API stability
guarantees it offers.

On Thu, Aug 3, 2017 at 12:59 PM Josh Elser  wrote:

> +1 sounds like a good idea to me.
>
> On 8/3/17 10:08 AM, Sean Busbey wrote:
> > Hi Folks!
> >
> > I think we need to start being more formal in planning for Hadoop 3.
> > They're up to 3.0.0-alpha4 and are pushing towards API-locking betas[1].
> >
> > What do folks think about starting to push on an Accumulo 2.0 release
> that
> > only supports Hadoop 3? It would let us move faster, which we'll need to
> do
> > if we want to get any API changes in to the Hadoop 3 line.
> >
> > If we get started soon we can probably make it parity on beta/GA status
> > with the Hadoop 3 line. That would give us a beta for Accumulo Summit and
> > GA by end of the year.
> >
> > Going to just Hadoop 3+ would also be a sufficient dependency break that
> we
> > could do a pass updating any lagging dependencies to latest major
> version.
> >
> >
> > [1]:
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release
> >
>

Re: [DISCUSS] Hadoop 3 and our dependencies generally

[Josh Elser]

+1 sounds like a good idea to me.

On 8/3/17 10:08 AM, Sean Busbey wrote:

Hi Folks!

I think we need to start being more formal in planning for Hadoop 3.
They're up to 3.0.0-alpha4 and are pushing towards API-locking betas[1].

What do folks think about starting to push on an Accumulo 2.0 release that
only supports Hadoop 3? It would let us move faster, which we'll need to do
if we want to get any API changes in to the Hadoop 3 line.

If we get started soon we can probably make it parity on beta/GA status
with the Hadoop 3 line. That would give us a beta for Accumulo Summit and
GA by end of the year.

Going to just Hadoop 3+ would also be a sufficient dependency break that we
could do a pass updating any lagging dependencies to latest major version.


[1]: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release

Re: [DISCUSS] Hadoop 3 and our dependencies generally

[Keith Turner]

I am in favor of going to Hadoop 3 for Accumulo 2.  If we do this then
Accumulo 2 can not release until after Hadoop 3 does.  Any idea when
Hadoop 3 will release?

On Thu, Aug 3, 2017 at 10:08 AM, Sean Busbey  wrote:
> Hi Folks!
>
> I think we need to start being more formal in planning for Hadoop 3.
> They're up to 3.0.0-alpha4 and are pushing towards API-locking betas[1].
>
> What do folks think about starting to push on an Accumulo 2.0 release that
> only supports Hadoop 3? It would let us move faster, which we'll need to do
> if we want to get any API changes in to the Hadoop 3 line.
>
> If we get started soon we can probably make it parity on beta/GA status
> with the Hadoop 3 line. That would give us a beta for Accumulo Summit and
> GA by end of the year.
>
> Going to just Hadoop 3+ would also be a sufficient dependency break that we
> could do a pass updating any lagging dependencies to latest major version.
>
>
> [1]: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release
> --
> busbey

Re: [DISCUSS] Hadoop 3 and our dependencies generally

[Michael Hogue]

All,

   For what it's worth, I'd attempted to run both 1.7.x and 1.8.x on Hadoop
3 and ran into a fairly straightforward dependency issue [1] that, when
addressed, should allow current Accumulo versions to run on Hadoop 3.
Hopefully this means that it's not a large lift to get to the point you're
aiming for.

Thanks,
Mike

[1] https://issues.apache.org/jira/browse/ACCUMULO-4611


On Thu, Aug 3, 2017 at 10:09 AM Sean Busbey  wrote:

> Hi Folks!
>
> I think we need to start being more formal in planning for Hadoop 3.
> They're up to 3.0.0-alpha4 and are pushing towards API-locking betas[1].
>
> What do folks think about starting to push on an Accumulo 2.0 release that
> only supports Hadoop 3? It would let us move faster, which we'll need to do
> if we want to get any API changes in to the Hadoop 3 line.
>
> If we get started soon we can probably make it parity on beta/GA status
> with the Hadoop 3 line. That would give us a beta for Accumulo Summit and
> GA by end of the year.
>
> Going to just Hadoop 3+ would also be a sufficient dependency break that we
> could do a pass updating any lagging dependencies to latest major version.
>
>
> [1]:
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release
> --
> busbey
>