Re: Upgrading Hadoop from CDH3b3 to CDH3

2010-10-21 Thread Abhinay Mehta
I've got a couple of wines saved up, could be useful for this upgrade.
Thanks for the heads-up.

On 20 October 2010 17:23, Michael Segel  wrote:

>
> CDH3B3 is the latest.
>
> My suggestion is that you get a large bottle of your favorite alcoholic
> beverage and enjoy it while you're doing this upgrade.
>
> In B3 you have user hadoop going to hdfs and the introduction of user
> mapred.
> So your hdfs stuff has to be owned by hdfs:hadoop and mapred stuff owned by
> mapred:hadoop.
> (That's group hadoop btw)
>
> Then you have to make sure that your unix directories have the correct file
> permissions because if they don't hadoop fails.
>
> Also since you're not using the start-all, start-hbase scripts you have to
> write your own script that uses the /etc/init.d/hadoop* scripts.
>
> Then there are zookeeper issues...
>
> But when all said and done... its more stable than hbase-0.20.3 (Cloudera's
> earlier release of Hbase) and 0.89 seems fairly stable in B3. (We're still
> testing it and trying to break it.)
>
> HTH
>
> -Mike
>
>
> > Date: Wed, 20 Oct 2010 13:53:11 +0100
> > Subject: Re: Upgrading Hadoop from CDH3b3 to CDH3
> > From: abhinay.me...@gmail.com
> > To: common-user@hadoop.apache.org
> >
> > Yes you are right, we obviously have beta2 installed on our cluster too.
> > Thanks.
> >
> > On 20 October 2010 12:35, ed  wrote:
> >
> > > I don't think there is a stable CDH3 yet although we've been using
> CDH3B2
> > > and it has been pretty stable for us.  (at least I don't see it
> available
> > > on
> > > their website and they JUST announced CDH3B3 last week at HadoopWorld.
> > >
> > > ~Ed
> > >
> > >
> > > On Wed, Oct 20, 2010 at 5:57 AM, Abhinay Mehta <
> abhinay.me...@gmail.com
> > > >wrote:
> > >
> > > > Hi all,
> > > >
> > > > We currently have Cloudera's Hadoop beta 3 installed on our cluster,
> we
> > > > would like to upgrade to the latest stable release CDH3.
> > > > Is there documentation or recommended steps on how to do this?
> > > >
> > > > We found some docs on how to upgrade from CDH2 and CDHb2 to CDHb3
> here:
> > > >
> > > >
> > >
> https://docs.cloudera.com/display/DOC/Hadoop+Upgrade+from+CDH2+or+CDH3b2+to+CDH3b3
> > > > Are the same steps recommended to upgrade to CDH3?
> > > >
> > > > I'm hoping it's a lot easier to upgrade from beta3 to the latest
> stable
> > > > version than that document states?
> > > >
> > > > Thank you.
> > > > Abhinay Mehta
> > > >
> > >
>
>


RE: Upgrading Hadoop from CDH3b3 to CDH3

2010-10-20 Thread Michael Segel

CDH3B3 is the latest.

My suggestion is that you get a large bottle of your favorite alcoholic 
beverage and enjoy it while you're doing this upgrade.

In B3 you have user hadoop going to hdfs and the introduction of user mapred.
So your hdfs stuff has to be owned by hdfs:hadoop and mapred stuff owned by 
mapred:hadoop.
(That's group hadoop btw)

Then you have to make sure that your unix directories have the correct file 
permissions because if they don't hadoop fails.

Also since you're not using the start-all, start-hbase scripts you have to 
write your own script that uses the /etc/init.d/hadoop* scripts.

Then there are zookeeper issues...

But when all said and done... its more stable than hbase-0.20.3 (Cloudera's 
earlier release of Hbase) and 0.89 seems fairly stable in B3. (We're still 
testing it and trying to break it.)

HTH

-Mike


> Date: Wed, 20 Oct 2010 13:53:11 +0100
> Subject: Re: Upgrading Hadoop from CDH3b3 to CDH3
> From: abhinay.me...@gmail.com
> To: common-user@hadoop.apache.org
> 
> Yes you are right, we obviously have beta2 installed on our cluster too.
> Thanks.
> 
> On 20 October 2010 12:35, ed  wrote:
> 
> > I don't think there is a stable CDH3 yet although we've been using CDH3B2
> > and it has been pretty stable for us.  (at least I don't see it available
> > on
> > their website and they JUST announced CDH3B3 last week at HadoopWorld.
> >
> > ~Ed
> >
> >
> > On Wed, Oct 20, 2010 at 5:57 AM, Abhinay Mehta  > >wrote:
> >
> > > Hi all,
> > >
> > > We currently have Cloudera's Hadoop beta 3 installed on our cluster, we
> > > would like to upgrade to the latest stable release CDH3.
> > > Is there documentation or recommended steps on how to do this?
> > >
> > > We found some docs on how to upgrade from CDH2 and CDHb2 to CDHb3 here:
> > >
> > >
> > https://docs.cloudera.com/display/DOC/Hadoop+Upgrade+from+CDH2+or+CDH3b2+to+CDH3b3
> > > Are the same steps recommended to upgrade to CDH3?
> > >
> > > I'm hoping it's a lot easier to upgrade from beta3 to the latest stable
> > > version than that document states?
> > >
> > > Thank you.
> > > Abhinay Mehta
> > >
> >
  

Re: Upgrading Hadoop from CDH3b3 to CDH3

2010-10-20 Thread Abhinay Mehta
Yes you are right, we obviously have beta2 installed on our cluster too.
Thanks.

On 20 October 2010 12:35, ed  wrote:

> I don't think there is a stable CDH3 yet although we've been using CDH3B2
> and it has been pretty stable for us.  (at least I don't see it available
> on
> their website and they JUST announced CDH3B3 last week at HadoopWorld.
>
> ~Ed
>
>
> On Wed, Oct 20, 2010 at 5:57 AM, Abhinay Mehta  >wrote:
>
> > Hi all,
> >
> > We currently have Cloudera's Hadoop beta 3 installed on our cluster, we
> > would like to upgrade to the latest stable release CDH3.
> > Is there documentation or recommended steps on how to do this?
> >
> > We found some docs on how to upgrade from CDH2 and CDHb2 to CDHb3 here:
> >
> >
> https://docs.cloudera.com/display/DOC/Hadoop+Upgrade+from+CDH2+or+CDH3b2+to+CDH3b3
> > Are the same steps recommended to upgrade to CDH3?
> >
> > I'm hoping it's a lot easier to upgrade from beta3 to the latest stable
> > version than that document states?
> >
> > Thank you.
> > Abhinay Mehta
> >
>


Re: Upgrading Hadoop from CDH3b3 to CDH3

2010-10-20 Thread ed
I don't think there is a stable CDH3 yet although we've been using CDH3B2
and it has been pretty stable for us.  (at least I don't see it available on
their website and they JUST announced CDH3B3 last week at HadoopWorld.

~Ed


On Wed, Oct 20, 2010 at 5:57 AM, Abhinay Mehta wrote:

> Hi all,
>
> We currently have Cloudera's Hadoop beta 3 installed on our cluster, we
> would like to upgrade to the latest stable release CDH3.
> Is there documentation or recommended steps on how to do this?
>
> We found some docs on how to upgrade from CDH2 and CDHb2 to CDHb3 here:
>
> https://docs.cloudera.com/display/DOC/Hadoop+Upgrade+from+CDH2+or+CDH3b2+to+CDH3b3
> Are the same steps recommended to upgrade to CDH3?
>
> I'm hoping it's a lot easier to upgrade from beta3 to the latest stable
> version than that document states?
>
> Thank you.
> Abhinay Mehta
>


Upgrading Hadoop from CDH3b3 to CDH3

2010-10-20 Thread Abhinay Mehta
Hi all,

We currently have Cloudera's Hadoop beta 3 installed on our cluster, we
would like to upgrade to the latest stable release CDH3.
Is there documentation or recommended steps on how to do this?

We found some docs on how to upgrade from CDH2 and CDHb2 to CDHb3 here:
https://docs.cloudera.com/display/DOC/Hadoop+Upgrade+from+CDH2+or+CDH3b2+to+CDH3b3
Are the same steps recommended to upgrade to CDH3?

I'm hoping it's a lot easier to upgrade from beta3 to the latest stable
version than that document states?

Thank you.
Abhinay Mehta