Thanks! Ted
On Wed, Jul 23, 2014 at 6:03 PM, Ted Yu <yuzhih...@gmail.com> wrote: > Please take a look at: > HBASE-9360 Enable 0.94 -> 0.96 replication to minimize upgrade down time > > Cheers > > > On Wed, Jul 23, 2014 at 10:12 AM, Guangle Fan <fanguan...@gmail.com> > wrote: > > > Not as described in the instruction page shutting down the cluster and do > > in-place upgrading. Yes, the process is to migrate table to another > cluster > > without service downtime. The other cluster is already 0.96. How is the > > process of doing migration ? > > > > > > On Tue, Jul 22, 2014 at 7:34 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > > > You mean the snapshot(s) taken by the 0.94.x release ? > > > 0.98 release is fully compatible in snapshot directory structure with > > that > > > of 0.94 > > > > > > Cheers > > > > > > > > > On Tue, Jul 22, 2014 at 7:01 PM, Qiang Tian <tian...@gmail.com> wrote: > > > > > > > what about snapshot? > > > > > > > > > > > > On Wed, Jul 23, 2014 at 7:49 AM, Guangle Fan <fanguan...@gmail.com> > > > wrote: > > > > > > > > > Hi, Ted you are right, hfiles on 0.94 cluster are v2 by default. I > > > > > actually don't need the convert tool. > > > > > > > > > > To migrate that data to another 0.96 cluster, does it work by > copying > > > > over > > > > > hfiles ? How to handle the meta data of the table in the new > cluster > > ? > > > > > > > > > > > > > > > On Tue, Jul 22, 2014 at 3:46 PM, Ted Yu <yuzhih...@gmail.com> > wrote: > > > > > > > > > > > The subject of this thread says '9.4' - I assume you meant '0.94' > > > > > release. > > > > > > If so, please make correction in the subject. > > > > > > > > > > > > Looking at hbase-default.xml from 0.94 branch: > > > > > > > > > > > > <property> > > > > > > <name>hfile.format.version</name> > > > > > > <value>2</value> > > > > > > <description> > > > > > > The HFile format version to use for new files. Set this > > to > > > 1 > > > > to > > > > > > test > > > > > > backwards-compatibility. The default value of this > option > > > > > should > > > > > > be > > > > > > consistent with FixedFileTrailer.MAX_VERSION. > > > > > > </description> > > > > > > </property> > > > > > > > > > > > > Are you running 0.94 cluster with the above config value being 1 > ? > > > > > > > > > > > > Cheers > > > > > > > > > > > > On Tue, Jul 22, 2014 at 3:27 PM, Guangle Fan < > fanguan...@gmail.com > > > > > > > > wrote: > > > > > > > > > > > > > Ted Thanks for your answer! > > > > > > > > > > > > > > Actually that wouldn't convert automatically. The problem is > 0.94 > > > is > > > > > > using > > > > > > > hfileV1, and that is online cluster that I can't shut down and > do > > > > hbase > > > > > > > upgrade/check file, thus I can't convert the file to v2. The > idea > > > is > > > > > copy > > > > > > > over the hfilleV1 to another 0.96 cluster and convert to > hfileV2. > > > Any > > > > > > handy > > > > > > > tool there I can use to do the convert and hfile loading in the > > new > > > > > > > cluster, or you guys have another way to handle this case ? > > > > Converting > > > > > to > > > > > > > sequence files ? > > > > > > > > > > > > > > > > > > > > > On Tue, Jul 22, 2014 at 3:00 PM, Ted Yu <yuzhih...@gmail.com> > > > wrote: > > > > > > > > > > > > > > > Guangle: > > > > > > > > For 0.94 cluster, you can perform major compaction after > which > > > your > > > > > > > HFiles > > > > > > > > would be converted to HFileV2. > > > > > > > > > > > > > > > > Cheers > > > > > > > > > > > > > > > > > > > > > > > > On Tue, Jul 22, 2014 at 1:54 PM, Guangle Fan < > > > fanguan...@gmail.com > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > Thanks Nick! > > > > > > > > > For some reason, I can't do a in-place upgrading for the > > > cluster. > > > > > Is > > > > > > > > there > > > > > > > > > a tool there I can use to convert hfileV1 to hfileV2 ? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Tue, Jul 22, 2014 at 1:43 PM, Nick Dimiduk < > > > > ndimi...@gmail.com> > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > Hi Guangle, > > > > > > > > > > > > > > > > > > > > Please have a look at the online book, there's a section > on > > > > > > upgrades. > > > > > > > > > Also, > > > > > > > > > > please consider upgrading to 0.98. The 0.96 line is in > > > minimum > > > > > > > > > maintenance > > > > > > > > > > mode and 0.98 is considered the stable/production line. > > > > > > > > > > > > > > > > > > > > http://hbase.apache.org/book.html#upgrading > > > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > > Nick > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Tue, Jul 22, 2014 at 1:24 PM, Guangle Fan < > > > > > fanguan...@gmail.com > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > Hi, All > > > > > > > > > > > > > > > > > > > > > > I have hfiles in HBase 9.4 cluster that I want to > migrate > > > to > > > > > > HBase > > > > > > > > 9.6 > > > > > > > > > > > cluster. > > > > > > > > > > > > > > > > > > > > > > What's the proper process to handle this ? > > > > > > > > > > > > > > > > > > > > > > Regards, > > > > > > > > > > > > > > > > > > > > > > Guangle > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
