Re: Backup again

2009-02-12 Thread Billy Pearson
agaev" Newsgroups: gmane.comp.java.hadoop.hbase.user To: Sent: Thursday, February 12, 2009 11:15 AM Subject: Re: Backup again Erik, thank you for the answer. I am afraid my question not clear. I agree that we can backup database just by scanning it and writing the data somewhere

Re: Backup again

2009-02-12 Thread Michael Dagaev
Erik, thank you for the answer. I am afraid my question not clear. I agree that we can backup database just by scanning it and writing the data somewhere while the database is running. However, if we want to backup the database _by copying the underlying HDFS file system_ we have

Re: Backup again

2009-02-12 Thread Erik Holstad
Hi Michael! I don't think that it is true that you can only backup system that are down, the backup tools that are posted in HBASE-974 can be used on system that are up and running. What that will do for you is to scan the tables and serialize those to disk and the other way around when importing.

Backup again

2009-02-12 Thread Michael Dagaev
Hi, all As I understand from the discussions on the list, we can backup the file system only if Hbase is down. If we want to run backup when Hbase is up we can work on the Hbase level, i.e. use scan, MR export/import utils, etc. but we cannot backup on the file system level. Is it correct?

Re: Backup Again

2009-02-04 Thread Michael Dagaev
Looks like we can work around the problem just by changing the "hbase.rootdir" value used as a key in the map. M. On Wed, Feb 4, 2009 at 7:00 PM, Chris K Wensel wrote: > I think that would be slightly more troublesome than just passing an url > around. most of the heavy lifting is done inside Ta

Re: Backup Again

2009-02-04 Thread Chris K Wensel
I think that would be slightly more troublesome than just passing an url around. most of the heavy lifting is done inside TableInput/ OutputFormat (which is part of HBase). You need to pass reasonable properties all the way down. I think the Streamy guys might be touching on some of this, th

Re: Backup Again

2009-02-04 Thread Michael Dagaev
> Currently no. but we would love you to patch that in. If you clone the repo > and get it working, I'll merge it back from your repo. Currently, I would like just to work around that problem :) What about loading the Hbase client classes with different class loaders? M.

Re: Backup Again

2009-02-04 Thread Chris K Wensel
Currently no. but we would love you to patch that in. If you clone the repo and get it working, I'll merge it back from your repo. I'm thinking it is as simple as handing the URL to HBaseTap. thoughts? ckw On Feb 4, 2009, at 8:38 AM, Michael Dagaev wrote: Thanks, Chris BTW, is it possible

Re: Backup Again

2009-02-04 Thread Michael Dagaev
Thanks, Chris BTW, is it possible to run a few HBase clients in a single JVM? On Wed, Feb 4, 2009 at 6:28 PM, Chris K Wensel wrote: > Hey Michael > > You could probably use Cascading to migrate data between HBase clusters. > http://wiki.apache.org/hadoop/Hbase/Cascading > > But the code currentl

Re: Backup Again

2009-02-04 Thread Chris K Wensel
Hey Michael You could probably use Cascading to migrate data between HBase clusters. http://wiki.apache.org/hadoop/Hbase/Cascading But the code currently doesn't support multiple HBase cluster clients in a single JVM, but I'm sure it can be coded in quickly. (the code is hosted at github, so

Backup Again

2009-02-04 Thread Michael Dagaev
Hi, all I read HBASE-974 and HBASE-643 mentioned on the list but what do you think about copying tables from the production to a backup Hbase cluster ? I guess we do need a big iron for such a backup cluster. I understand that the copy can be implemented with MR but for now we can implement i