restoring old hbase backup in new hbase

2014-07-29 Thread oc tsdb
Hi, We are planning to move our cluster from hbase 0.94.14 to 0.98.2. Our query is - If we have backup taken(using snapshots) on hbase 0.94.14, can we restore the same backup on newer version of hbase 0.98.2? Thanks oc.tsdb

how to reduce hbase-regionserver connection retries to zookeeper

2014-07-29 Thread oc tsdb
Hi, if the namenode (or zookeeper) is down for some reason, hbase-regionserver(on datanode) keep retrying to connect to zookeeper continuously for long time. We tried by setting hbase.client.retries.number to 1 in hbase-site.xml, But no effect. Can someone please let us know, hbase

incremental cluster backup using snapshots

2014-07-10 Thread oc tsdb
Hi, Does new hbase version(0.99) supports incremental backup using snapshots? If not supported in current releases, is it planned to add in future releases? can we export snapshots to local file system directly? Thanks oc.tsdb

Re: HBase 0.98 rpm

2014-06-03 Thread oc tsdb
You can find rpm's under output/hbase/ Cheers On Mon, Jun 2, 2014 at 10:52 PM, oc tsdb oc.t...@gmail.com wrote: Hi, To build rpm, we downloaded HBase 0.98.2 src from apache download link( http://mirror.sdunix.com/apache/hbase/hbase-0.98.2/hbase-0.98.2-src.tar.gz ) and other files

Re: HBase 0.98 rpm

2014-06-02 Thread oc tsdb
Vissapragada bhara...@cloudera.com wrote: On Tue, May 27, 2014 at 2:38 PM, oc tsdb oc.t...@gmail.com wrote: Hi , 1) Where can we find hbase.098 tar with hbase 0.98 directory structure similar to hbase-0.94.19 ? i,e .. Directory structure of hbase 0.98 # ls bin/ dev-support

HBase 0.98 rpm

2014-05-27 Thread oc tsdb
Hi , 1) Where can we find hbase.098 tar with hbase 0.98 directory structure similar to hbase-0.94.19 ? i,e .. Directory structure of hbase 0.98 # ls bin/ dev-support/ hbase-common/ hbase-hadoop2-compat/ hbase-prefix-tree/ hbase-shell/ LICENSE.txt README.txt CHANGES.txt

How to remove duplicate data in HBase?

2014-01-17 Thread oc tsdb
Hi all, We want to know if there is any option to remove duplicate data in Hbase based on column family dynamically? Thanks, OC

directly export hbase snapshots to local fs

2013-12-12 Thread oc tsdb
Hi, We are using HBase 0.94.14 and have only one cluster with 1NN and 4 DNs. We are trying to export snapshot directly to local system(e.g local fs path: /tmp/hbase_backup) as specified below.It is just exporting/copying snapshots (.hbase-snapshot) but not actual data(.archive).Why the below

Re: HBase 0.94.10 snapshot FileNotFoundException exception

2013-12-10 Thread oc tsdb
- from a shell on Cluster-1: clone_snapshot 'snapshotName', 'tableName' 4 and 5 I've no idea what you mean Matteo On Mon, Dec 9, 2013 at 11:25 AM, oc tsdb oc.t...@gmail.com wrote: Hi, we are taking tsdb data backup using HBase snapshots. We tested the scenario as mentioned below: 1

Re: HBase 0.94.10 snapshot FileNotFoundException exception

2013-12-10 Thread oc tsdb
resolution of a clone (that in your case the is the restore of a snapshot of a restored table). This problem was fixed as part of HBASE-8760, which should be integrated in 0.94.12 Matteo On Tue, Dec 10, 2013 at 10:00 AM, oc tsdb oc.t...@gmail.com wrote: Hi, Thanks for your help. More

HBase 0.94.10 snapshot FileNotFoundException exception

2013-12-09 Thread oc tsdb
Hi, we are taking tsdb data backup using HBase snapshots. We tested the scenario as mentioned below: 1. Created snapshots and exported all snapshots successfully. Exported data contains archive+hbase-snapshot 2. Started HBase from scratch (removed all Hbase tabled and created again) 3.

HBase snapshot export - mappers

2013-12-05 Thread oc tsdb
Hi, While exporting HBase snapshots we need to specify number of mappers to use as mentioned below.To get better performance how many mappers can be used and please let us know based on which parameters we need to decide on number of mappers to use.I am new to HBase. Please refer if there are

Re: HBase ExportSnapshot

2013-12-03 Thread oc tsdb
) On Mon, Dec 2, 2013 at 10:01 PM, oc tsdb oc.t...@gmail.com wrote: here is snapshot export logs. mastre log: === 2013-12-02 21:54:30,840 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=1 regions=1 average=1.0

Incremental backup of hbase with export not working

2013-12-02 Thread oc tsdb
Hi , In order to take incremental backup using export of hbase , we followed http://hbase.apache.org/book/ops_mgt.html#import Few things that need clarification are : 1. what does version mean? is is the same version number which we give during creation of hbase table ? 2. what if we don't

Re: HBase ExportSnapshot

2013-12-02 Thread oc tsdb
r1507792 | mbertozzi | 2013-07-28 05:17:39 -0700 (Sun, 28 Jul 2013) | 1 line HBASE-9060 ExportSnapshot job fails if target path contains percentage character (Jerry He) On Mon, Dec 2, 2013 at 9:19 AM, oc tsdb oc.t...@gmail.com wrote: Hi

Re: HBase ExportSnapshot

2013-12-02 Thread oc tsdb
' argument, outputFs would be an instance of org.apache.hadoop.fs.LocalFileSystem. Cheers On Mon, Dec 2, 2013 at 9:06 PM, oc tsdb oc.t...@gmail.com wrote: We see same logs for both options 013-12-02 09:47:41,311 INFO org.apache.hadoop.hbase.master.snapshot.TakeSnapshotHandler: Running

Re: snapshotexport to outside of cluster

2013-11-30 Thread oc tsdb
copying to local file system' means ? Cheers On Fri, Nov 29, 2013 at 8:49 PM, oc tsdb oc.t...@gmail.com wrote: Hi, thanks for your replay. We are able to export snapshot to another cluster But this is not what we are looking for. We want to export

snapshotexport to outside of cluster

2013-11-29 Thread oc tsdb
Hi, can someone please let us know if we can export snapshots data directly to outside of cluster without copying to local. Please refer us if there are any blog with example. Below command is copying data to local file system under /tmp. hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot

Re: snapshotexport to outside of cluster

2013-11-29 Thread oc tsdb
is a sample command exporting to another cluster: hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot gs_1383068263 -copy-to hdfs://experiment-1d:8020/hbase -mappers 6 On Fri, Nov 29, 2013 at 4:02 AM, oc tsdb oc.t...@gmail.com wrote: Hi, can someone please let us know if we can export

HBase snapshots

2013-11-19 Thread oc tsdb
Hi, We are using HBase 0.94.10 version. We could able to take snapshots for all hbase tables and export into another cluster successfully. To take HBase table snapshots we followed procedure given at below apache link. http://hbase.apache.org/book/ops.snapshots.html Purpose of taking snapshots

Re: HBase snapshots

2013-11-19 Thread oc tsdb
Hi Matteo, Thanks a lot for your quick and detailed explanation. -OC On Tue, Nov 19, 2013 at 10:43 PM, Matteo Bertozzi theo.berto...@gmail.comwrote: 1.Is there a way to take incremental snapshots on HBase tables? Due to the nature of hbase, when hfiles gets compacted your table will not

is jdk required to run hbase or jre alone is sufficient

2013-10-15 Thread oc tsdb
HI , I would like to know if JRE alone is sufficient to run HBASE services or JDK is required ? we are planning to install latest stable version of hbase Thanks, Oc.tsdb

How to recover data from hadoop/hbase cluster

2013-08-09 Thread oc tsdb
Hi, I am running a hadoop/hbase cluster with 6 nodes (1 name node, 5 data nodes). Two days back two of the machines went down due to some kernel crash. These machines were rebooted after some time. Meanwhile the cluster became unresponsive. Today, to create disk space and let other application

getting splitmanager debug logs continuously

2013-08-08 Thread oc tsdb
Hi, I am running a cluster with 6 nodes; Two of 6 nodes in my cluster went down (due to other application failure) and came back after some time (had to do a power reboot). When these nodes are back I use to get WARN org.apache.hadoop.DFSClient: Failed to connect to , add to deadnodes and

Re: getting splitmanager debug logs continuously

2013-08-08 Thread oc tsdb
(besides region servers)? On Thu, Aug 8, 2013 at 2:41 PM, oc tsdb oc.t...@gmail.com wrote: I am using hbase-0.92 Region server was not running on any of the nodes. Restarted the cluster. It started region server on all nodes except HMaster but still unresponsive. processes