Re: how to reduce hbase-regionserver connection retries to zookeeper

2014-07-29 Thread oc tsdb
ues for the following config parameters (values below are > only for illustration): > > config.setInt("zookeeper.recovery.retry", 1); > config.setInt("zookeeper.recovery.retry.intervalmill", 1000); > > What hbase release are you using ? > > Cheers

how to reduce hbase-regionserver connection retries to zookeeper

2014-07-29 Thread oc tsdb
Hi, if the namenode (or zookeeper) is down for some reason, hbase-regionserver(on datanode) keep retrying to connect to zookeeper continuously for long time. We tried by setting "hbase.client.retries.number" to 1 in hbase-site.xml, But no effect. Can someone please let us know, hbase configurati

restoring old hbase backup in new hbase

2014-07-29 Thread oc tsdb
Hi, We are planning to move our cluster from hbase 0.94.14 to 0.98.2. Our query is - If we have backup taken(using snapshots) on hbase 0.94.14, can we restore the same backup on newer version of hbase 0.98.2? Thanks oc.tsdb

incremental cluster backup using snapshots

2014-07-10 Thread oc tsdb
Hi, Does new hbase version(>0.99) supports incremental backup using snapshots? If not supported in current releases, is it planned to add in future releases? can we export snapshots to local file system directly? Thanks oc.tsdb

Re: HBase 0.98 rpm

2014-06-03 Thread oc tsdb
bigtop/build/hbase//.rpm > > You can find rpm's under output/hbase/ > > Cheers > > > On Mon, Jun 2, 2014 at 10:52 PM, oc tsdb wrote: > > > Hi, > > > > To build rpm, we downloaded HBase 0.98.2 src from apache download link( > > > http://m

Re: HBase 0.98 rpm

2014-06-02 Thread oc tsdb
Vissapragada wrote: > On Tue, May 27, 2014 at 2:38 PM, oc tsdb wrote: > > > Hi , > > > > 1) Where can we find hbase.098 tar > > with hbase 0.98 directory structure similar to hbase-0.94.19 ? > > i,e .. > > > > Directory structure of hbase 0.98 >

HBase 0.98 rpm

2014-05-27 Thread oc tsdb
Hi , 1) Where can we find hbase.098 tar with hbase 0.98 directory structure similar to hbase-0.94.19 ? i,e .. Directory structure of hbase 0.98 # ls bin/ dev-support/ hbase-common/ hbase-hadoop2-compat/ hbase-prefix-tree/ hbase-shell/ LICENSE.txt README.txt CHANGES.txt h

How to remove duplicate data in HBase?

2014-01-17 Thread oc tsdb
Hi all, We want to know if there is any option to remove duplicate data in Hbase based on column family dynamically? Thanks, OC

directly export hbase snapshots to local fs

2013-12-12 Thread oc tsdb
Hi, We are using HBase 0.94.14 and have only one cluster with 1NN and 4 DNs. We are trying to export snapshot directly to local system(e.g local fs path: /tmp/hbase_backup) as specified below.It is just exporting/copying snapshots (.hbase-snapshot) but not actual data(.archive).Why the below comm

Re: HBase 0.94.10 snapshot FileNotFoundException exception

2013-12-10 Thread oc tsdb
a "clone" (that > in your case the is the restore of a snapshot of a restored table). > This problem was fixed as part of HBASE-8760, which should be integrated in > 0.94.12 > > > Matteo > > > > On Tue, Dec 10, 2013 at 10:00 AM, oc tsdb wrote: > > >

Re: HBase 0.94.10 snapshot FileNotFoundException exception

2013-12-10 Thread oc tsdb
created in Step 1 means > - from a shell in Cluster-2 export snapshot to Cluster-1: hbase > org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot snapshotName ... > - from a shell on Cluster-1 verify snapshot with: hbase > org.apache.hadoop.hbase.snapshot.SnapshotInfo -sna

HBase 0.94.10 snapshot FileNotFoundException exception

2013-12-09 Thread oc tsdb
Hi, we are taking tsdb data backup using HBase snapshots. We tested the scenario as mentioned below: 1. Created snapshots and exported all snapshots successfully. Exported data contains archive+hbase-snapshot 2. Started HBase from scratch (removed all Hbase tabled and created again) 3. Succe

Re: HBase snapshot export - mappers

2013-12-06 Thread oc tsdb
t to use. > each machine will get N files to copy based on: total files to export / > nmappers > > Matteo > > > > On Thu, Dec 5, 2013 at 12:58 PM, oc tsdb wrote: > > > Hi, > > > > > > While exporting HBase snapshots we need to specify number of ma

HBase snapshot export - mappers

2013-12-05 Thread oc tsdb
Hi, While exporting HBase snapshots we need to specify number of mappers to use as mentioned below.To get better performance how many mappers can be used and please let us know based on which parameters we need to decide on number of mappers to use.I am new to HBase. Please refer if there are go

Re: HBase ExportSnapshot

2013-12-03 Thread oc tsdb
.apache.hadoop.hbase.io.FileLink.getFileStatus(FileLink.java:376) > > > On Mon, Dec 2, 2013 at 10:01 PM, oc tsdb wrote: > > > here is snapshot export logs. > > > > mastre log: > > === > > 2013-12-02 21:54:30,840 INFO org.apache.hadoop.hbase.mast

Re: HBase ExportSnapshot

2013-12-02 Thread oc tsdb
onf); > > For 'file:///tmp/hbase_backup' argument, outputFs would be an instance of > org.apache.hadoop.fs.LocalFileSystem. > > Cheers > > > On Mon, Dec 2, 2013 at 9:06 PM, oc tsdb wrote: > > > We see same logs for both options > > > > 013-

Re: HBase ExportSnapshot

2013-12-02 Thread oc tsdb
gt; > HBASE-8760 possible loss of data in snapshot taken after region split > > r1507792 | mbertozzi | 2013-07-28 05:17:39 -0700 (Sun, 28 Jul 2013) | 1 > line > > HBASE-9060 ExportSnapshot job fails if target path contains percentage >

HBase ExportSnapshot

2013-12-02 Thread oc tsdb
Hi, We have cluster with 4 data nodes and HBase version is 0.94.10. We have created snapshot for all hbase tables and trying to export snapshot in two ways. option 1.Export snapshot into same cluster hdfs hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot hbase_tbl_snapshot_name

Incremental backup of hbase with export not working

2013-12-02 Thread oc tsdb
Hi , In order to take incremental backup using export of hbase , we followed http://hbase.apache.org/book/ops_mgt.html#import Few things that need clarification are : 1. what does version mean? is is the same version number which we give during creation of hbase table ? 2. what if we don't sp

Re: snapshotexport to outside of cluster

2013-12-01 Thread oc tsdb
We want to use that exported data in case of any disaster happens. Thanks -OC On Sun, Dec 1, 2013 at 2:25 PM, Ted Yu wrote: > Since the remote server doesn't have hdfs, what would the backup be used > for ? > > Cheers > > On Nov 30, 2013, at 10:34 PM, oc tsdb wrote:

Re: snapshotexport to outside of cluster

2013-11-30 Thread oc tsdb
shot#ExportMapper#copyFile(), it directly copies > > data > > > to outputPath which is in the other cluster. > > > > > > Can you clarify what 'without copying to local file system' means ? > > > > > > Cheers > > > > >

Re: snapshotexport to outside of cluster

2013-11-29 Thread oc tsdb
and exporting to another cluster: > > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot > gs_1383068263 -copy-to hdfs://experiment-1d:8020/hbase -mappers 6 > > > On Fri, Nov 29, 2013 at 4:02 AM, oc tsdb wrote: > > > Hi, > > > > can someone please l

snapshotexport to outside of cluster

2013-11-29 Thread oc tsdb
Hi, can someone please let us know if we can export snapshots data directly to outside of cluster without copying to local. Please refer us if there are any blog with example. Below command is copying data to local file system under /tmp. hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -sn

Re: HBase snapshots

2013-11-19 Thread oc tsdb
Hi Matteo, Thanks a lot for your quick and detailed explanation. -OC On Tue, Nov 19, 2013 at 10:43 PM, Matteo Bertozzi wrote: > > 1.Is there a way to take incremental snapshots on HBase tables? > > > > Due to the nature of hbase, when hfiles gets compacted your table will not > share files wit

HBase snapshots

2013-11-19 Thread oc tsdb
Hi, We are using HBase 0.94.10 version. We could able to take snapshots for all hbase tables and export into another cluster successfully. To take HBase table snapshots we followed procedure given at below apache link. http://hbase.apache.org/book/ops.snapshots.html Purpose of taking snapshots

is jdk required to run hbase or jre alone is sufficient

2013-10-15 Thread oc tsdb
HI , I would like to know if JRE alone is sufficient to run HBASE services or JDK is required ? we are planning to install latest stable version of hbase Thanks, Oc.tsdb

How to recover data from hadoop/hbase cluster

2013-08-09 Thread oc tsdb
Hi, I am running a hadoop/hbase cluster with 6 nodes (1 name node, 5 data nodes). Two days back two of the machines went down due to some kernel crash. These machines were rebooted after some time. Meanwhile the cluster became unresponsive. Today, to create disk space and let other application se

Re: getting splitmanager debug logs continuously

2013-08-08 Thread oc tsdb
ion servers)? > > > On Thu, Aug 8, 2013 at 2:41 PM, oc tsdb wrote: > > > I am using hbase-0.92 > > > > Region server was not running on any of the nodes. > > > > Restarted the cluster. It started region server on all nodes except > > HMaster but still un

getting splitmanager debug logs continuously

2013-08-08 Thread oc tsdb
Hi, I am running a cluster with 6 nodes; Two of 6 nodes in my cluster went down (due to other application failure) and came back after some time (had to do a power reboot). When these nodes are back I use to get "WARN org.apache.hadoop.DFSClient: Failed to connect to , add to deadnodes and continu