Re: Terribly long HDFS timeouts while appending to HLog

2012-11-07 Thread David Charle
u should upgrade to 0.94 as you also had issues with row locks as newer version had improved miniBatchPut code base. On Nov 7, 2012, at 9:57 AM, Varun Sharma wrote: > Thanks for the response. One more point is that I am running hadoop 1.0.4 > with hbase 0.92 - not sure if that is known to have

Re: Backup strategy

2012-11-15 Thread David Charle
Thanks Carlos. Do you have any rough estimates on timings on snapshot ? (by leaving copy) On Thu, Nov 15, 2012 at 9:52 AM, Espinoza,Carlos wrote: > This is what we've been using https://github.com/oclc/HBase-Backup > > -Original Message- > From: David Charle [mailto:dbc

recommended nodes

2012-11-26 Thread David Charle
hi what's the recommended nodes for NN, hmaster and zk nodes for a larger cluster, lets say 50-100+ also, what would be the ideal replication factor for larger clusters when u have 3-4 racks ? -- David

Unbalanced region server

2012-04-23 Thread David Charle
Hi What can make a region server unbalanced when it comes to space ? (and possibly requests too). For example; I have 5 node cluster (replication factor of 3); and in which all 4 has same size; where as one node is almost double in size for /hbase. Any help will be appreciated; esp what makes th

Re: Unbalanced region server

2012-04-23 Thread David Charle
ionservers. > > On Mon, Apr 23, 2012 at 9:41 PM, David Charle > wrote: > > > Hi > > > > What can make a region server unbalanced when it comes to space ? (and > > possibly requests too). > > > > For example; I have 5 node cluster (replication factor of 3);

Re: Unbalanced region server

2012-04-23 Thread David Charle
Does balancer_switch=true; rebalances any skew in the existing keys or it only does for all new regions ? The requests seems to be oK across all servers. On Mon, Apr 23, 2012 at 8:03 PM, David Charle wrote: > Thanks Bryan. > > Here is the regions count: > > 1: 2616 > 2: 2620 &

Re: Unbalanced region server

2012-04-23 Thread David Charle
David > Sent from iPhone. > > On Apr 23, 2012, at 11:39 PM, David Charle wrote: > > > Does balancer_switch=true; rebalances any skew in the existing keys or it > > only does for all new regions ? The requests seems to be oK across all > > servers. > > &g

0.20 to 0.90 upgrade

2012-04-25 Thread David Charle
As per the docs, it looks like painless to upgrade from 0.20.3 to 0.90 (only need to run upgrade script if upgrading to 0.92). http://hbase.apache.org/book/upgrading.html#upgrade0.90 Anyone has experience in upgrading from 0.20 to 0.90 or something similar with major upgrade ? Do we need to upgrad

When node is down

2012-06-21 Thread David Charle
What is the best practice to remove a node and add the same node back for hbase/hadoop ? Currently in our 10 node cluster; 2 nodes went down (bad disk, so node is down as its the root volume+data); need to replace the disk and add them back. Any quick suggestions or pointers to doc for the right p

Re: When node is down

2012-06-22 Thread David Charle
t; Node goes down. > 10 min later, cluster sees node down. Should then be able to replicate the > missing blocks. > > Replace disk w new disk and rebuild file system. > Bring node up. > Rebalance cluster. > > That should be pretty much it. > > > On Jun 21, 2012, at 10

Re: When node is down

2012-06-22 Thread David Charle
be able to replicate > the > > missing blocks. > > > > Replace disk w new disk and rebuild file system. > > Bring node up. > > Rebalance cluster. > > > > That should be pretty much it. > > > > > > On Jun 21, 2012, at 10:17 PM, David Charle