> Are there performance hits for running in
> INFO/DEBUG/? What do most people suggest?

DEBUG until you get your HBase config under control

>> 5 of our HBase region servers were killed. First off, when this happens and
>> there are only 2 servers is there a possibility of data corruption and/or
>> loss?

No, unless you hit some sort of bug.

>> Secondly and more importantly, why does this happen and how can I resolve it?

The important line is:

>> 2011-08-24 15:20:47,202 INFO org.apache.zookeeper.ClientCnxn: Client
>> session timed out, have not heard from server in 26666ms for sessionid

This indicates that either your ZK server was GCing for 26 seconds or
your region server was. Either way it ended up in:

>> org.apache.zookeeper.KeeperException$SessionExpiredException: 
>> KeeperErrorCode = Session expired

Which is 13.6.2.7 here:
http://hbase.apache.org/book/trouble.rs.html#trouble.rs.runtime

J-D

Reply via email to