RE: RegionServer dying every two or three days

2012-01-04 Thread Ramkrishna S Vasudevan
Recently we faced a similar problem and it was due to GC config. Pls check your GC. Regards Ram -Original Message- From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack Sent: Thursday, January 05, 2012 2:50 AM To: user@hbase.apache.org Subject: Re: RegionServer dying

RE: hbase RegionServer dead suddenly

2012-01-02 Thread Ramkrishna S Vasudevan
If MemStore flush fails RS aborts. As per the below stack trace I find that the flushing was not Successful due to some failure in HDFS. Can you check the NN and DN logs at this time? Regards Ram -Original Message- From: xiaochao [mailto:cschy.2...@163.com] Sent: Saturday, December 3

RE: Connecting to google region server

2011-12-29 Thread Ramkrishna S Vasudevan
No ips are hardcoded in the code... Regards Ram -Original Message- From: Santiago Vázquez [mailto:santi...@zauberlabs.com] Sent: Friday, December 30, 2011 3:22 AM To: user@hbase.apache.org Subject: Connecting to google region server I dont know why my hbase is trying to connect to out

RE: Read speed down after long running

2011-12-27 Thread Ramkrishna S Vasudevan
As Lars mentioned admin apis like flush and compact will also slow down the client. As part of restart of HBase cluster, clients are also restarted? Regards Ram -Original Message- From: Lars H [mailto:lhofha...@yahoo.com] Sent: Tuesday, December 27, 2011 10:02 PM To: user@hbase.apache.o

RE: ANN: HBase 0.90.5RC0 available for download

2011-12-22 Thread Ramkrishna S Vasudevan
+1.. -Original Message- From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack Sent: Friday, December 23, 2011 6:14 AM To: user@hbase.apache.org; lars hofhansl Subject: Re: ANN: HBase 0.90.5RC0 available for download On Thu, Dec 22, 2011 at 4:23 PM, lars hofhansl wrot

RE: hbase regionserver dead - org.apache.hadoop.hbase.YouAreDeadException

2011-12-08 Thread Ramkrishna S Vasudevan
Hi Did you check your zookeeper? Check the zookeeper logs. May be some network fluctuation between your HBase cluster and Zookeeper. Also read the trouble shooting section of HBase w.r.t Zookeeper. May be the load on ZK is too heavy and there is some long Full GC happening. Regards Ram -O

RE: what is region server startcode

2011-12-06 Thread Ramkrishna S Vasudevan
RegionServer start code you can get it from the UI. It is the code to uniquely identify an RS. Regards Ram -Original Message- From: Vamshi Krishna [mailto:vamshi2...@gmail.com] Sent: Tuesday, December 06, 2011 11:56 AM To: user@hbase.apache.org Subject: what is region server startcode

RE: Flushing memstore

2011-11-29 Thread Ramkrishna S Vasudevan
Hi Mark Before shutting down a region server the memstore flush will automatically happen provided it is a clean shutdown. If you want to manually flush you can use the hbase shell command flush 'regionname' or flush 'tablename'. Reg, CDH version i am not aware of . Regards Ram -Origina

RE: Help with continuous loading configuration

2011-11-16 Thread Ramkrishna S Vasudevan
Hi Amit As you said the regions may be distributed evenly across RS, if you can see if the puts are reaching to a particular RS only at any point of time it will surely overload the RS. As Stack pointed out, what is your schema and how is your row key designed ? Regards Ram -Original M

RE: balancer stopped working

2011-11-16 Thread Ramkrishna S Vasudevan
Can you share the logs to confirm things? Regards Ram -Original Message- From: Matthias Hofschen [mailto:hofsc...@gmail.com] Sent: Wednesday, November 16, 2011 4:10 PM To: hbase-u...@hadoop.apache.org Subject: balancer stopped working Hi, we had a case today where the loadbalancer stop

RE: RE: Hbase Multiple Master issue

2011-11-03 Thread Ramkrishna S Vasudevan
okeeper and > get the new master node and then communicate with it. But thats not > happenning!!! > Any suggestions plz !! > > > V.Sriram wrote: >> >> Thanks for the reply. Will try other versions as well!! >> >> regards, >> V.Sriram >> >> >

RE: RE: Hbase Multiple Master issue

2011-11-03 Thread Ramkrishna S Vasudevan
de and then communicate with it. But thats not > happenning!!! > Any suggestions plz !! > > > V.Sriram wrote: >> >> Thanks for the reply. Will try other versions as well!! >> >> regards, >> V.Sriram >> >> >> Ramkrishna S Vasudevan wrote: >>

RE: Hbase Multiple Master issue

2011-11-01 Thread Ramkrishna S Vasudevan
Hi What version of HBase are you using? Regards Ram -Original Message- From: V.Sriram [mailto:srira...@ask.com] Sent: Tuesday, November 01, 2011 12:58 PM To: hbase-u...@hadoop.apache.org Subject: Hbase Multiple Master issue Hi all, I am evaluating HBase Multiple master utility as

RE: Region has been OPENING for too long

2011-10-31 Thread Ramkrishna S Vasudevan
Hi What I would suggest is try doing a forcefull assign of that region that is showing this log using the shell.(If the logs still continues to appear). Regards Ram -Original Message- From: tovb...@gmail.com [mailto:tovb...@gmail.com] On Behalf Of Matthew Tovbin Sent: Monday, Octob

RE: java.lang.NumberFormatException: For input string: ""

2011-10-19 Thread Ramkrishna S Vasudevan
What is the configuration for hdfs.rootdir? Regards Ram -Original Message- From: Sooraj S [mailto:soor...@sparksupport.com] Sent: Wednesday, October 19, 2011 5:02 PM To: user@hbase.apache.org Subject: java.lang.NumberFormatException: For input string: "" Hi All, When i try to start the

RE: Not able to remove entries from .META. table

2011-10-17 Thread Ramkrishna S Vasudevan
Thanks Stuthi for sharing this. -Original Message- From: Stuti Awasthi [mailto:stutiawas...@hcl.com] Sent: Tuesday, October 18, 2011 9:46 AM To: user@hbase.apache.org Subject: RE: Not able to remove entries from .META. table Hi Jon, Thanks for the pointers. I figured out that in my ca

RE: FATAL org.apache.hadoop.hbase.regionserver.wal.HLog: Could not append

2011-10-14 Thread Ramkrishna S Vasudevan
Hi Are you sure there was no insert. The stack trace shows a put operation was going on. You can check your datanode logs at the corresponding time when this exception occured in the RS to see if any write request has reached the DN and that you can find using the HLog file name for that RS. R

RE: Does Hbase automatically restore data when regionservers fail?

2011-10-12 Thread Ramkrishna S Vasudevan
Hi Edward You mean restoring data means all the stored data when the regionservers were running fine? Yes, HBase will restore you all the data that was being served by the failed region server by replaying the HLog which will be done by the master. Regards Ram -Original Message- From: e

RE: Queries on Zookeeper failure and RegionServer restartup

2011-09-20 Thread Ramkrishna S Vasudevan
Reg the clockoutofSync exception, just check if your cluster has same time set. This problem comes when you have time differences. Best Regards Ram -Original Message- From: Stuti Awasthi [mailto:stutiawas...@hcl.com] Sent: Tuesday, September 20, 2011 1:28 PM To: user@hbase.apache.org Su

RE: Balancer is running automatically

2011-09-12 Thread Ramkrishna S Vasudevan
Hi Jeff Balancer is a periodic operation. Did you wait for the specified period for the balancer to run? the balancer period is determined by the property "hbase.balancer.period". Incase you need to check if its running pump in some regions and set this property to a lower value. Then you can

RE: HRegionServer not shutting down

2011-09-12 Thread Ramkrishna S Vasudevan
Hi Jeff I have a faced a similar issue and my thread dumps showed the following 2011-08-16 11:26:22 Full thread dump Java HotSpot(TM) 64-Bit Server VM (14.3-b01 mixed mode): "Attach Listener" daemon prio=10 tid=0x40fa3000 nid=0x4046 waiting on condition [0x] java.la

RE: a question about assgin()

2011-09-08 Thread Ramkrishna S Vasudevan
Hi The purpose of assign() api is to assign a region to an RS as you have understood correctly. The purpose of unassign() api is to unassign a region from an RS that was serving it. In Hbase while the balancer tries to balance the regions then the overall purpose is to assign a region R1 served b

RE: Hbase can't balance.

2011-09-04 Thread Ramkrishna S Vasudevan
Hi Gao Yes i think what you say is correct. Regards Ram -Original Message- From: Gaojinchao [mailto:gaojinc...@huawei.com] Sent: Monday, September 05, 2011 10:33 AM To: user@hbase.apache.org Subject: Hbase can't balance. Version: 0.90.4 Cluster : 40 boxes As I saw below logs. It said

Generating FindBugs HTML report from Maven

2011-08-30 Thread Ramkrishna S Vasudevan
Hi I would like to generate a findbugs HTML report for the HBASE code. I have added the plugin in the POM.xml. When i issue mvn findbugs:findbugs am able to get only an XML file. How to get an HTML file. Regards Ram

RE: Query regarding HTable.get and timeouts

2011-08-21 Thread Ramkrishna S Vasudevan
Hi Srikanth I went through your logs.. not much info is present in that. Could you give the logs which shows what happened when the master and RS started. and also to whom the ROOT and META table got assigned? Regards Ram -Original Message- From: Srikanth P. Shreenivas [mailto:srikant

RE: Finding the trace of a query

2011-08-11 Thread Ramkrishna S Vasudevan
Hi Create table will be done by hBaseAdmin. On every table object you will have put and get. Read the functionality of HBase and documentation on HBase. It will help you. Regards Ram -Original Message- From: Anurag Awasthi [mailto:anuragawasth...@gmail.com] Sent: Thursday, August 11,

RE: Finding the trace of a query

2011-08-11 Thread Ramkrishna S Vasudevan
Hi Anurag, Before starting this hope you have created a table and inserted data. In HBase insert is done using put. So for tracking the read flow in HBase it is get data from table There are two things -> Get entire table contents -> get a specific row. For getting a specific row using a java

RE: Doubt in backup master ?

2011-08-09 Thread Ramkrishna S Vasudevan
hi Shanmuganathan, I am currently using ./bin/hbase-daemon.sh start master to start both active and backup master. so once the active goes down automatically the backup becomes master and the RS will connect to it.(Hope this part is working fine). I have not used in the way that you have mention

RE: HBase Users Group: Aug 22 @ FB

2011-08-08 Thread Ramkrishna S Vasudevan
Hi Will those presentations be uploaded somewhere so that we can have a look at it ? Regards Ram -Original Message- From: Friso van Vollenhoven [mailto:fvanvollenho...@xebia.com] Sent: Tuesday, August 09, 2011 10:15 AM To: Subject: Re: HBase Users Group: Aug 22 @ FB Hi Nicolas, Will

RE: Apparent data loss on 90.4 rc2 after partial zookeeper network partition (on MapR)

2011-08-04 Thread Ramkrishna S Vasudevan
Hi Lohith In HDFS there is a provision to call Name node recovery. As part of this operation if suppose the HLog belongs to a RS and the lease is held by that RS, the master invokes a command on Namenode to recover the lease. The RS which owns the HLog relinquishes it and the Namenode will becom

RE: Run the namenode and master seperately?

2011-07-26 Thread Ramkrishna S Vasudevan
Hi Shanmuganathan, Use the following property in HBASE-SITE.XML to specify the HDFS path. Ensure that you have the host name mapping of the namenode and the master machine. hbase.rootdir hdfs://linux76:9000/hbase The directory shared by region servers. Hope this i

RE: problem when change zookeeper.znode.parent

2011-07-25 Thread Ramkrishna S Vasudevan
JIRA. Thanks On Jul 25, 2011, at 12:32 AM, Ramkrishna S Vasudevan wrote: > Hi, > > I found the problem why it is continuously hanging when we use a Table > object. > When we use the Admin object first it tries to check the master. > If the zookeeper.znode.parent is not spec

RE: problem when change zookeeper.znode.parent

2011-07-25 Thread Ramkrishna S Vasudevan
used HTable, it was hung at the stacktrace pasted before. Thanks! 2011/7/25 Ramkrishna S Vasudevan : > Hi, > Which version of HBASE are you using? > > In HBASE-0.90.x version i get the following stack trace when the client > tries to connect to the master. > >

RE: problem when change zookeeper.znode.parent

2011-07-24 Thread Ramkrishna S Vasudevan
Hi, Which version of HBASE are you using? In HBASE-0.90.x version i get the following stack trace when the client tries to connect to the master. 11/07/25 10:13:16 INFO client.HConnectionManager$HConnectionImplementation: ZooKeeper available but no active master location found 11/07/25 10:13:16

RE: Deadlocked Regionserver process

2011-07-14 Thread Ramkrishna S Vasudevan
Sorry its not Data class But the problem is in the use of Date class. JD had once replied to the mailing list with the heading Re: Possible dead lock :) Regards Ram -Original Message- From: Ramkrishna S Vasudevan [mailto:ramakrish...@huawei.com] Sent: Friday, July 15, 2011 9:26 AM To

RE: Deadlocked Regionserver process

2011-07-14 Thread Ramkrishna S Vasudevan
Hi I think this as stack mentioned in HBASE-3830 could be due to profiler. But the problem is in the use of Data class. JD had once replied to the mailing list with the heading Re: Possible dead lock JD's reply = I see what you are say

RE: FW: Reg: The HLog that is created in region creation

2011-07-05 Thread Ramkrishna S Vasudevan
ou may have read CompactSplitThread code where compacting stores in a region happens before splitting. Cheers On Mon, Jul 4, 2011 at 9:26 PM, Ramkrishna S Vasudevan < ramakrish...@huawei.com> wrote: > Dear Ted > > Thanks for your reply. > > I have few questions on Splitting of regions. &g

Reg: The HLog that is created in region creation

2011-07-04 Thread Ramkrishna S Vasudevan
Hello Can anybody tell me what is the use of the HLog created per region when a region is created? Regards Ram *** This e-mail and attachments contain confidential information from HUAWEI, which is int

Problems in setting up local Hudson CI for HBase

2011-06-30 Thread Ramkrishna S Vasudevan
I am trying to setup a local Hudson CI for HBase. Once I configure and give a build I get the following problem Started by user anonymous Updating http://svn.apache.org/repos/asf/hbase/trunk At revision 1141411 no change for

RE: Any documents available on the Scanners

2011-05-06 Thread Ramkrishna S Vasudevan
ss-post to multiple lists, bcc'ed dev@ since this is really a user question) There's only 1 scanner in HBase, can you be more precise? J-D On Thu, May 5, 2011 at 9:15 PM, Ramkrishna S Vasudevan wrote: > Hi > > > > There are different scanners in HBase. > > Any docu

Any documents available on the Scanners

2011-05-05 Thread Ramkrishna S Vasudevan
Hi There are different scanners in HBase. Any documents available explaining the details on them and what scanner will be used in what flow ? Regards Ram *** This e-mail and attachments contain confid

RE: A question about Hmaster startup.

2011-04-18 Thread Ramkrishna S Vasudevan
Hi Yes. In Hbase 0.90.2 this change has been done. The HMaster tries creating the /hbase/hbase.version and when the DN comes up the NN throws an exception saying AlreadyCreatedException. so the HMaster is not able to start. Regards Ram

RE: Cannot transition the unassinged node in opening state due to version mismatch

2011-04-15 Thread Ramkrishna S Vasudevan
ou need to find more information about that region in the master log and region servers logs, try to find its story. BTW which version of HBase is this? J-D On Thu, Apr 14, 2011 at 6:09 AM, Ramkrishna S Vasudevan wrote: >  We were runing the HBase cluster for one whole night. > > > >

Cannot transition the unassinged node in opening state due to version mismatch

2011-04-14 Thread Ramkrishna S Vasudevan
We were runing the HBase cluster for one whole night. Then we tried to restart the region server. That we got an error saying transition of a region failed due to version mismatch in the unassigned node. The META region was actually getting loaded as part of log replay that is when we

Reg:HBase Client

2011-04-11 Thread Ramkrishna S Vasudevan
Hi AFter starting Hmaster and hregionserver, if we kill the namenode and try to insert some data it is allowing the insertion and even get is working. But the RegionSErver and Master throws error saying unable to connect to namenode. Is it not like the client should also throw error .

RE: Killing and restarting of master caused AlreadyBeingCreatedException from HLogs

2011-04-09 Thread Ramkrishna S Vasudevan
krish...@huawei.com Subject: Re: Killing and restarting of master caused AlreadyBeingCreatedException from HLogs Have you read the email thread entitled 'file is already being created by NN_Recovery' on user mailing list ? On Sat, Apr 9, 2011 at 7:06 AM, Ramkrishna S Vasudevan < ramakrish...

Killing and restarting of master caused AlreadyBeingCreatedException from HLogs

2011-04-09 Thread Ramkrishna S Vasudevan
If we kill the HMaster and try restarting it.. the following exceptions are logged plitting hlog 2 of 2: hdfs://10.18.52.108:9000/hbase/.logs/linux108,60020,1302346754067/linux108%3 A60020.1302350355407, length=1459 2011-04-09 18:02:56,017 INFO org.apache.hadoop.hbase.util.FSUtils: Recovering