Re: Regionserver goes down while endpoint execution

2013-03-12 Thread lars hofhansl
What does the region server log say? Endpoints do not run in a sandbox. You can call System.exit(...) and your RegionServer will happily exit. If you can, please show us your endpoint code. -- Lars From: Kumar, Deepak8 deepak8.ku...@citi.com To:

RE: Regionserver goes down while endpoint execution

2013-03-12 Thread Kumar, Deepak8
Lars, Thanks for your quick response.There is not much info in region server log. I am again executing it with DEBUG log level in region servers. Here is the endpoint code public class ColumnAggregationEndpoint extends BaseEndpointCoprocessor implements ColumnAggregationProtocol {

RE: Regionserver goes down while endpoint execution

2013-03-12 Thread Kumar, Deepak8
Lars, It is having following errors when I execute the Endpoint RPC client from eclipse. It seems some of the regions at regionserver vm-8aa9-fe74.nam.nsroot.net is taking more time to reponse. Could you guide how to fix it. I don't find any option to set hbase.rpc.timeout from hbase

Does a major compact flush memstore?

2013-03-12 Thread Liu, Raymond
It seems to me that a major_compact table command from hbase shell do not fush memstore? When I done with major compact, still some data in memstore and will be flush out to disk when I shut down hbase cluster. Best Regards, Raymond Liu

RE: region server down when scanning using mapreduce

2013-03-12 Thread Lu, Wei
We turned the block cache to false and tried again, regionserver still crash one after another. There are a lot of scanner lease time out, and then master log info: RegionServer ephemeral node deleted, processing expiration [rs21,60020,1363010589837] Seems the problem is not caused by

RE: region server down when scanning using mapreduce

2013-03-12 Thread Anoop Sam John
How is the GC pattern in your RSs which are getting down? In RS logs you might be having YouAreDeadExceptions... Pls try tuning your RS memory and GC opts. -Anoop- From: Lu, Wei [w...@microstrategy.com] Sent: Tuesday, March 12, 2013 1:42 PM To:

Re: RegionServers Crashing every hour in production env

2013-03-12 Thread Pablo Musa
Guys, thank you very much for the help. Yesterday I spent 14 hours trying to tune the whole cluster. The cluster is not ready yet needs a lot of tunning, but at least is working. My first big problem was namenode + datanode GC. They were not using CMS and thus were taking incremental time to

RE: region server down when scanning using mapreduce

2013-03-12 Thread Azuryy Yu
how did you use scanner? paste some codes here. On Mar 12, 2013 4:13 PM, Lu, Wei w...@microstrategy.com wrote: We turned the block cache to false and tried again, regionserver still crash one after another. There are a lot of scanner lease time out, and then master log info:

HBase receivedBytes

2013-03-12 Thread Levin, Ohad
Hi all, Monitoring Hbase, we need to know the amount of bytes received by each region server (and overall throughput). The only metric I found for this is RS.hadoop.service_HBase.name_RPCStatistics-60020.ReceivedBytes. However, this metric Is a delta and not total number. My question is is

Re: Hbase Thrift DemoClient.php bug

2013-03-12 Thread Ted Yu
I checked trunk code - parameter count matches. Looks like this is a problem in 0.94 only On Mon, Mar 11, 2013 at 8:19 PM, Ted yuzhih...@gmail.com wrote: Thanks for reporting this. Mind opening a jira ? On Mar 11, 2013, at 7:13 PM, jung moor...@gmail.com wrote: hiya installed thrift

Re: Regionserver goes down while endpoint execution

2013-03-12 Thread Himanshu Vashishtha
I don't see RS dying with this. It says that it is taking more time than 60 sec (default timeout for clients), and therefore it stops processing the coprocessor call as the client is disconnected. Is your cluster okay? how many rows in the table? Normal scan works good? Can you share more about

Re: Hbase Thrift DemoClient.php bug

2013-03-12 Thread Ted Yu
HBASE-8079 has been logged. On Tue, Mar 12, 2013 at 9:55 AM, Ted Yu yuzhih...@gmail.com wrote: I checked trunk code - parameter count matches. Looks like this is a problem in 0.94 only On Mon, Mar 11, 2013 at 8:19 PM, Ted yuzhih...@gmail.com wrote: Thanks for reporting this. Mind

Re: Regionserver goes down while endpoint execution

2013-03-12 Thread Ted Yu
From region server log: 2013-03-12 03:07:22,605 DEBUG org.apache.hadoop.hdfs.DFSClient: Error making BlockReader. Closing stale Socket[addr=/10.42.105.112,port=50010,localport=54114] java.io.EOFException: Premature EOF: no length prefix available at

Re: Regionserver goes down while endpoint execution

2013-03-12 Thread Gary Helmling
To expand on what Himanshu said, your endpoint is doing an unbounded scan on the region, so with a region with a lot of rows it's taking more than 60 seconds to run to the region end, which is why the client side of the call is timing out. In addition you're building up an in memory list of all

Re: Welcome our newest Committer Anoop

2013-03-12 Thread Devaraj Das
Hey Anoop, Congratulations! Devaraj. On Mon, Mar 11, 2013 at 10:50 AM, Enis Söztutar enis@gmail.com wrote: Congrats and welcome. On Mon, Mar 11, 2013 at 2:21 AM, Nicolas Liochon nkey...@gmail.com wrote: Congrats, Anoop! On Mon, Mar 11, 2013 at 5:35 AM, rajeshbabu chintaguntla

HBase is able to connect to ZooKeeper but the connection closes immediately...

2013-03-12 Thread Ryan Compton
When I try to access HBase from a cluster node which is not the zookeeper server I have the following problem: -bash-3.2$ hostname node33 -bash-3.2$ hbase shell HBase Shell; enter 'helpRETURN' for list of supported commands. Type exitRETURN to leave the HBase Shell Version 0.90.4-cdh3u3, r, Thu

Re: HBase is able to connect to ZooKeeper but the connection closes immediately...

2013-03-12 Thread Kevin O'dell
Hi Ryan, Make sure you have the correct client configurations on the node you are trying to access from. You will need the hbase-site and the zoo.cfg to make this work. On Tue, Mar 12, 2013 at 4:47 PM, Ryan Compton compton.r...@gmail.comwrote: When I try to access HBase from a cluster node

HBase is able to connect to ZooKeeper but the connection closes immediately...

2013-03-12 Thread Ryan Compton
When I try to access HBase from a cluster node which is not the zookeeper server I have the following problem: -bash-3.2$ hostname node33 -bash-3.2$ hbase shell HBase Shell; enter 'helpRETURN' for list of supported commands. Type exitRETURN to leave the HBase Shell Version 0.90.4-cdh3u3, r, Thu

Re: HBase is able to connect to ZooKeeper but the connection closes immediately...

2013-03-12 Thread Ted Yu
Have you seen Kevin's response ? Cheers On Tue, Mar 12, 2013 at 1:42 PM, Ryan Compton compton.r...@gmail.comwrote: When I try to access HBase from a cluster node which is not the zookeeper server I have the following problem: -bash-3.2$ hostname node33 -bash-3.2$ hbase shell HBase Shell;

Re: HBase is able to connect to ZooKeeper but the connection closes immediately...

2013-03-12 Thread Ryan Compton
Yes, I am having success with it. We use Cloudera and there's a button, Generate Client Configuration, which generated a .zip file with a very informative README.txt. The trick is to extract that .zip and export HBASE_CONF_DIR : hbase(main):002:0 exit -bash-3.2$ hostname node33 -bash-3.2$ export

RE: Does a major compact flush memstore?

2013-03-12 Thread Liu, Raymond
I tried both hbase shell's major_compact cmd and java api HBaseAdmin.majorCompact() on table name. They don't flush the memstore on to disk, compact cmd seems not doing that too. I hadn't read enough related code, While I am wondering, is that because there are size threshold before a memstore

Re: Does a major compact flush memstore?

2013-03-12 Thread Stack
Raymond: Major compaction does not first flush. Should it or should it be an option? St.Ack On Tue, Mar 12, 2013 at 6:46 PM, Liu, Raymond raymond@intel.com wrote: I tried both hbase shell's major_compact cmd and java api HBaseAdmin.majorCompact() on table name. They don't flush the

RE: Does a major compact flush memstore?

2013-03-12 Thread Liu, Raymond
St.Ack I am not sure what's the design idea behind it. While, If I want to invoke a major compact manually, I guess what I want is that all separate file and the memstore is combined into one file. If I don't write anything new there, from the user point of view, I will assume that it

Re: Welcome our newest Committer Anoop

2013-03-12 Thread xkwang bruce
Congratulations, Anoop! 2013/3/13 Devaraj Das d...@hortonworks.com Hey Anoop, Congratulations! Devaraj. On Mon, Mar 11, 2013 at 10:50 AM, Enis Söztutar enis@gmail.com wrote: Congrats and welcome. On Mon, Mar 11, 2013 at 2:21 AM, Nicolas Liochon nkey...@gmail.com wrote: