Performance on updation.

2014-05-26 Thread Ranjini Rathinam
Hi, I want to know the performance of hbase on doing updation operation. How good is Hbase on Updation ? Please suggest. Thanks in advance. Ranjini

答复: 答复: 答复: what in regionserver's Used Heap

2014-05-26 Thread sunweiwei
Yes, I'm using metrics2 with ganglia. And I have closed ganglia, because there is too many region metrics. But I don't delete metrics2 configuration in $HBASE_HOME/conf/hadoop-metrics2-hbase.properties. Is this OK? Thanks -邮件原件- 发件人: Ted Yu [mailto:yuzhih...@gmail.com] 发送时间:

custom hbase shell commands

2014-05-26 Thread yeshwanth kumar
hi, i am using hbase 0.94.10, Distribution: Apache i am working on jruby scripts to create custom hbase command. I want to know whether I can create a custom hbase command similar to already available scan, put commands.. I have a sample jruby script, client.rb that outputs the Row ID and Value

Re: custom hbase shell commands

2014-05-26 Thread Bharath Vissapragada
bcc : user@ cc : dev@ During startup shell loads the commands from shell/commands/* [1] and calls appropriate command when invoked [2]. [1] https://github.com/apache/hbase/blob/0.94/src/main/ruby/shell.rb#L42 [2] https://github.com/apache/hbase/blob/0.94/src/main/ruby/shell.rb#L110 On Mon, May

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-26 Thread Ted Yu
I was waiting for Matt Corgan to take a look at prefix tree changes in the fix for HBASE-11234. FYI On May 25, 2014, at 10:34 PM, Andrew Purtell apurt...@apache.org wrote: For the record, -1 due to HBASE-11251: Vandana fixed the problem that prevented IntegrationTestIngestWithACL from

Re: Performance on updation.

2014-05-26 Thread Ted Yu
Which hbase release are you considering ? Different releases have different implementation for the write path. E.g., 0.98 release has HBASE-8755. In trunk, disruptor is introduced. This means write performance gets faster with each major release. Cheers On May 25, 2014, at 11:10 PM, Ranjini

Re: 答复: 答复: 答复: what in regionserver's Used Heap

2014-05-26 Thread Ted Yu
Can you pastebin the contents of conf/hadoop-metrics2-hbase.properties ? Thanks On Sun, May 25, 2014 at 11:37 PM, sunweiwei su...@asiainfo-linkage.comwrote: Yes, I'm using metrics2 with ganglia. And I have closed ganglia, because there is too many region metrics. But I don't delete

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-26 Thread Anoop John
HBASE-11253 also can be fixed in next RC. Patch is available in Jira. Pls review. -Anoop- On Mon, May 26, 2014 at 11:04 AM, Andrew Purtell apurt...@apache.orgwrote: For the record, -1 due to HBASE-11251: Vandana fixed the problem that prevented IntegrationTestIngestWithACL from running since

HBase UI and Shell not responsive (java.net.SocketTimeoutException: 600000 millis timeout)

2014-05-26 Thread Demai Ni
hi, HBase version is 0.96. Occasionally, a large cluster got the time out(stacktrace at the end of the email) when access UI or Hbase shell. HBase Master seems working fine as a load job was running and eventually completed successfully. I did some google and found a suggestion to increase

Re: HBase UI and Shell not responsive (java.net.SocketTimeoutException: 600000 millis timeout)

2014-05-26 Thread Esteban Gutierrez
Hello Demai, Have you seen any thing else going on the master, e.g. high cpu load? Can you try to get a jstack of the HBase master next time you experience this issue? Also how many regions you have in this cluster and how many RPC handlers have you configured for the master? regards, esteban.

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-26 Thread Andrew Purtell
Then it may not get in. On May 26, 2014, at 3:43 AM, Ted Yu yuzhih...@gmail.com wrote: I was waiting for Matt Corgan to take a look at prefix tree changes in the fix for HBASE-11234. FYI On May 25, 2014, at 10:34 PM, Andrew Purtell apurt...@apache.org wrote: For the record, -1

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-26 Thread Ted Yu
Matt is traveling. He said he would review tonight. Cheers On May 26, 2014, at 10:16 AM, Andrew Purtell andrew.purt...@gmail.com wrote: Then it may not get in. On May 26, 2014, at 3:43 AM, Ted Yu yuzhih...@gmail.com wrote: I was waiting for Matt Corgan to take a look at prefix tree

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-26 Thread Andrew Purtell
The fix for 11251 has introduced a new problem as reported on the JIRA. I can fix it with an addendum. If there are more commits of ready to go patches in the meantime we can add them to the next RC. Otherwise the train is leaving. On May 26, 2014, at 8:24 AM, Anoop John anoop.hb...@gmail.com

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-26 Thread Andrew Purtell
Then it won't get in. On May 26, 2014, at 10:18 AM, Ted Yu yuzhih...@gmail.com wrote: Matt is traveling. He said he would review tonight. Cheers On May 26, 2014, at 10:16 AM, Andrew Purtell andrew.purt...@gmail.com wrote: Then it may not get in. On May 26, 2014, at 3:43

Re: HBase UI and Shell not responsive (java.net.SocketTimeoutException: 600000 millis timeout)

2014-05-26 Thread Demai Ni
hi, Esteban, thanks for the quick response. We have a load job running at the time, I believe the task was both high CPU and IO, and may cause some hotspot. Well, it wasn't my cluster, so I don't have the first hand info. But from the past experience, we may have one hot regionServer with quite

[CANCELLED] [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available

2014-05-26 Thread Andrew Purtell
New RC forthcoming -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)

[VOTE] The 2nd HBase 0.98.3 release candidate (RC1) is available, vote closing 6/1/2014

2014-05-26 Thread Andrew Purtell
The 2nd HBase 0.98.3 release candidate (RC1) is available for download at http://people.apache.org/~apurtell/0.98.3RC1/ and Maven artifacts are also available in the temporary repository https://repository.apache.org/content/repositories/orgapachehbase-1022 Signed with my code signing key

Re: HBase cluster design

2014-05-26 Thread Dhaval Shah
A few things pop out to me on cursory glance: - You are using CMSIncrementalMode which after a long chain of events has a tendency to result in the famous Juliet pause of death. Can you try Par New GC instead and see if that helps? - You should try to reduce the CMSInitiatingOccupancyFraction to

RE: HBase cluster design

2014-05-26 Thread Henry Hung
@Flavio: One thing you should consider: is CPU over saturated? For instance, if one server has 24 cores, and the task tracker is configured to also execute 24 MR simultaneously, then there is no core left for HBase to do GC, and then crash. Few weeks ago my region server sometimes crash when

答复: 答复: 答复: 答复: what in regionserver's Used Heap

2014-05-26 Thread sunweiwei
This is hadoop-metrics2-hbase.properties. hbase.extendedperiod = 3600 # Configuration of the hbase context for ganglia # Pick one: Ganglia 3.0 (former) or Ganglia 3.1 (latter) # hbase.class=org.apache.hadoop.metrics.ganglia.GangliaContext