Re: Re: hbase read performance tuning failed

Ahh... You're using thrift. I honestly do not know what performance characteristics you should expect from that. Maybe some folks here who use thrift can answer that...? -- Lars From: LEI Xiaofeng To: user@hbase.apache.org; lars hofhansl Sent: Tuesday, Janu

答复: control HBase stop / start from supervisord

Hi Mathan, Maybe you could get some ideas from: https://github.com/XiaoMi/minos we do use the modified supervisor to start/stop HBase on all our cluster:) Thanks, 发件人: Nick Dimiduk [ndimi...@gmail.com] 发送时间: 2014年1月8日 2:32 收件人: mathan kumar 抄送: hbase-user

Re: Re: Re: hbase read performance tuning failed

Please refer to https://issues.apache.org/jira/browse/HBASE-1015 Cheers On Tue, Jan 7, 2014 at 5:54 PM, LEI Xiaofeng wrote: > In addition, I am using c++ to access HBase. Will it make any difference > compared to using Java? > > > > -原始邮件- > > 发件人: "LEI Xiaofeng" > > 发送时间: 2014年1月8日 星

Re: Re: Re: hbase read performance tuning failed

In addition, I am using c++ to access HBase. Will it make any difference compared to using Java? > -原始邮件- > 发件人: "LEI Xiaofeng" > 发送时间: 2014年1月8日 星期三 > 收件人: user@hbase.apache.org, doug.m...@explorysmedical.com > 抄送: > 主题: Re: Re: hbase read performance tuning failed > > I tried to se

Re: Re: hbase read performance tuning failed

Xiaofeng: Take a look at this: http://hbase.apache.org/book.html#hbase.regionserver.checksum.verify Cheers On Tue, Jan 7, 2014 at 5:36 PM, LEI Xiaofeng wrote: > I tried to set "BLOCKSIZE" to 0 when created table to tune the scan > performance, but it did not work. Another thing is what do you

Re: Re: hbase read performance tuning failed

I tried to set "BLOCKSIZE" to 0 when created table to tune the scan performance, but it did not work. Another thing is what do you mean by "turing HBase checksumming on"? I do not know how to do it. Could you give mw some detailed information? Thanks > -原始邮件- > 发件人: "Doug Meil" > 发送时

Re: Re: hbase read performance tuning failed

Lars, I use "scannerOpenWithPrefix" func to get my scanner and use "scannerGetList(rowResults, scanner,100)" func to get rows. I can only get about 5K records per second. But my exception is at least 220K records per second. I want to know what have you done makes you manage to get that perma

Re: Re: hbase read performance tuning failed

I use "scannerOpenWithPrefix" func to get my scanner and use "scannerGetList(rowResults, scanner,100)" func to get rows. I can only get about 5K records per second. But my exception is at least 220K records per second. > -原始邮件- > 发件人: "Haosong Huang" > 发送时间: 2014年1月7日 星期二 > 收件人: user

Re: Hbase Performance Issue

Akhtar: There is no manual step for bulk load. You essentially have your script that runs the map reduce job that creates the HFiles. On success of this script/command, you run the completebulkload command ... the whole bulk load can be automated, just like your map reduce job. --Suraj On Mon, J

Splitlog Replication

I need to run through some server maintenance on my data nodes, including a reboot. My splitlogs, though, only seem to have a replication factor of 1 (when a data nodes is taken offline, I sometimes have missing blocks for them). I know I can decommission data nodes with the exclude.dfs file, but t

Re: hbase 0.94.x and hadoop 2.2

See here in the refguide for setting up 0.94 on hadoop 2.2: http://hbase.apache.org/book.html#ftn.d2907e640 St.Ack On Mon, Jan 6, 2014 at 4:36 PM, Kim Chew wrote: > Hello all, > > Does hbase 0.94.x support hadoop 2.2? > > Because I got this exception when trying to connect to a table, > > Exce

Re: hbase read performance tuning failed

In addition to what Lars just said about the blocksize, this is a similar question to another one that somebody asked, and it's always good to make sure that you understand where your data is. As a sanity check, make sure it's not all on one or two RSs (look at the hbase web pages or with tools li

Re: control HBase stop / start from supervisord

Please see this JIRA as well: HBASE-7386 Investigate providing some supervisor support for znode deletion On Tue, Jan 7, 2014 at 10:32 AM, Nick Dimiduk wrote: > Moving to HBase-user > > Hi Mathan, > > Have a look at hbase-daemon.sh in $HBASE_HOME/bin. It wraps up the details > necessary for bu

Re: control HBase stop / start from supervisord

Moving to HBase-user Hi Mathan, Have a look at hbase-daemon.sh in $HBASE_HOME/bin. It wraps up the details necessary for building the java command used to start an HBase process (it also does some other house-cleaning like log rotation, which you probably also want). Use it to start and stop Regi

Re: hbase read performance tuning failed

If increasing hbase.client.scanner.caching makes no difference you have another issue. How many rows do you expect your to return? On contemporary hardware I manage to scan a few million KeyValues (i.e. columns) per second and per CPU core. Note that for scan performance you want to increase the

Re:Re: a short introduction of simplehbase(hbase ORM)

Yes, I know there are some framework such as Phoenix. Phoenix is good work. But I have some other ideas. To me, each data store is different, especially non-traditional relation database. Because they bring us some new ideas to design,store,handle datum. If we still encapsulate it to a SQL skin,

Re:Re: Re:Re: a short introduction of simplehbase(hbase ORM)

Yes, simplehbase is an ORM lib to simplify java app dev on hbase. but simplehbase provides more than just mapping. such as SQL-Like HbaseQueryLanguage Myibatics-Like dynamic query capability. Multiple version mapping on hbase etc. xinzhi.zhang At 2014-01-06 00:55:38,"Haosong Huang [via Apache

Invitation to connect on LinkedIn

LinkedIn takeshi, I'd like to add you to my professional network on LinkedIn. - Abhinav Abhinav Pundir Senior Software Engineer at Yahoo! Bengaluru Area, India Confirm that you know Abhinav Pundir: https://www.linkedin.com/e/-5b3i14-hq5c7xrs-55/isd/19114829582/tuctZSMH/?hs=false

Invitation to connect on LinkedIn

LinkedIn anil, I'd like to add you to my professional network on LinkedIn. - Abhinav Abhinav Pundir Senior Software Engineer at Yahoo! Bengaluru Area, India Confirm that you know Abhinav Pundir: https://www.linkedin.com/e/vdnvgz-hq5c82vr-6z/isd/19114829616/5aZt7BTB/?hs=false&tok

Invitation to connect on LinkedIn

LinkedIn anil, I'd like to add you to my professional network on LinkedIn. - Abhinav Abhinav Pundir Senior Software Engineer at Yahoo! Bengaluru Area, India Confirm that you know Abhinav Pundir: https://www.linkedin.com/e/-97doxy-hq5c83h4-2c/isd/19114829496/jeuf5X5J/?hs=false&to

Re: hadoop-hbase failure - could use some help, a class is apparently not being found by Hadoop

Hi there, Could you please share your solution to this issue? We're also running into the same TableOutputFormat class not found. I've been looking for a solution for almost a week now and re-installed cloudera with no use. Thanks -- View this message in context: http://apache-hbase.679495

Re: hbase read performance tuning failed

>but the scan performance is poor. Did you set start row and end row in the Scan? Besides, if the random read performance of your cluster is ok, maybe smallscan could help you. HBASE-9488 On Tue, Jan 7, 2014 at 3:06 PM, LEI Xiaofeng wrote: > H