RE: Query regarding HTable.get and timeouts

2011-08-21 Thread Ramkrishna S Vasudevan
Hi Srikanth I went through your logs.. not much info is present in that. Could you give the logs which shows what happened when the master and RS started. and also to whom the ROOT and META table got assigned? Regards Ram -Original Message- From: Srikanth P. Shreenivas [mailto:srikant

Re: Sorting question

2011-08-21 Thread Chris Tarnas
HBase doesn't use the localized sorting rules, it sorts on the byte value. Space is ASCII 32, a value less than the alphanumeric characters. -chris On Aug 21, 2011, at 8:11 PM, Mark wrote: > FYI I am using openScannerWithPrefix thrift api call > > On 8/21/11 6:47 PM, Mark wrote: >> Why when

Re: Number of tables

2011-08-21 Thread Michel Segel
Mark, Looks like you have your key setup correctly... What happens if you make your user as the first element in the key? You can go with multiple tables. This may also help to improve performance too. Sent from a remote device. Please excuse any typos... Mike Segel On Aug 21, 2011, at 1:34

Re: Sorting question

2011-08-21 Thread Mark
FYI I am using openScannerWithPrefix thrift api call On 8/21/11 6:47 PM, Mark wrote: Why when scanning do I see the following sort order? "foo bar" "foo bar" "foo" I thought that "foo" would be sorted before "foo bar" since this is natural ordering. Why am I seeing these results?

Sorting question

2011-08-21 Thread Mark
Why when scanning do I see the following sort order? "foo bar" "foo bar" "foo" I thought that "foo" would be sorted before "foo bar" since this is natural ordering. Why am I seeing these results?

Re: Hbase version

2011-08-21 Thread Stack
Yes, 0.90.4 is our current stable offering. On version of hadoop, the versions that fit the bill are detailed in our doc here: http://hbase.apache.org/book.html#hadoop St.Ack On Sun, Aug 21, 2011 at 2:07 PM, Greg Bledsoe wrote: > Hi > > Is 0.90.4 currently the most stable/bug fixed version of hb

Re: Hbase version

2011-08-21 Thread Jean-Daniel Cryans
> Is 0.90.4 currently the most stable/bug fixed version of hbase? Yes. > What is the best hdfs version for it?  0.20.x, x=?...  Opinions? Hasn't changed, see the top of this page: http://hbase.apache.org/book/hadoop.html J-D

Hbase version

2011-08-21 Thread Greg Bledsoe
Hi Is 0.90.4 currently the most stable/bug fixed version of hbase? What is the best hdfs version for it? 0.20.x, x=?... Opinions? Greg

Re: Query regarding HTable.get and timeouts

2011-08-21 Thread Jean-Daniel Cryans
Yeah that null message isn't really helpful :) So one thing that might be helpful would be to know who DC1AuthDFSC1D3 is, since you identified the logs as "Region server n". Then look at the master's web UI and see where -ROOT- is assigned. Is it also DC1AuthDFSC1D3? If so, then I would proceed

Re: Number of tables

2011-08-21 Thread Jean-Daniel Cryans
> Is there a disadvantage to create more tables? Not on the HBase side, in the end it's all regions. J-D

Re: Number of tables

2011-08-21 Thread Mark
About a million rows per day per table. Is there a disadvantage to create more tables? On 8/21/11 10:49 AM, Sonal Goyal wrote: If your data size is big enough to warrant 3 tables, go for it. This would be the case where there are really lots of entries for user#type. Best Regards, Sonal Crux:

Re: Number of tables

2011-08-21 Thread Sonal Goyal
If your data size is big enough to warrant 3 tables, go for it. This would be the case where there are really lots of entries for user#type. Best Regards, Sonal Crux: Reporting for HBase Nube Technologies

Re: Number of tables

2011-08-21 Thread Mark
Almost all use cases require type.. ie Retrieve all searches performed by user 'foo': scan "history", {STARTROW => "search/foo"} Retrieve all product views performed by user 'foo': scan "history", {STARTROW => "view/foo"} On 8/21/11 10:25 AM, Sonal Goyal wrote: Hi Mark, When you say that y

Re: HBase tables snippet

2011-08-21 Thread Sonal Goyal
Hi Vincent, If you are able to provide some criteria for selecting the rows(rowkey/composite rowkey/column) etc, you can try using Crux at https://github.com/sonalgoyal/crux. With Crux, you can select specific data in HBase columns by defining filters and view the data in a tabular/chart format.

Re: Number of tables

2011-08-21 Thread Sonal Goyal
Hi Mark, When you say that your use case does not require searching across multiple types, what do you mean? Do you have cases when you search with type? Best Regards, Sonal Crux: Reporting for HBase Nube Technologies

Number of tables

2011-08-21 Thread Mark
We are logging all user actions into hbase. These actions include searches, product views and clicks. We are currently storing them in one table with row keys like so: "#{type}/#{user}/#{time}", where type is either click, search, view and user is the current user logged in. Obviously using th

Re: HBase tables snippet

2011-08-21 Thread Doug Meil
If you just need a sample of rows from tables, use the client API (e.g., HTable) and scan off a few hundred rows or whatever you need. The harder part of local unit testing is getting a coherent set of rows that makes sense between all the tables - but that's something that every developer has to

HBase tables snippet

2011-08-21 Thread vincent.pe...@gmail.com
Hi, We have an HBase cluster containing TBs of data. As a front-end developer, I need a snippet of some tables to run tests on local. I would like to build a script that would export a given number of rows for a given list of tables. I had a look at the export / import table but it export the whol

HRegionPartitioner has the same problem as HBASE-3111.

2011-08-21 Thread Takuya UESHIN
Hi, I found that HRegionPartitioner has the same problem as HBASE-3111. Some tests I'm writing for MapReduce using HRegionPartitioner don't succeed because HRegionPartitioiner overwrites the test specific configuration "hbase.zookeeper.property.clientPort" : 21818 with that in hbase-site.xml (or

Re: mini-hbase configuration for tests

2011-08-21 Thread Eric Charles
On 16/08/11 05:33, Stack wrote: On Mon, Aug 15, 2011 at 5:12 PM, Garrett Wu wrote: I have a bunch of integration tests that spend a lot of time creating and deleting tables in a mini hbase cluster started using HBaseTestingUtility. Disabling and deleting a table seems to take a second or two