Re: Why HTableDescriptor DEFAULT_VERSIONS is 3?

2011-04-03 Thread Ryan Rawson
because it always has been? I think the original BT paper probably had the number '3' in there somewhere... But yes, not too big, not too small. There probably isnt a reasonable setting here, I'm guessing 1 isnt quite right either. Its one aspect of your data modelling, so people should probabl

Why HTableDescriptor DEFAULT_VERSIONS is 3?

2011-04-03 Thread Eric Charles
Hi, Is there a particular reason to have chosen 3 for HTableDescriptor.DEFAULT_VERSIONS? ("not too low, not too big"? - I didn't find discussions about this). Tks, - Eric

Re: versions stored in a cell

2011-04-03 Thread Eric Charles
1.- On my side, I could imagine to use the versions to store the history of a key (without the need to add extra index table). Really depends on requirement and datamodel, I think but many versions can sometimes make sense. 2.- HBASE-3488 is related to the hadoop rowcounter job. To get version

Re: very trick design issue

2011-04-03 Thread ajay.gov
You may want to denormalize by adding the security_price info in the activity table. When you insert items into the activity table you wll then have to insert the security_price for it as well. That way you can get the securty_price for the activity with one call to the activity table. thanks -aj

Re: versions stored in a cell

2011-04-03 Thread Ted Yu
For 1, please give some background to justify the high number of versions. For 2, take a look at HBASE-3488 On Sun, Apr 3, 2011 at 12:49 PM, Vishal Kapoor wrote: > two questions, > > 1) if I give number of versions for a family as 365*3 is it a bad > design? how many versions are a good practice

Re: Scan rows in reverse order?

2011-04-03 Thread tsuna
On Sun, Apr 3, 2011 at 12:44 PM, Vishal Kapoor wrote: > I have my row id starting with a reverse time stamp so that I can get > to the latest data first, but I also need to process data as it comes > in, is there any way I can get scan to give me data from bottom up? No. You need to manually cre

versions stored in a cell

2011-04-03 Thread Vishal Kapoor
two questions, 1) if I give number of versions for a family as 365*3 is it a bad design? how many versions are a good practice? if I have two many versions will that be a single seek when I get the row Id? if yes, will it take longer to store data? pros and cons? 2) how do I get the number of ver

Scan rows in reverse order?

2011-04-03 Thread Vishal Kapoor
I have my row id starting with a reverse time stamp so that I can get to the latest data first, but I also need to process data as it comes in, is there any way I can get scan to give me data from bottom up? thanks, Vishal

Re: HBase wiki updated

2011-04-03 Thread Venkatesh
A big thankyou from a hbase user (sorry for the spam..but deserves thanks) -Original Message- From: Jean-Daniel Cryans To: user@hbase.apache.org Sent: Sat, Apr 2, 2011 3:51 pm Subject: Re: HBase wiki updated 2 Internets for you Doug, that's awesome! Thx J-D On Apr 2,

Re: Speeding up LoadIncrementalHFiles?

2011-04-03 Thread Ted Yu
Adam: I approached the problem in two steps. See my patch, 3721-v2.txt, on https://issues.apache.org/jira/browse/HBASE-3721 Cheers On Thu, Mar 31, 2011 at 12:41 PM, Ted Yu wrote: > Adam: > I logged https://issues.apache.org/jira/browse/HBASE-3721 > > Feel free to comment on that JIRA. > > > On