Re: Question on the number of column families

2014-08-06 Thread Qiang Tian
our suggestion. > But since MemStore and BlockCache is separately managed on each column > family, I'm a little concerned with the memory footprint. > > Thank you. > > -Original Message- > From: Qiang Tian [mailto:tian...@gmail.com] > Sent: Thursday, August 07, 2014 11:4

Re: Question on the number of column families

2014-08-06 Thread Ted Yu
sential, except for SingleColumnValueFilter. > > Thanks. > > -Original Message----- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Thursday, August 07, 2014 12:38 PM > To: user@hbase.apache.org > Subject: Re: Question on the number of column families > > bq. Wh

RE: Question on the number of column families

2014-08-06 Thread innowireless TaeYun Kim
Sent: Thursday, August 07, 2014 11:43 AM To: user@hbase.apache.org Subject: Re: Question on the number of column families Hi, the description of hbase-5416 stated why it was introduced, if you only have 1 CF, dummy CF does not help. it is helpful for multi-CF case, e.g. "putting them in

RE: Question on the number of column families

2014-08-06 Thread innowireless TaeYun Kim
riginal Message----- > From: innowireless TaeYun Kim [mailto:taeyun@innowireless.co.kr] > Sent: Wednesday, August 06, 2014 1:48 PM > To: user@hbase.apache.org > Subject: RE: Question on the number of column families > > Thank you. > > The 'dummy' column will alwa

Re: Question on the number of column families

2014-08-06 Thread Ted Yu
es ahead. So sorry for my premature thoughts) > > > -Original Message- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Wednesday, August 06, 2014 1:38 PM > To: user@hbase.apache.org > Subject: Re: Question on the number of column families > > bq. add a 'dummy' c

Re: Question on the number of column families

2014-08-06 Thread Qiang Tian
my' column family can be used to minimize the scan cost. > > Thank you. > > > -Original Message----- > From: innowireless TaeYun Kim [mailto:taeyun@innowireless.co.kr] > Sent: Wednesday, August 06, 2014 1:48 PM > To: user@hbase.apache.org > Subject: RE: Question on the numbe

RE: Question on the number of column families

2014-08-06 Thread innowireless TaeYun Kim
innowireless TaeYun Kim [mailto:taeyun@innowireless.co.kr] Sent: Wednesday, August 06, 2014 1:48 PM To: user@hbase.apache.org Subject: RE: Question on the number of column families Thank you. The 'dummy' column will always hold the value '1' (or even an empty string),

RE: Question on the number of column families

2014-08-05 Thread innowireless TaeYun Kim
r@hbase.apache.org Subject: Re: Question on the number of column families bq. add a 'dummy' column family and apply HBASE-5416 technique Adding dummy column family is not the way to utilize essential column family support - what would this dummy column family hold ? bq. since I have not re

Re: Question on the number of column families

2014-08-05 Thread Ted Yu
bq. add a 'dummy' column family and apply HBASE-5416 technique Adding dummy column family is not the way to utilize essential column family support - what would this dummy column family hold ? bq. since I have not read the filtering section of the book I'm reading yet Once you finish reading, yo

RE: Question on the number of column families

2014-08-05 Thread innowireless TaeYun Kim
Thank you all. Facts learned: - Having 130 column families is too much. Don't do that. - While scanning, an entire row will be read for filtering, unless HBASE-5416 technique is applied which makes only relevant column family is loaded. (But it seems that still one can't load just a column need

Re: Question on the number of column families

2014-08-05 Thread Alok Singh
One way to model the data would be to use a composite key that is made up of the RDMS primary_key + "." + field_name. Then just have a single column that contains the value of the field. Individual field lookups will be a simple get and to get all of fields of a record, you would do a scan with sta

Re: Question on the number of column families

2014-08-05 Thread Michael Segel
s somewhat related to the size of the >>> client screen that displays the values on a map. >>> Normally a client requests the values for the area that is displayed on >>> the screen. >>> >>> >>> -Original Message- >>> From: Alo

Re: Question on the number of column families

2014-08-05 Thread Ted Yu
essage- > > From: innowireless TaeYun Kim [mailto:taeyun....@innowireless.co.kr] > > Sent: Tuesday, August 05, 2014 8:36 PM > > To: user@hbase.apache.org > > Subject: RE: Question on the number of column families > > > > Thank you for your reply. > > > >

Re: Question on the number of column families

2014-08-05 Thread Alok Kumar
is somewhat related to the size of the > client screen that displays the values on a map. > Normally a client requests the values for the area that is displayed on > the screen. > > > -Original Message- > From: Alok Kumar [mailto:alok...@gmail.com] > Sent: Tuesday, Aug

RE: Question on the number of column families

2014-08-05 Thread innowireless TaeYun Kim
block cache, unless the columns are separated by individual column family. -Original Message- From: innowireless TaeYun Kim [mailto:taeyun@innowireless.co.kr] Sent: Tuesday, August 05, 2014 8:36 PM To: user@hbase.apache.org Subject: RE: Question on the number of column families Than

RE: Question on the number of column families

2014-08-05 Thread innowireless TaeYun Kim
uests the values for the area that is displayed on the screen. -Original Message- From: Alok Kumar [mailto:alok...@gmail.com] Sent: Tuesday, August 05, 2014 8:24 PM To: user@hbase.apache.org Subject: Re: Question on the number of column families Hi, Hbase creates HFile per column-f

Re: Question on the number of column families

2014-08-05 Thread Alok Kumar
5, 2014 8:11 PM > To: user@hbase.apache.org > Subject: Question on the number of column families > > Hi, > > > > According to http://hbase.apache.org/book/number.of.cfs.html, having more > than 2~3 column families are strongly discouraged. > > > > BTW, in my case, re

RE: Question on the number of column families

2014-08-05 Thread innowireless TaeYun Kim
To: user@hbase.apache.org Subject: Question on the number of column families Hi, According to http://hbase.apache.org/book/number.of.cfs.html, having more than 2~3 column families are strongly discouraged. BTW, in my case, records on a table have the following characteristics: - The

Question on the number of column families

2014-08-05 Thread innowireless TaeYun Kim
Hi, According to http://hbase.apache.org/book/number.of.cfs.html, having more than 2~3 column families are strongly discouraged. BTW, in my case, records on a table have the following characteristics: - The table is read-only. It is bulk-loaded once. When a new data is ready, A new tabl