column based or row based storage for HBase?

2012-08-05 Thread Lin Ma
Hi guys, I am wondering whether HBase is using column based storage or row based storage? - I read some technical documents and mentioned advantages of HBase is using column based storage to store similar data together to foster compression. So it means same columns of different rows are

Re: column based or row based storage for HBase?

2012-08-05 Thread Mohit Anchlia
On Sun, Aug 5, 2012 at 6:04 AM, Lin Ma wrote: > Hi guys, > > I am wondering whether HBase is using column based storage or row based > storage? > >- I read some technical documents and mentioned advantages of HBase is >using column based storage to store similar data together to foster >

Re: column based or row based storage for HBase?

2012-08-05 Thread lars hofhansl
ied to write this up a while back: http://hadoop-hbase.blogspot.com/2011/12/introduction-to-hbase.html -- Lars - Original Message - From: Lin Ma To: user@hbase.apache.org Cc: Sent: Sunday, August 5, 2012 6:04 AM Subject: column based or row based storage for HBase? Hi guys, I

Re: column based or row based storage for HBase?

2012-08-05 Thread Lin Ma
Thank you for the informative reply, Mohit! Some more comments, 1. actually my confusion about column based storage is from the book "HBase The Definitive Guide", chapter 1, section "the Dawn of Big Data", which draw a picture showing HBase store the same column of all different rows continuously

Re: column based or row based storage for HBase?

2012-08-05 Thread yonghu
In my understanding of column-oriented structure of hbase, the first thing is the term column-oriented. The meaning is that the data which belongs to the same column family stores continuously in the disk. For each column-family, the data is stored as row store. If you want to understand the intern

Re: column based or row based storage for HBase?

2012-08-05 Thread Lin Ma
t; > I tried to write this up a while back: > http://hadoop-hbase.blogspot.com/2011/12/introduction-to-hbase.html > > -- Lars > > > > - Original Message - > From: Lin Ma > To: user@hbase.apache.org > Cc: > Sent: Sunday, August 5, 2012 6:04 AM > Subject: colu

Re: column based or row based storage for HBase?

2012-08-05 Thread lars hofhansl
uld work through the topic in the HBase book: http://hbase.apache.org/book/datamodel.html. -- Lars - Original Message - From: Lin Ma To: user@hbase.apache.org; lars hofhansl Cc: Sent: Sunday, August 5, 2012 8:44 PM Subject: Re: column based or row based storage for HBase? Hi Lars,

Re: column based or row based storage for HBase?

2012-08-06 Thread Lin Ma
gt; You should work through the topic in the HBase book: > http://hbase.apache.org/book/datamodel.html. > > -- Lars > > > - Original Message - > From: Lin Ma > To: user@hbase.apache.org; lars hofhansl > Cc: > Sent: Sunday, August 5, 2012 8:44 PM > Subjec

Re: column based or row based storage for HBase?

2012-08-06 Thread Lin Ma
Thank you Yong, So just clarify one thing, for your comments -- "column family stores continuously", does not mean data are stored *column after column physically * (e.g. store col1 of row 1, then col 1 of row 2, then col 1 of row 3, then col 2 of row 1, then col 2 of row 2, and finally col 2 of r

Re: column based or row based storage for HBase?

2012-08-06 Thread Mohit Anchlia
On Sun, Aug 5, 2012 at 8:03 PM, Lin Ma wrote: > Thank you for the informative reply, Mohit! > > Some more comments, > > 1. actually my confusion about column based storage is from the book > "HBase The Definitive Guide", chapter 1, section "the Dawn of Big Data", > which draw a picture showing HB

Re: column based or row based storage for HBase?

2012-08-06 Thread Jason Frantz
Lin, Looks like your questions may already be answered, but you might find the following link comparing "traditional" columnar databases against HBase/BigTable interesting: http://dbmsmusings.blogspot.com/2010/03/distinguishing-two-major-types-of_29.html -Jason On Sun, Aug 5, 2012 at 8:03 PM, L

Re: column based or row based storage for HBase?

2012-08-12 Thread Lin Ma
Hi Jason, This is very good reference. I read it from begin to the end and learned a lot. Thanks and have a good weekend. regards, Lin On Tue, Aug 7, 2012 at 2:00 AM, Jason Frantz wrote: > Lin, > > Looks like your questions may already be answered, but you might find the > following link compa