Thanks Ted Yu and Kevin for your links... Now i understand the use of MSLAB.
Could you please help me what is the default size of each Data Block in HFile. I go through this link( http://blog.cloudera.com/blog/2012/06/hbase-io-hfile-input-output/) to understand HFile format. But have doubt : what is the size of each Data Block> how it decided? On Mon, Mar 3, 2014 at 10:37 PM, Kevin O'dell <kevin.od...@cloudera.com>wrote: > Upendra, > > Todd L wrote a great set of blogs that explains the problem and some > solutions: > > http://blog.cloudera.com/blog/2011/02/avoiding-full-gcs-in-hbase-with-memstore-local-allocation-buffers-part-1/ > > > On Mon, Mar 3, 2014 at 12:00 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > See http://hbase.apache.org/book.html#gcpause > > > > > > On Mon, Mar 3, 2014 at 8:06 AM, Upendra Yadav <upendra1...@gmail.com> > > wrote: > > > > > On this link(https://hbase.apache.org/book/regions.arch.html) i got : > > > > > > MSLAB requires 2mb per memstore (that's 2mb per family per region). > > > > > > what is MSLAB. Is this related to each Data block size inside HFile? > > > > > > > > > On Mon, Mar 3, 2014 at 7:30 PM, Upendra Yadav <upendra1...@gmail.com> > > > wrote: > > > > > > > Thanks... > > > > > > > > So in HFile, each data Block size will be 128 MB(After Major > > > > compaction.... if we have more than one block...)? > > > > > > > > > > > > On Mon, Mar 3, 2014 at 5:21 PM, 冯宏华 <fenghong...@xiaomi.com> wrote: > > > > > > > >> 128M > > > >> ________________________________________ > > > >> 发件人: Upendra Yadav [upendra1...@gmail.com] > > > >> 发送时间: 2014年3月3日 19:20 > > > >> 收件人: user@hbase.apache.org > > > >> 主题: what is the default size of each Column family memstore.... > > > >> > > > >> Hi > > > >> > > > >> what is the default size of each Column family memstore.... > > > >> > > > > > > > > > > > > > > > > > -- > Kevin O'Dell > Systems Engineer, Cloudera >
