Re: hbase architecture doubts

2016-05-01 Thread Stack
On Sun, May 1, 2016 at 3:36 AM, Shushant Arora wrote: > 1.Does Hbase uses ConcurrentskipListMap(CSLM) to store data in memstore? > > Yes (We use a CSLS but this is implemented over a CSLM). > 2.When mwmstore is flushed to HDFS- does it dump the memstore > Concurrentskiplist as Hfile2? Then How

Re: hbase architecture doubts

2016-05-01 Thread Ted Yu
For #1, in branch-1, please take a look at DefaultMemStore.java where you would see: // MemStore. Use a CellSkipListSet rather than SkipListSet because of the // better semantics. The Map will overwrite if passed a key it already had // whereas the Set will not add new Cell if key is sam

hbase architecture doubts

2016-05-01 Thread Shushant Arora
1.Does Hbase uses ConcurrentskipListMap(CSLM) to store data in memstore? 2.When mwmstore is flushed to HDFS- does it dump the memstore Concurrentskiplist as Hfile2? Then How does it calculates blocks out of CSLM and dmp them in HDFS. 3.After dumping the inmemory CSLM of memstore to HFILe does mem