Do you have compression enabled, and is your data highly compressible? On Mon, Mar 27, 2017 at 6:26 AM, Hef <hef.onl...@gmail.com> wrote:
> Hi, > Does anyone have an idea why most of my 128MB memstore flushed files are > only several MBs? > > There are a lot of logs look as below: > > 2017-03-27 13:10:25,064 INFO > org.apache.hadoop.hbase.regionserver.DefaultStoreFlusher: Flushed, > sequenceid=13042496, memsize=128.0 M, hasBloomFilter=true, into tmp file > hdfs://xxxxx > 2017-03-27 13:10:25,093 INFO org.apache.hadoop.hbase.regionserver.HStore: > Added > hdfs://nameservice1/hbase/data/default/mytable/ > 82f4e7d6931a57edf9654f32625f9fb7/t/0f59c07ef24644a38dce577d7fb6ac1b, > entries=545226, sequenceid=13042496, filesize=7.3 M > 2017-03-27 13:10:25,094 INFO org.apache.hadoop.hbase.regionserver.HRegion: > Finished memstore flush of ~128.02 MB/134235405, currentsize=352.34 > KB/360800 for region > mytable,3808555269964B038A7BC1EC6CC19B03\x00\x00\x00\x00\x00\x00\ > x00\xA7\x00\x06P\xC9])\x9A\xC9\x01\xA9Q<\xBDX\x88\x07\ > x82\xEAR\xD7,1490340797381.82f4e7d6931a57edf9654f32625f9fb7. > in 1052ms, sequenceid=13042496, compaction requested=false > > A 128MB memstore flushed to be only 7.3MB hfile, is that normal? > In what case could this happen? > > Thanks > Hef >
