Hello Stack, Thank you for analyzing. Now just quick answer on your question.
2010/1/16 stack <[email protected]> > Looking at our log again Dmitry, you are flushing a lot under load -- > sometimes multiple times per second. > > 2010-01-15 13:52:52,430 DEBUG org.apache.hadoop.hbase.regionserver.Store: > Added hdfs://nn1/hbase/2/1459207030/contents/3021941585147682122, > entries=492, sequenceid=129985024, memsize=5.3m, filesize=5.2m to > 2,\x00\x01\x27D,1263549378148 > > I notice that we are flushing at ~6.4M or so rather than at the usual 64M. > Did you change that setting? If so, that'd help explain why we're having > some trouble keeping up -- lots of small files. > As I understood hbase.hregion.memstore.block.multiplier parameter impacts on this parameter. I have multiplier equal to 12. It helped me in case 5Kb rows, but seems not effective with 25Kb rows. I'll provide test results a bit later. Dmitriy.
