On Thu, Apr 21, 2011 at 7:00 PM, Zhoushuaifeng <[email protected]> wrote: > I'm running random scan and put performance test at the same time, found > that put performance descend a lot. Don't know why. > Looking into the logs, found that "Block cache LRU eviction" occured almost > once per second. But it only last about 10 ms, so, will it bring so much > influence to put performance? And how to improve it? >
I would think that there would be little to no relation between put and block cache evictions. > hbase-root-regionserver-c3s5.log.2011-04-19:2011-04-19 21:00:00,067 DEBUG > org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction > started; Attempting to free 163.35 MB of total=1.36 GB > hbase-root-regionserver-c3s5.log.2011-04-19:2011-04-19 21:00:00,081 DEBUG > org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction > completed; freed=163.39 MB, total=1.2 GB, single=973.98 MB, multi=400.97 MB, > memory=0 KB > It looks like each time it runs its evictly ~10 percent. You are doing lots of scans that go via the block cache? Regards the puts, tell us more. How many clients, what type of clients, regions, regionservers, versions of hbase and hadoop, etc. You've seen this page? http://hbase.apache.org/book.html#performance St.Ack
