I think you may want to think a bit about this…
How far do you want to go with your memory management?
'Off heap' is a new nifty way of saying application level swap and memory
management. So what you are basically saying is that I have memory, local
persistence, then HDFS persistence.
And
Hi Michael,
All what you said is exactly what I have in mind. Being able to have a
layered hierarchy with different storage engines ((Flash, SSD, Memory,
etc.) that you can configure. It's not just offheap, but anything which can
offload the BlockCache and which is still faster than going to the
Hi J-M,
N-leveled caching is something I've discussed with some folks but it hasn't
been done. We already have multi-cache management strategies, such as
CombinedBlockCache, so this would be making them more generic and exposing
through configuration. Something you'd be interested in taking on?
Hi,
Is it possible to have 2 bucket cache on a single region server?
Like L2 and L3? I would like to have L2 offheap and block evicted from L2
going into L3 on SSD. So we already have something like that? Or should I
open a JIRA?
hbase.bucketcache.ioengine can get only one value. Might be nice
