Re: Using PCIe SSDs instead of RAM

2010-07-25 Thread dormando
On Fri, Jul 23, 2010 at 8:47 AM, dormando dorma...@rydia.net wrote: I tried. Try the engine branch? I guess, I'll have to at some point. Just wanted to say, that LRU was designed as an algorithm for a uniform cost model, where all elements are almost equally important (have

Re: Using PCIe SSDs instead of RAM

2010-07-25 Thread Jakub Łopuszański
Thanks for an explanation. I see that we have entirely different points of view, probably caused by totally different identified sets of bottlenecks, different usage, different configurations etc (I assume that you have greater experience, since my is restricted to one company, with just 55

Re: Using PCIe SSDs instead of RAM

2010-07-25 Thread dormando
On Sun, 25 Jul 2010, Jakub Łopuszański wrote: Thanks for an explanation. I see that we have entirely different points of view, probably caused by totally different identified sets of bottlenecks, different usage, different configurations etc (I assume that you have greater experience,

Re: Using PCIe SSDs instead of RAM

2010-07-23 Thread Jakub Łopuszański
While I agree with most of your thesis, I can't see how GC is against the LRU. I agree, that often accessed keys with short TTL seem strange, and so do rarely accessed keys with long TTL. But there are lots of perfect reasons to have such situation, and we do. GC does not work against the LRU (at

Re: Using PCIe SSDs instead of RAM

2010-07-23 Thread dormando
I tried. Try the engine branch? On Fri, 23 Jul 2010, Jakub Łopuszański wrote: While I agree with most of your thesis, I can't see how GC is against the LRU. I agree, that often accessed keys with short TTL seem strange, and so do rarely accessed keys with long TTL. But there are lots of

Re: Using PCIe SSDs instead of RAM

2010-07-23 Thread Jakub Łopuszański
On Fri, Jul 23, 2010 at 8:47 AM, dormando dorma...@rydia.net wrote: I tried. Try the engine branch? I guess, I'll have to at some point. Just wanted to say, that LRU was designed as an algorithm for a uniform cost model, where all elements are almost equally important (have the same cost of

Re: Using PCIe SSDs instead of RAM

2010-07-23 Thread Ben Manes
: Re: Using PCIe SSDs instead of RAM On Fri, Jul 23, 2010 at 8:47 AM, dormando dorma...@rydia.net wrote: I tried. Try the engine branch? I guess, I'll have to at some point. Just wanted to say, that LRU was designed as an algorithm for a uniform cost model, where all elements are almost

Re: Using PCIe SSDs instead of RAM

2010-07-23 Thread Dustin
On Jul 23, 11:31 am, Ben Manes ben_ma...@yahoo.com wrote: There are alternatives to LRU, which is generally chosen for being extremely simple to implement, fast, and has a reasonable hit rate. The Greedy-Dual-Size-Frequency policy may be more appropriate for memcached as it accounts a value's

Re: Using PCIe SSDs instead of RAM

2010-07-22 Thread Jakub Łopuszański
I see that my patch for garbage collection is still being ignored, and your post gives me some idea about why it is so. I think that RAM is a real problem, because currently (without GC) you have no clue about how much RAM you really need. So you can end up blindly buying more and more machines,

Re: Using PCIe SSDs instead of RAM

2010-07-22 Thread Brian Moon
On 7/22/10 5:46 AM, Jakub Łopuszański wrote: I see that my patch for garbage collection is still being ignored, and your post gives me some idea about why it is so. I think that RAM is a real problem, because currently (without GC) you have no clue about how much RAM you really need. So you can

Re: Using PCIe SSDs instead of RAM

2010-07-22 Thread Jakub Łopuszański
Well, I beg to differ. We used to have evictions 0, actually around 200 (per whatever munin counts them), so we used to think, that we have too small number of machines, and kept adding them. After using the patch, the memory usage dropped by 80%, and we have no evictions since a long time, which

Re: Using PCIe SSDs instead of RAM

2010-07-22 Thread Brian Moon
On 7/22/10 2:02 PM, Jakub Łopuszański wrote: Well, I beg to differ. We used to have evictions 0, actually around 200 (per whatever munin counts them), so we used to think, that we have too small number of machines, and kept adding them. After using the patch, the memory usage dropped by 80%,

Re: Using PCIe SSDs instead of RAM

2010-07-22 Thread dormando
http://code.google.com/p/memcached/wiki/NewServerMaint#Looks_Can_be_Deceiving Think I'll write a separate page about managing memory, based off of the slides from my mysqlconf presentation about monitoring memcached... We're not ignoring you, the patch is against what the LRU is designed for.

Re: Using PCIe SSDs instead of RAM

2010-07-14 Thread David Raccah
increasing every year. When I thought of using PCIe SSDs instead of RAM I wasn't doing this with regard to persistence of objects. I just noticed, that the Fusion- io's ioDrives are working with near-RAM speed, having the PCIe bus as the only bottleneck in speed (don't mix it up with SATA SSDs

Re: Using PCIe SSDs instead of RAM

2010-07-13 Thread Mitch
access to RAM. But RAM is still very expensive - even with the amount of RAM you get for the same money increasing every year. When I thought of using PCIe SSDs instead of RAM I wasn't doing this with regard to persistence of objects. I just noticed, that the Fusion- io's ioDrives are working

Using PCIe SSDs instead of RAM

2010-07-09 Thread Marten Lehmann
Hello, I know that memcached is designed to get its speed from the fast access to RAM. But RAM is still very expensive - even with the amount of RAM you get for the same money increasing every year. When I thought of using PCIe SSDs instead of RAM I wasn't doing this with regard to persistence