Re: Clarification on Hardware Requirements and Performance

2016-08-30 Thread Joseph Grasser
I just left my client so this is not a pressing concern anymore, but my curiosity is peaked. What kind of compression would you recommend? How much strain does that but on compute resources? Would that lower qps? On Sat, Aug 27, 2016 at 2:14 AM, Ripduman Sohan wrote: > > > On 27 August 2016 at 1

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread dormando
Thanks! You can reallocate pages in newer versions. as I said before the `-o modern` on the latest ones does that automatically so long as you have some free space for it to work with (the lru_crawler and using sane TTL's helps there). Otherwise you can use manual controls as listed in doc/protoco

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread Joseph Grasser
Hey Guys, thank you so much for everything This community is awesome; the product is awesome; everyone here is awesome; and most of all everyone on this thread is awesome! On Sat, Aug 27, 2016 at 3:05 PM, Joseph Grasser wrote: > So, when I compare the total pages with the unfetched evictions I

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread Joseph Grasser
So, when I compare the total pages with the unfetched evictions I do notice skew. We should probably reallocate the pages to better fit our usage pattern. On Sat, Aug 27, 2016 at 2:46 PM, dormando wrote: > Probably. > > Look through `stats slabs` and `stats items` to see if evictions skew > towa

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread dormando
Probably. Look through `stats slabs` and `stats items` to see if evictions skew toward slabs without enough pages in it, that sort of thing. That's all fixed (or improved) in more recent versions (with enough feature flags enabled) you can also telnet in and run `watch evictions` to get a stream

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread Joseph Grasser
echo "stats" shows the following : cmd_set 3,000,000,000 evicted_unfetched 2,800,000,000 evictions 2,900,000,000 This looks super abusive to me. What, is that 6% utilization of data in cache? On Sat, Aug 27, 2016 at 1:35 PM, dormando wrote: > You could comb through stats looking for things like

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread dormando
You could comb through stats looking for things like evicted_unfetched, unbalanced slab classes, etc. 1.4.31 with `-o modern` can either make a huge improvement in memory efficiency or a marginal one. I'm unaware of it being worse. Just something to consider if cost is your concern. On Sat, 27 A

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread Joseph Grasser
We are running 1.4.13 on wheezy. In the environment I am looking at there is positive correlation between gets and puts. The ration is something like 10 Gets : 15 Puts. The eviction spikes are also occurring at peak put times ( which kind of makes senses with the mem pressure ). I think the applic

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread dormando
What version are you on and what're your startup options, out of curiosity? A lot of the more recent features can help with memory efficiency, for what it's worth. On Sat, 27 Aug 2016, Joseph Grasser wrote: > > No problem, I'm trying cut down on cost. We're currently using a dedicated > model w

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread Ripduman Sohan
On 27 August 2016 at 10:05, Joseph Grasser wrote: > No problem, I'm trying cut down on cost. We're currently using a dedicated > model which works for us on a technical level but is expensive (within > budget but still expensive). > > We are experiencing weird spikes in evictions but I think that

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread Joseph Grasser
No problem, I'm trying cut down on cost. We're currently using a dedicated model which works for us on a technical level but is expensive (within budget but still expensive). We are experiencing weird spikes in evictions but I think that is the result of developers abusing the service. Tbh I don'

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread Ripduman Sohan
> > > On Aug 27, 2016 1:46 AM, "dormando" wrote: > >> > >> > Thank you for the tips guys! >> > >> > The limiting factor for us is actually memory utilization. We are using >> the default configuration on sizable ec2 nodes and pulling only like 20k >> qps per node. Which is fine >> > because we nee

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread Joseph Grasser
I don't really have high visibility into the average item size but I see what you mean. Stats should give us good info on that right? On Aug 27, 2016 1:46 AM, "dormando" wrote: > > > > Thank you for the tips guys! > > > > The limiting factor for us is actually memory utilization. We are using >

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread dormando
> > Thank you for the tips guys! > > The limiting factor for us is actually memory utilization. We are using the > default configuration on sizable ec2 nodes and pulling only like 20k qps per > node. Which is fine > because we need to shard the key set over x servers to handle the mem req > (30G

Re: Clarification on Hardware Requirements and Performance

2016-08-27 Thread Joseph Grasser
Thank you for the tips guys! The limiting factor for us is actually memory utilization. We are using the default configuration on sizable ec2 nodes and pulling only like 20k qps per node. Which is fine because we need to shard the key set over x servers to handle the mem req (30G) per server. I s

Re: Clarification on Hardware Requirements and Performance

2016-08-26 Thread Ripduman Sohan
I believe it's standard memcached compared on kernel and OpenOnload TCP stacks. I have had no involvement with this though so it's just conjecture on my part. I guess sa...@solarflare.com knows more, I can find out if it helps. On 26 August 2016 at 23:37, dormando wrote: > Is that still using

Re: Clarification on Hardware Requirements and Performance

2016-08-26 Thread dormando
Is that still using a modified codebase? On Fri, 26 Aug 2016, Ripduman Sohan wrote: > Some more > numbers:https://www.solarflare.com/Media/Default/PDFs/Solutions/Solarflare-Accelerating-Memcached-Using-Flareon-Ultra-server-IO-adapter.pdf > > On 26 August 2016 at 07:08, Henrik Schröder wrote: >

Re: Clarification on Hardware Requirements and Performance

2016-08-26 Thread Ripduman Sohan
Some more numbers: https://www.solarflare.com/Media/Default/PDFs/Solutions/Solarflare-Accelerating-Memcached-Using-Flareon-Ultra-server-IO-adapter.pdf On 26 August 2016 at 07:08, Henrik Schröder wrote: > Anecdotal datapoint: I have a machine with 2xE5520 (Xeon server processor > from 2009) whic

Re: Clarification on Hardware Requirements and Performance

2016-08-25 Thread Henrik Schröder
Anecdotal datapoint: I have a machine with 2xE5520 (Xeon server processor from 2009) which does ~300k requests/s, and handles ~400Mbps of network traffic, but only using ~5% of the CPU. It's been my experience that you will saturate your network way before you'll saturate your CPU on pretty much a

Clarification on Hardware Requirements and Performance

2016-08-25 Thread Joseph Grasser
It is written in the docs that "On a fast machine with very high speed networking, memcached can easily handle 200,000+ requests per second." How fast does a machine have to be in order to server that load easily? What are the hardware requirements for such a server? https://github.com/memcache