Re: SERVER_ERROR out of memory storing object with memcached 1.4.10

2012-01-09 Thread Santi Saez

El 09/01/12 06:12, dormando escribió:


Hey, could you please try to reproduce the issue with 1.4.11-beta1:
http://code.google.com/p/memcached/wiki/ReleaseNotes1411beta1

I've closed the logic issues and fixed a few other things besides. Would
be very good to know if you're still able to bug it out.

Thanks!
-Dormando


Using 1.4.11-beta1 I can't reproduce out of memory storing object 
error, thanks!


--Santi


all our memcached servers failing w/ EPIPE from time to time, but ...

2012-01-09 Thread Christian Parpart
Hey all,

we have a sharded memcached cluster of 5 nodes.
Last week we once had a problem that one of our memcached
servers had really big issues, and only a cold process restart
helped getting it back.

The phenomena was/is that we had lots of memcached clients
getting an EPIPE, and as soon as we identified the failing
memcached node and could not connect using fresh tiny
test-scripts nor directly either.

First we thought it *MIGHT* be also a hardware issue, or whatnot,
and we wrote a monitoring test (checking every memcached node
every 10 seconds individually connecting to it, test-writing, rereading
and comparing the values, and report on error).

The result though, is, that we get EPIPEs and even rare EOFs
quite regulary, not that often that we (do not yet know, we) should
care about, but we now know of **two** cases where
we had a peak EPIPE scenario (one very big, one somewhat big)
where once only a restart helped.

We came to the conclusion, that it definitely might some issue
with the software itself, and though, seek help from upstream, in the hope
to get any kind of advise, help, or whatever you think
that might help us in getting such things fixed.

FYI: the clients are all ruby using standard gem redis version 2.1.1
and memcached version 1x 1.4.4 and 4x 1.4.2.

Many thanks for any thoughts :)
Christian Parpart.


Re: SERVER_ERROR out of memory storing object with memcached 1.4.10

2012-01-09 Thread dormando
 El 09/01/12 06:12, dormando escribió:

  Hey, could you please try to reproduce the issue with 1.4.11-beta1:
  http://code.google.com/p/memcached/wiki/ReleaseNotes1411beta1
 
  I've closed the logic issues and fixed a few other things besides. Would
  be very good to know if you're still able to bug it out.
 
  Thanks!
  -Dormando

 Using 1.4.11-beta1 I can't reproduce out of memory storing object error,
 thanks!

Awesome! Thanks for verifying so quickly. I'll try to wrap this up into an
-rc1 today. Hoping some other people try it too :)


Storage Engine ?

2012-01-09 Thread Wendy Cheng
There are archived discussions floating around about this subject,
particularly with SSD. Are there open source works (implementation,
src code, interface description, etc) available for people to take a
look ?

Thanks,
Wendy


Re: Storage Engine ?

2012-01-09 Thread dormando
 There are archived discussions floating around about this subject,
 particularly with SSD. Are there open source works (implementation,
 src code, interface description, etc) available for people to take a
 look ?

There is a working and well used engine implementation in the engine-pu
branch:
https://github.com/memcached/memcached/tree/engine-pu

There's also a download on the google code site of an older beta release
of 1.6.0. Included in the source tree is the default engine, which should
serve as a good example. Others exist if you google around.


Re: Storage Engine ?

2012-01-09 Thread Dustin

On Monday, January 9, 2012 2:13:36 PM UTC-8, Wendy Cheng wrote:

 Found an expired RFC at
 http://code.google.com/p/memcached/wiki/EngineInterface. Look pretty
 old though. Wondering whether there are (open source) implementation
 works associated with it ?

It's pretty solid (in production under heavy load in numerous sites) and a 
few of us have a lot of experience writing engines.  Please do ask 
questions.



Re: Storage Engine ?

2012-01-09 Thread Wendy Cheng
On Mon, Jan 9, 2012 at 2:21 PM, dormando dorma...@rydia.net wrote:
 There are archived discussions floating around about this subject,
 particularly with SSD. Are there open source works (implementation,
 src code, interface description, etc) available for people to take a
 look ?

 There is a working and well used engine implementation in the engine-pu
 branch:
 https://github.com/memcached/memcached/tree/engine-pu

 There's also a download on the google code site of an older beta release
 of 1.6.0. Included in the source tree is the default engine, which should
 serve as a good example. Others exist if you google around.

Cool ! I'm pulling the code right now. Great thanks ! ... Wendy